-- Logs begin at Mon 2022-04-11 15:45:56 UTC, end at Mon 2022-04-11 17:09:41 UTC. -- Apr 11 16:35:57.469936 dv-cinder-837166-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 11 16:35:57.477439 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 11 16:35:57.482617 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Apr 11 16:35:57 2022] *** Apr 11 16:35:57.482617 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 11 16:35:57.482617 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 11 16:35:57.482617 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: nodename: dv-cinder-837166-2-iscsi Apr 11 16:35:57.482617 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: machine: x86_64 Apr 11 16:35:57.482617 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: clock source: unix Apr 11 16:35:57.482617 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: pcre jit disabled Apr 11 16:35:57.482617 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: detected number of CPU cores: 4 Apr 11 16:35:57.482617 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: current working directory: / Apr 11 16:35:57.482617 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: detected binary path: /usr/bin/uwsgi-core Apr 11 16:35:57.482617 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: your processes number limit is 47680 Apr 11 16:35:57.482617 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: your memory page size is 4096 bytes Apr 11 16:35:57.482617 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: detected max file descriptor number: 2048 Apr 11 16:35:57.482617 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: lock engine: pthread robust mutexes Apr 11 16:35:57.482617 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: thunder lock: enabled Apr 11 16:35:57.482617 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 11 16:35:57.482617 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 11 16:35:57.527717 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: Python main interpreter initialized at 0x5628f91039c0 Apr 11 16:35:57.527717 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: python threads support enabled Apr 11 16:35:57.527717 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: your server socket listen backlog is limited to 100 connections Apr 11 16:35:57.527717 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: your mercy for graceful operations on workers is 90 seconds Apr 11 16:35:57.528075 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: mapped 403077 bytes (393 KB) for 2 cores Apr 11 16:35:57.528142 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: *** Operational MODE: preforking *** Apr 11 16:35:57.528427 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: *** uWSGI is running in multiple interpreter mode *** Apr 11 16:35:57.528427 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: spawned uWSGI master process (pid: 86329) Apr 11 16:35:57.530107 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: spawned uWSGI worker 1 (pid: 86345, cores: 1) Apr 11 16:35:57.530107 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: spawned uWSGI worker 2 (pid: 86346, cores: 1) Apr 11 16:35:57.528629 dv-cinder-837166-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 11 16:35:57.535753 dv-cinder-837166-2-iscsi devstack@keystone.service[86329]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 11 16:36:03.349754 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 16:36:03.349754 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: from cryptography.utils import int_from_bytes Apr 11 16:36:03.350472 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 16:36:03.350472 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: from cryptography.utils import int_from_bytes Apr 11 16:36:03.351314 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 16:36:03.351314 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: from cryptography.utils import int_from_bytes Apr 11 16:36:03.351767 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 16:36:03.351767 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: from cryptography.utils import int_from_bytes Apr 11 16:36:03.400972 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 16:36:03.401159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 16:36:03.401357 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] command line args: [] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 16:36:03.401600 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 16:36:03.401778 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ================================================================================ {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 16:36:03.402030 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] admin_token = **** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.402274 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] config_dir = [] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.402421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 16:36:03.402509 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.402687 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 16:36:03.402771 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] config_source = [] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.402831 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] command line args: [] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 16:36:03.402899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] debug = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.403066 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.403256 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 16:36:03.403256 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ================================================================================ {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 16:36:03.403878 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.404262 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.404469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] admin_token = **** {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.404725 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] config_dir = [] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.404864 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.404945 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.405116 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] config_source = [] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.405226 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.405299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] debug = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.405375 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] list_limit = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.405437 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.405522 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] log_config_append = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.405737 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.405839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.405916 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.405984 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] log_dir = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.406044 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] log_file = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.406106 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.406333 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.406433 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.406506 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] list_limit = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.406567 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.406809 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] log_config_append = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.406890 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.406952 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.407147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] log_dir = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.407253 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.407327 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] log_file = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.407395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.407395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.407509 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.407732 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.407845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.407920 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.407988 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.408183 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.408281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.408281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.408403 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.408469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.408687 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.408786 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.408856 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.408916 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.409119 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.409223 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.409293 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.409354 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.409548 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.409757 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.409757 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.410055 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.410351 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.410351 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] publish_errors = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.410807 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.411001 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.411115 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.411422 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.411422 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.411804 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.73/identity {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.412007 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.412179 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] publish_errors = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.412373 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.412557 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.412722 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] standard_threads = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.412953 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.413100 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.413232 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.413411 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.413553 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.413684 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.413812 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.413949 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] use_journal = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.414116 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] standard_threads = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.414264 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] use_json = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.414264 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] use_stderr = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.414519 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.414688 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] use_syslog = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.414829 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.414966 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.415106 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.415106 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] use_journal = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.415353 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.415551 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] use_json = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.415699 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.415830 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] use_stderr = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.415830 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] use_syslog = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.416093 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.416230 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 16:36:03.416360 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.416500 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.416637 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.416776 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.416912 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.417043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.417172 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.417307 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.417437 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.417639 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.417771 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.417901 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.418030 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.418158 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.418296 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.418438 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.418568 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.418732 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.418862 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.418993 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.419158 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.419292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.419422 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.420071 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.420204 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.420335 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.420477 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.420615 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.420759 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.420895 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.421026 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.421167 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.421305 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.421444 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.421575 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.421704 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.421834 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.421970 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.422113 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.422245 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.422377 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.422514 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.422701 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.422836 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.422979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.423111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.423241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.423371 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.423371 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.423626 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.423764 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.423896 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.424025 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.424154 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.424283 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.424423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.424631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.424764 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.424893 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.425022 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.425151 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.425286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.425424 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.425557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.425687 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.425816 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.425951 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.426087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.426227 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.426369 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.426499 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.426665 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.426802 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.426932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.427070 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.427201 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.427331 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.427460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.427589 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.427728 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.427867 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.428003 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.429209 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.429385 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.429584 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.429822 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.430024 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.430195 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.430390 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.430621 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.430792 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.431030 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.431197 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.431392 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.431585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.431815 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.431997 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.432244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.432412 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.432674 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.432882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.433051 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.433281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.433490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.433660 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.433856 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.434052 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.434255 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.434420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.434625 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.434793 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.434930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.435062 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.435782 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.435954 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.436102 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.436244 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.436377 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.436522 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.436657 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.436797 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.436930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.437075 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.437254 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.437393 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.437536 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.437677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.437811 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.437942 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.438082 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.438215 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.438215 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.438470 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.438661 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.438801 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.438801 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.439079 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.439211 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.439341 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.439472 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.439603 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.439745 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.439912 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.440076 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.440212 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.440349 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.440480 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.440619 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.440751 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.440892 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.441035 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.441179 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.441324 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.441529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.441669 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.441801 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.441932 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.442062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.442199 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.442340 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.442472 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.442636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.442776 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.442776 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.443035 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.443178 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.443310 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.443310 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.443559 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.443690 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.443828 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.443960 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.444091 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.444228 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.444359 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.444491 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.444630 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.444783 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.444929 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.445061 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.445192 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.445322 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.445454 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.445454 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.445709 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.445842 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.445973 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.446103 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.446235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.446367 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.446508 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.446682 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.446818 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.446948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.447078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.447208 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.447350 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.447491 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.447491 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.447741 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.447871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.448003 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.448003 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.448263 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.448404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] auth.external = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.448535 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.448667 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.448798 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] auth.external = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.448798 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.449056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.449218 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.449360 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.449493 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.449625 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] auth.password = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.449756 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] auth.password = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.449888 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] auth.token = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.450031 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] auth.token = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.450173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.450305 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.450445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.450577 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.450801 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.450948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.451099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.451232 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.451365 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.451497 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.451638 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.451772 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.451905 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.452042 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.452192 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] credential.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.452331 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] credential.caching = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.452473 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.452606 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.452745 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.452879 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.453011 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.453143 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.453287 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.453421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.453553 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.453684 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.453817 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.453948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.454097 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.454231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.454363 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.454494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.454641 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.454780 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.454925 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.455059 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.455198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.455331 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.455463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.455595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.455740 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.455885 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.456019 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.456150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.456281 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.456419 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.456565 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] federation.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.456699 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] federation.caching = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.456830 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.456962 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.457094 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.457225 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.457435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.457570 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.457703 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.457846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.457977 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.458111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.458252 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.458386 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.458525 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.458719 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.458856 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.458988 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.459130 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.459264 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.459397 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.459529 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.459671 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.459803 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.459945 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.460078 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] identity.caching = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.460211 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.460343 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.460475 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.460606 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.460747 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.460888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.461029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.461180 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.461314 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.461450 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.461600 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.461734 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.461866 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.461998 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.462129 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.462261 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.462401 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.462533 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.462688 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.462821 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.462953 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.463084 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.463228 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.463373 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.463505 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.463637 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.463768 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.463911 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.464045 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.464176 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.464309 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.464441 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.464573 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.464714 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.464848 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.464979 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.465110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.465252 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.465386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.465527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.465660 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.465793 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.465926 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.466057 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.466194 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.466357 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.466498 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.466658 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.466798 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.466931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.467075 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.467217 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.467351 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.467484 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.467617 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.467748 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.467880 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.468020 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.468154 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.468286 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.468286 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.468537 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.468669 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.468809 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.468957 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.469090 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.469221 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.469353 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.469484 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.469626 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.469766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.469900 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.470032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.470163 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.470295 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.470434 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.470568 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.470725 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.470870 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.471010 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.471146 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.471290 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.471424 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.471557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.471689 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.471828 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.471962 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.472102 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.472235 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.472367 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.472499 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.472640 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.472773 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.472913 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.473049 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.473187 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.473326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.473458 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.473590 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.473730 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.473864 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.473996 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.474129 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.474260 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.474392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.474545 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.474712 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.474847 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.474979 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.475110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.475242 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.475385 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.475527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.475665 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.475804 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.475943 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.476081 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.476227 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.476369 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.476518 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.476657 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.476794 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.476943 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.477083 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.477222 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.477360 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.477498 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.477636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.477782 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.477923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.478062 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.478200 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.478349 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.478488 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.478655 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.478802 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.478941 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.479080 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.479224 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.479363 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.479511 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.479651 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.479790 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.479928 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.480067 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.480205 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.480363 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.480503 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.480642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.480779 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.480917 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.481065 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.481214 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.481355 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.481494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.481632 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.481771 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.481909 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.482567 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.482788 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.482939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.483079 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.483218 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.483356 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.483506 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.483646 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.483785 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.483923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.484061 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.484061 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.484398 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.484540 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.484678 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.484827 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] resource.caching = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.484966 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.485104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.485249 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] resource.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.485391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.485529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.485667 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.485805 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.485943 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.486094 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.486235 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.486374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.486512 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.486670 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.486822 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.486972 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.487113 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.487252 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.487391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.487529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.487667 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] role.caching = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.487814 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.487960 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] role.driver = sql {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.488099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] role.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.488237 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.488376 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] role.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.488521 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.488669 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.488819 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.488959 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.489098 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.489236 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.489374 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.489522 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.489663 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.489802 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.489940 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.490078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.490216 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.490363 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.490503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.490734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.490879 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.491023 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.491165 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.491313 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.491453 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.491593 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.491731 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.491871 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.492019 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.492160 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.492160 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.492424 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.492424 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.492701 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.492849 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.492991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.493130 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.493269 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.493408 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.493547 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.493695 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.493836 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.493975 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.494115 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.494253 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.494401 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.494549 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.494712 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.494853 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.494990 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.495128 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.495266 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.495415 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.495556 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.495694 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.495834 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.495972 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.496110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.496257 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.496408 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.496547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.496685 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.496824 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.496973 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.497121 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.497261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.497400 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.497539 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.498232 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] token.caching = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.498379 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.498530 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.498711 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] token.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.498863 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.499004 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.499142 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.499281 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.499432 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.499574 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.499714 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.499854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.499994 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.500141 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.500282 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.500423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.500561 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.500700 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.500850 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.500999 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.501151 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.501291 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.501430 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.501569 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.501708 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.501855 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.501996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.502136 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.502274 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.502412 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.502550 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.502728 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.502881 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.503021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.503161 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.503301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.503440 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.connection = **** {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.503591 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.503740 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.503895 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.connection = **** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.504044 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.504195 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.504336 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.504475 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.504614 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.504765 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.504914 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.505056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.505196 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.505336 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.505476 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.505616 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.505763 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.505906 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.506046 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.506186 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.506326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.506465 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.506640 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.506802 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.506942 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.507083 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.507222 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.507363 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.507581 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.507725 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.507866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.507866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.508131 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.508270 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.508419 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.508560 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.508700 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.508849 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86346) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 16:36:03.508991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.508991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 16:36:03.508991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86345) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 16:36:03.518135 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.518365 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.518610 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.518824 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.519057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.519289 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.527237 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.528010 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.555711 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.555938 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.556696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.556931 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.610529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.610797 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.660133 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.660395 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.660551 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.660710 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.727229 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.727516 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.727689 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.727840 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.727983 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.728124 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.728264 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.728413 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.728556 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.728696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.728850 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.728850 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.752533 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.752759 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.752908 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.753049 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.753190 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.753331 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.753481 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.753623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.753785 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.753925 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.754065 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.754220 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.754364 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.754511 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.765230 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.765434 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.778413 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.778673 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.779321 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.779489 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.779636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.779779 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.779937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.780082 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.780223 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.780363 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.780504 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.780654 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.780796 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86345) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.780937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86346) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 16:36:03.797810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.798016 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 16:36:03.798348 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.798544 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 16:36:03.798721 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.798865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 16:36:03.799005 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.799146 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.799297 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.799297 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 16:36:03.799567 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.799718 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.799859 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.800007 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.800007 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.800275 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.810387 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.810679 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.810946 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.811197 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.811347 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.811491 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.811715 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.811988 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.819208 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:03.820014 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:03.822431 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:03.822834 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.823116 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.823393 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.823541 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:03.823683 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.823823 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.823975 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.824116 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.824265 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.824407 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.824548 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.824689 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.824829 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.824978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.825121 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.825262 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.825402 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.825563 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.825563 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.825842 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.826103 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.852789 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.853095 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.854575 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:03.854711 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:03.856054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.856151 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.861051 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:03.861226 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:03.861368 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.861496 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.861771 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.861855 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.869042 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:03.869281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:03.869368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.869637 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.873931 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:03.874213 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.874431 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:03.874542 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.874774 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.874859 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.875040 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.875125 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.875306 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.875527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.875612 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.875816 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.875899 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.876217 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.876550 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.876884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.894841 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.895113 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.896053 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.896394 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.899614 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:03.901097 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:03.904605 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.904605 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.905505 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.905871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.910276 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:03.911051 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:03.915533 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:03.916456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:03.919282 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.920156 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.920407 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.920692 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.920968 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.921054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.921254 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.921339 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.921695 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.922043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.922385 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:03.922774 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.043379 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:04.043736 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.043945 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.044033 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:04.044215 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.044337 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.044619 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.045412 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.052583 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.053244 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.054274 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.054547 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.054959 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.055235 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.057844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:04.058131 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.058216 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:04.058498 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.058615 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.058877 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.058963 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.059152 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.059257 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.059509 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.072235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:04.072516 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.072602 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:04.072792 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.072879 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.073066 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.073162 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.073342 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.073439 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.073623 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.073710 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.073893 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.073980 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.074187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.092735 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:04.094899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:04.096024 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:04.098129 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:04.099369 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.100970 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.101465 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.102769 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:04.103049 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.103187 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.103331 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.104820 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:04.105097 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.105396 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.111211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.112768 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:04.113195 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.114941 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:04.115999 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.116298 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.116595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.116870 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.118184 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.118467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.118780 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.119054 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.126063 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:04.126349 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.126654 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.128293 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:04.128583 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.128859 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.134665 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86346) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:04.135005 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.135344 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.135668 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.135940 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.136226 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.136504 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.136789 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.137061 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.137434 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.137709 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.137982 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.138276 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.138552 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86346) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.138932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86345) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 16:36:04.139139 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.139542 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.139818 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.140087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.140451 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.140819 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.141180 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.141822 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.142323 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.142730 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.143090 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.143436 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.143708 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86345) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 16:36:04.177184 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5628f91039c0 pid: 86346 (default app) Apr 11 16:36:04.180653 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfd7b4-1c38-4703-9e48-b8383d4f223c None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:04.180948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfd7b4-1c38-4703-9e48-b8383d4f223c None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:04.181226 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcfd7b4-1c38-4703-9e48-b8383d4f223c None None] PATH_INFO: `/v3` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:04.182317 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5628f91039c0 pid: 86345 (default app) Apr 11 16:36:04.185470 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1/1] 10.222.0.73 () {50 vars in 791 bytes} [Mon Apr 11 16:36:04 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:12.395429 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9d5dd-d73d-4de0-9182-b640b6a9b93a None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:12.395980 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9d5dd-d73d-4de0-9182-b640b6a9b93a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:12.395980 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9d5dd-d73d-4de0-9182-b640b6a9b93a None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:12.400274 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1/2] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:12 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:36:12.405969 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28cafb-2ef1-4217-b516-94ff08d2d741 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:12.406464 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28cafb-2ef1-4217-b516-94ff08d2d741 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:12.406557 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28cafb-2ef1-4217-b516-94ff08d2d741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:12.437246 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG oslo_db.sqlalchemy.engines [None req-1e28cafb-2ef1-4217-b516-94ff08d2d741 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86346) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:36:12.615749 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG passlib.handlers.bcrypt [None req-1e28cafb-2ef1-4217-b516-94ff08d2d741 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86346) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 11 16:36:12.616155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG passlib.handlers.bcrypt [None req-1e28cafb-2ef1-4217-b516-94ff08d2d741 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86346) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 11 16:36:12.671660 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-1e28cafb-2ef1-4217-b516-94ff08d2d741 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:12.673189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-1e28cafb-2ef1-4217-b516-94ff08d2d741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:12.793170 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 2/3] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Apr 11 16:36:12.967428 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9d5dd-d73d-4de0-9182-b640b6a9b93a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:13.000081 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG oslo_db.sqlalchemy.engines [None req-49c9d5dd-d73d-4de0-9182-b640b6a9b93a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86345) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 16:36:13.124857 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c9d5dd-d73d-4de0-9182-b640b6a9b93a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:13.129062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f67175c-7e0f-47c3-bd50-8480eeb83cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:13.129717 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67175c-7e0f-47c3-bd50-8480eeb83cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:13.130000 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67175c-7e0f-47c3-bd50-8480eeb83cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:13.130271 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f67175c-7e0f-47c3-bd50-8480eeb83cf2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:13.138814 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67175c-7e0f-47c3-bd50-8480eeb83cf2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:13.188819 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4f67175c-7e0f-47c3-bd50-8480eeb83cf2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 11 16:36:13.189149 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f67175c-7e0f-47c3-bd50-8480eeb83cf2 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:13.198209 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 2/4] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Apr 11 16:36:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:36:13.205436 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28cafb-2ef1-4217-b516-94ff08d2d741 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:13.219326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28cafb-2ef1-4217-b516-94ff08d2d741 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:13.223732 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceec92a-3a93-4474-8496-90e574d8a703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:13.224918 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceec92a-3a93-4474-8496-90e574d8a703 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:13.225295 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceec92a-3a93-4474-8496-90e574d8a703 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:13.225649 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceec92a-3a93-4474-8496-90e574d8a703 admin admin] PATH_INFO: `/v3/projects/f8c9bf4c662c47e3808d264d2ea01d67` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:13.227230 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceec92a-3a93-4474-8496-90e574d8a703 admin admin] RBAC: Authorizing `identity:get_project(project_id=f8c9bf4c662c47e3808d264d2ea01d67)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:13.279742 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.common.rbac_enforcer.enforcer [None req-eceec92a-3a93-4474-8496-90e574d8a703 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 11 16:36:13.280082 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceec92a-3a93-4474-8496-90e574d8a703 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:13.284677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 3/5] 10.222.0.73 () {56 vars in 1207 bytes} [Mon Apr 11 16:36:13 2022] GET /identity/v3/projects/f8c9bf4c662c47e3808d264d2ea01d67 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:15.574463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e8a47-2f8e-41b3-904b-b1dbfb1c6cd0 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:15.575023 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e8a47-2f8e-41b3-904b-b1dbfb1c6cd0 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:15.575126 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e8a47-2f8e-41b3-904b-b1dbfb1c6cd0 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:15.579171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 3/6] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:36:15.584381 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364dda1-dd2f-4205-9ce5-f0aeac0adc51 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:15.584810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364dda1-dd2f-4205-9ce5-f0aeac0adc51 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:15.584937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364dda1-dd2f-4205-9ce5-f0aeac0adc51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:15.603096 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-6364dda1-dd2f-4205-9ce5-f0aeac0adc51 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:15.604583 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-6364dda1-dd2f-4205-9ce5-f0aeac0adc51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:15.612714 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 4/7] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 11 16:36:15.634886 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e8a47-2f8e-41b3-904b-b1dbfb1c6cd0 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:15.646880 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e8a47-2f8e-41b3-904b-b1dbfb1c6cd0 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:15.651036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843936fd-826c-46ef-b7ef-a8d8e6e8d4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:15.651661 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843936fd-826c-46ef-b7ef-a8d8e6e8d4bc admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:15.651944 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843936fd-826c-46ef-b7ef-a8d8e6e8d4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:15.652222 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843936fd-826c-46ef-b7ef-a8d8e6e8d4bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:15.659695 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843936fd-826c-46ef-b7ef-a8d8e6e8d4bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:15.661457 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843936fd-826c-46ef-b7ef-a8d8e6e8d4bc admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:15.670402 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 4/8] 10.222.0.73 () {58 vars in 1324 bytes} [Mon Apr 11 16:36:15 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:36:15.676962 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364dda1-dd2f-4205-9ce5-f0aeac0adc51 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:15.686247 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364dda1-dd2f-4205-9ce5-f0aeac0adc51 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:15.690518 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a8635-d3f9-4e81-a1ec-bff7844f5d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:15.691411 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a8635-d3f9-4e81-a1ec-bff7844f5d9d admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:15.691687 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a8635-d3f9-4e81-a1ec-bff7844f5d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:15.691957 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a8635-d3f9-4e81-a1ec-bff7844f5d9d admin admin] PATH_INFO: `/v3/users/f89fba69f1e24fd6b5126bf48028fdd1` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:15.693318 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a8635-d3f9-4e81-a1ec-bff7844f5d9d admin admin] RBAC: Authorizing `identity:get_user(user_id=f89fba69f1e24fd6b5126bf48028fdd1)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:15.695161 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a8635-d3f9-4e81-a1ec-bff7844f5d9d admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:15.696703 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 5/9] 10.222.0.73 () {56 vars in 1198 bytes} [Mon Apr 11 16:36:15 2022] GET /identity/v3/users/f89fba69f1e24fd6b5126bf48028fdd1 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:18.040606 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399319d-f806-432d-88e6-baadf2dfee1b None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:18.041122 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399319d-f806-432d-88e6-baadf2dfee1b None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:18.041217 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0399319d-f806-432d-88e6-baadf2dfee1b None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:18.042520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 5/10] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:36:18.047864 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7992-ef93-40cb-b8f7-6fa0ff854c09 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:18.048285 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7992-ef93-40cb-b8f7-6fa0ff854c09 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:18.048430 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7992-ef93-40cb-b8f7-6fa0ff854c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:18.065015 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-279f7992-ef93-40cb-b8f7-6fa0ff854c09 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:18.066171 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-279f7992-ef93-40cb-b8f7-6fa0ff854c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:18.084612 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1da9b7-89fd-4a79-bd5e-637c84d68d27 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:18.084904 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1da9b7-89fd-4a79-bd5e-637c84d68d27 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:18.085175 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1da9b7-89fd-4a79-bd5e-637c84d68d27 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:18.086499 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 6/11] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:36:18.091441 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47534d05-3cb0-41c8-a248-318fe6b4b62e None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:18.091721 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47534d05-3cb0-41c8-a248-318fe6b4b62e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:18.091997 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47534d05-3cb0-41c8-a248-318fe6b4b62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:18.130968 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG passlib.handlers.bcrypt [None req-47534d05-3cb0-41c8-a248-318fe6b4b62e None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86345) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 11 16:36:18.131376 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG passlib.handlers.bcrypt [None req-47534d05-3cb0-41c8-a248-318fe6b4b62e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86345) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 11 16:36:18.144252 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 6/12] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:18.167731 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f7992-ef93-40cb-b8f7-6fa0ff854c09 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:18.178337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-47534d05-3cb0-41c8-a248-318fe6b4b62e None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:18.179937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-47534d05-3cb0-41c8-a248-318fe6b4b62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:18.262224 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f7992-ef93-40cb-b8f7-6fa0ff854c09 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:18.274645 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 7/13] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:36:18.294299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e937f-551f-4682-a3d4-4bc7b45e903c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:18.295126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e937f-551f-4682-a3d4-4bc7b45e903c None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:18.295414 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e937f-551f-4682-a3d4-4bc7b45e903c None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:18.295692 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e937f-551f-4682-a3d4-4bc7b45e903c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:18.295921 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47534d05-3cb0-41c8-a248-318fe6b4b62e None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:18.306870 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e937f-551f-4682-a3d4-4bc7b45e903c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:18.314288 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-3f9e937f-551f-4682-a3d4-4bc7b45e903c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:36:18.315518 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 7/14] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:36:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:36:18.321144 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e937f-551f-4682-a3d4-4bc7b45e903c None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:18.391099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47534d05-3cb0-41c8-a248-318fe6b4b62e None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:18.415296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e937f-551f-4682-a3d4-4bc7b45e903c None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:18.422633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768678a-a270-4c19-b420-ffcfa56e8301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:18.423508 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768678a-a270-4c19-b420-ffcfa56e8301 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:18.423791 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768678a-a270-4c19-b420-ffcfa56e8301 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:18.424066 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7768678a-a270-4c19-b420-ffcfa56e8301 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:18.447669 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc9bdd-09ab-4265-b77c-a907e2ebda98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:18.448317 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc9bdd-09ab-4265-b77c-a907e2ebda98 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:18.448601 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc9bdd-09ab-4265-b77c-a907e2ebda98 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:18.448875 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc9bdd-09ab-4265-b77c-a907e2ebda98 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:18.449614 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc9bdd-09ab-4265-b77c-a907e2ebda98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:18.449928 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc9bdd-09ab-4265-b77c-a907e2ebda98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:18.451372 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc9bdd-09ab-4265-b77c-a907e2ebda98 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:18.462681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 8/15] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:18.468102 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc9bdd-09ab-4265-b77c-a907e2ebda98 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:18.487411 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768678a-a270-4c19-b420-ffcfa56e8301 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:18.488920 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7768678a-a270-4c19-b420-ffcfa56e8301 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:18.560947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc9bdd-09ab-4265-b77c-a907e2ebda98 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:18.579839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 8/16] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:36:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:18.586681 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768678a-a270-4c19-b420-ffcfa56e8301 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:18.592288 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c3d51-b62c-4f6d-a34d-7d0a31bd4c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:18.593158 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c3d51-b62c-4f6d-a34d-7d0a31bd4c64 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:18.593442 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c3d51-b62c-4f6d-a34d-7d0a31bd4c64 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:18.593713 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4c3d51-b62c-4f6d-a34d-7d0a31bd4c64 None admin] PATH_INFO: `/v3/users/f89fba69f1e24fd6b5126bf48028fdd1` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:18.594947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c3d51-b62c-4f6d-a34d-7d0a31bd4c64 None admin] RBAC: Authorizing `identity:get_user(user_id=f89fba69f1e24fd6b5126bf48028fdd1)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:18.596418 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4c3d51-b62c-4f6d-a34d-7d0a31bd4c64 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:18.598029 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 9/17] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:18 2022] GET /identity/v3/users/f89fba69f1e24fd6b5126bf48028fdd1 => generated 247 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:18.603140 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c3d51-b62c-4f6d-a34d-7d0a31bd4c64 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:18.677652 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7768678a-a270-4c19-b420-ffcfa56e8301 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:18.695809 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4c3d51-b62c-4f6d-a34d-7d0a31bd4c64 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:18.709118 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284dc4f-0ae2-4775-8bf3-0c80a2722506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:18.709905 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284dc4f-0ae2-4775-8bf3-0c80a2722506 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:18.710184 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284dc4f-0ae2-4775-8bf3-0c80a2722506 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:18.710453 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284dc4f-0ae2-4775-8bf3-0c80a2722506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:18.727303 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c9c88-9b31-4edc-a827-fc41f345336e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:18.728081 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c9c88-9b31-4edc-a827-fc41f345336e None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:18.728359 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c9c88-9b31-4edc-a827-fc41f345336e None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:18.728480 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284dc4f-0ae2-4775-8bf3-0c80a2722506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:18.728631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c9c88-9b31-4edc-a827-fc41f345336e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:18.729797 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c9c88-9b31-4edc-a827-fc41f345336e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:18.729953 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284dc4f-0ae2-4775-8bf3-0c80a2722506 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:18.731771 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15c9c88-9b31-4edc-a827-fc41f345336e None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:18.733371 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 10/18] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:36:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:18.738978 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c9c88-9b31-4edc-a827-fc41f345336e None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:18.746903 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-9284dc4f-0ae2-4775-8bf3-0c80a2722506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:36:18.748678 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 9/19] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:36:18.754094 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284dc4f-0ae2-4775-8bf3-0c80a2722506 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:18.832469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c9c88-9b31-4edc-a827-fc41f345336e None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:18.847627 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284dc4f-0ae2-4775-8bf3-0c80a2722506 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:18.863991 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32135aa-0706-4412-92d8-173a454abd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:18.864637 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32135aa-0706-4412-92d8-173a454abd71 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:18.864921 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32135aa-0706-4412-92d8-173a454abd71 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:18.865198 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32135aa-0706-4412-92d8-173a454abd71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:18.866018 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32135aa-0706-4412-92d8-173a454abd71 None admin] RBAC: Adding query filter params (role.id=13de1ce875d44fcc988cc31b3a0639be, scope.domain.id=default, user.id=f89fba69f1e24fd6b5126bf48028fdd1) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:18.866329 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32135aa-0706-4412-92d8-173a454abd71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:18.867796 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32135aa-0706-4412-92d8-173a454abd71 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:18.874397 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 11/20] 10.222.0.73 () {56 vars in 1322 bytes} [Mon Apr 11 16:36:18 2022] GET /identity/v3/role_assignments?user.id=f89fba69f1e24fd6b5126bf48028fdd1&scope.domain.id=default&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 233 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:18.879753 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25e7848-a301-4b63-84ba-60dd84544086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:18.880434 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e7848-a301-4b63-84ba-60dd84544086 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:18.880718 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e7848-a301-4b63-84ba-60dd84544086 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:18.880993 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e7848-a301-4b63-84ba-60dd84544086 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:18.881732 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e7848-a301-4b63-84ba-60dd84544086 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:18.882040 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e7848-a301-4b63-84ba-60dd84544086 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:18.883540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25e7848-a301-4b63-84ba-60dd84544086 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:18.903093 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 10/21] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:21.703699 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0c6fa-3233-4789-b2a2-fe8c04e10b23 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:21.704204 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0c6fa-3233-4789-b2a2-fe8c04e10b23 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:21.704275 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0c6fa-3233-4789-b2a2-fe8c04e10b23 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:21.705896 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 12/22] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:21.711517 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb584d7-4f19-4b50-8587-75df2306d0fe None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:21.711898 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb584d7-4f19-4b50-8587-75df2306d0fe None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:21.712069 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb584d7-4f19-4b50-8587-75df2306d0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:21.735769 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-bfb584d7-4f19-4b50-8587-75df2306d0fe None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:21.736975 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bfb584d7-4f19-4b50-8587-75df2306d0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:21.804060 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5c2b4-c3d5-4477-aff0-4bc6b63e1029 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:21.804743 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5c2b4-c3d5-4477-aff0-4bc6b63e1029 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:21.805224 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc5c2b4-c3d5-4477-aff0-4bc6b63e1029 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:21.807214 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 13/23] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:21.812435 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38255aa-f31e-4054-a60f-3cbf987ecdd7 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:21.812966 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38255aa-f31e-4054-a60f-3cbf987ecdd7 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:21.813432 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38255aa-f31e-4054-a60f-3cbf987ecdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:21.827974 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 11/24] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:36:21.846350 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-b38255aa-f31e-4054-a60f-3cbf987ecdd7 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:21.847966 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b38255aa-f31e-4054-a60f-3cbf987ecdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:21.862629 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb584d7-4f19-4b50-8587-75df2306d0fe None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:21.971132 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 14/25] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:36:22.003300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb584d7-4f19-4b50-8587-75df2306d0fe None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:22.007558 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38255aa-f31e-4054-a60f-3cbf987ecdd7 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:22.046618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e60ebf-0969-4e15-b9af-f70a810ce155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:22.047425 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e60ebf-0969-4e15-b9af-f70a810ce155 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:22.047710 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e60ebf-0969-4e15-b9af-f70a810ce155 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:22.047987 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e60ebf-0969-4e15-b9af-f70a810ce155 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:22.071989 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e60ebf-0969-4e15-b9af-f70a810ce155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:22.078963 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-03e60ebf-0969-4e15-b9af-f70a810ce155 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:36:22.080429 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 12/26] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:36:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:36:22.087060 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d84f1c-60f8-4ff9-8718-9c0dc47fb504 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:22.087382 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d84f1c-60f8-4ff9-8718-9c0dc47fb504 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:22.087669 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d84f1c-60f8-4ff9-8718-9c0dc47fb504 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:22.089395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 13/27] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:22.090137 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d84f1c-60f8-4ff9-8718-9c0dc47fb504 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:22.146060 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38255aa-f31e-4054-a60f-3cbf987ecdd7 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:22.190037 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94429116-8ee1-4c80-a981-ba4a43bfb23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:22.190971 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94429116-8ee1-4c80-a981-ba4a43bfb23e None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:22.191425 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94429116-8ee1-4c80-a981-ba4a43bfb23e None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:22.191845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94429116-8ee1-4c80-a981-ba4a43bfb23e None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:22.192740 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94429116-8ee1-4c80-a981-ba4a43bfb23e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:22.194265 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94429116-8ee1-4c80-a981-ba4a43bfb23e None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:22.290548 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d84f1c-60f8-4ff9-8718-9c0dc47fb504 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:22.324307 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8d663-3d9c-4db8-8b8c-d89fa1644fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:22.325672 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d663-3d9c-4db8-8b8c-d89fa1644fbb None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:22.326051 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d663-3d9c-4db8-8b8c-d89fa1644fbb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:22.326425 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8d663-3d9c-4db8-8b8c-d89fa1644fbb None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:22.327298 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8d663-3d9c-4db8-8b8c-d89fa1644fbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:22.327703 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8d663-3d9c-4db8-8b8c-d89fa1644fbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:22.329172 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8d663-3d9c-4db8-8b8c-d89fa1644fbb None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:22.342917 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 14/28] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:22.343859 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 15/29] 10.222.0.73 () {60 vars in 1131 bytes} [Mon Apr 11 16:36:22 2022] POST /identity/v3/roles => generated 219 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:36:22.344519 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565de69-e17f-4307-ac06-ba6468366984 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:22.344921 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565de69-e17f-4307-ac06-ba6468366984 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:22.345294 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565de69-e17f-4307-ac06-ba6468366984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:22.346186 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cc572-91c7-41eb-843a-7314f70a8dc9 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:22.346669 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cc572-91c7-41eb-843a-7314f70a8dc9 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:22.347213 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6cc572-91c7-41eb-843a-7314f70a8dc9 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:22.349041 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 16/30] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:22.356939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395c95f-05a0-4bdc-8320-3c04d1d31801 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:22.356939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395c95f-05a0-4bdc-8320-3c04d1d31801 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:22.356939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395c95f-05a0-4bdc-8320-3c04d1d31801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:22.363284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-4565de69-e17f-4307-ac06-ba6468366984 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:22.364492 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4565de69-e17f-4307-ac06-ba6468366984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:22.395893 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-7395c95f-05a0-4bdc-8320-3c04d1d31801 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:22.397488 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-7395c95f-05a0-4bdc-8320-3c04d1d31801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:22.480356 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 15/31] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:22.481357 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565de69-e17f-4307-ac06-ba6468366984 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:22.545742 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 17/32] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:22.547461 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395c95f-05a0-4bdc-8320-3c04d1d31801 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:22.613093 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4565de69-e17f-4307-ac06-ba6468366984 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:22.648946 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa88be-1570-4dae-bb28-d4cafb79880b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:22.649831 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa88be-1570-4dae-bb28-d4cafb79880b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:22.650116 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa88be-1570-4dae-bb28-d4cafb79880b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:22.650391 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fa88be-1570-4dae-bb28-d4cafb79880b None admin] PATH_INFO: `/v3/users/f89fba69f1e24fd6b5126bf48028fdd1` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:22.652004 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa88be-1570-4dae-bb28-d4cafb79880b None admin] RBAC: Authorizing `identity:get_user(user_id=f89fba69f1e24fd6b5126bf48028fdd1)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:22.653515 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fa88be-1570-4dae-bb28-d4cafb79880b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:22.654345 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395c95f-05a0-4bdc-8320-3c04d1d31801 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:22.655517 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 16/33] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:22 2022] GET /identity/v3/users/f89fba69f1e24fd6b5126bf48028fdd1 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:22.656305 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa88be-1570-4dae-bb28-d4cafb79880b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:22.689110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fa38f-2017-4291-b934-208d71ebb116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:22.689783 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fa38f-2017-4291-b934-208d71ebb116 None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:22.690064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fa38f-2017-4291-b934-208d71ebb116 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:22.690679 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fa38f-2017-4291-b934-208d71ebb116 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:22.691707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fa38f-2017-4291-b934-208d71ebb116 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:22.693689 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fa38f-2017-4291-b934-208d71ebb116 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:22.715912 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 18/34] 10.222.0.73 () {60 vars in 1131 bytes} [Mon Apr 11 16:36:22 2022] POST /identity/v3/roles => generated 225 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:36:22.717222 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fa38f-2017-4291-b934-208d71ebb116 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:22.782363 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fa88be-1570-4dae-bb28-d4cafb79880b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:22.819697 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ae291-66f3-42c7-9174-c583608b998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:22.820490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ae291-66f3-42c7-9174-c583608b998e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:22.820758 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ae291-66f3-42c7-9174-c583608b998e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:22.821028 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ae291-66f3-42c7-9174-c583608b998e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:22.826472 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fa38f-2017-4291-b934-208d71ebb116 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:22.833645 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ae291-66f3-42c7-9174-c583608b998e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:22.835398 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ae291-66f3-42c7-9174-c583608b998e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:22.853231 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-da3ae291-66f3-42c7-9174-c583608b998e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:36:22.854883 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 17/35] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:22.860499 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ae291-66f3-42c7-9174-c583608b998e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:22.865298 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af36e2-3a9d-4ee3-b784-419d05807e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:22.866182 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af36e2-3a9d-4ee3-b784-419d05807e53 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:22.866470 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af36e2-3a9d-4ee3-b784-419d05807e53 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:22.866770 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af36e2-3a9d-4ee3-b784-419d05807e53 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:22.869534 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af36e2-3a9d-4ee3-b784-419d05807e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:22.874204 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af36e2-3a9d-4ee3-b784-419d05807e53 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:22.878508 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 19/36] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:36:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:22.887461 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af36e2-3a9d-4ee3-b784-419d05807e53 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:23.050883 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ae291-66f3-42c7-9174-c583608b998e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:23.057175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af36e2-3a9d-4ee3-b784-419d05807e53 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:23.093838 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe175f-ed24-4d24-af6c-e57c7328e427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:23.094409 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe175f-ed24-4d24-af6c-e57c7328e427 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:23.094720 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58797cda-9077-4620-b099-abbcb62453b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:23.094855 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe175f-ed24-4d24-af6c-e57c7328e427 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:23.095039 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe175f-ed24-4d24-af6c-e57c7328e427 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:23.095740 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe175f-ed24-4d24-af6c-e57c7328e427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:23.096039 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe175f-ed24-4d24-af6c-e57c7328e427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:23.096542 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58797cda-9077-4620-b099-abbcb62453b7 None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:23.097028 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58797cda-9077-4620-b099-abbcb62453b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:23.097440 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abe175f-ed24-4d24-af6c-e57c7328e427 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:23.097699 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58797cda-9077-4620-b099-abbcb62453b7 None admin] PATH_INFO: `/v3/domains/default/users/f89fba69f1e24fd6b5126bf48028fdd1/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:23.099987 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58797cda-9077-4620-b099-abbcb62453b7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f89fba69f1e24fd6b5126bf48028fdd1, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:23.101759 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58797cda-9077-4620-b099-abbcb62453b7 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:23.110659 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 18/37] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:23.116694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe175f-ed24-4d24-af6c-e57c7328e427 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:23.124678 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 20/38] 10.222.0.73 () {58 vars in 1361 bytes} [Mon Apr 11 16:36:22 2022] PUT /identity/v3/domains/default/users/f89fba69f1e24fd6b5126bf48028fdd1/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:36:23.158390 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1feba9-ccbc-48d0-9cea-096cb45b37e2 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:23.159111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1feba9-ccbc-48d0-9cea-096cb45b37e2 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:23.159596 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1feba9-ccbc-48d0-9cea-096cb45b37e2 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:23.161257 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 21/39] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:36:23.167174 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2d0ca-b6f5-4fde-947a-25ede6ee853f None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:23.167769 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2d0ca-b6f5-4fde-947a-25ede6ee853f None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:23.168253 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec2d0ca-b6f5-4fde-947a-25ede6ee853f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:23.187761 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-cec2d0ca-b6f5-4fde-947a-25ede6ee853f None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:23.189443 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-cec2d0ca-b6f5-4fde-947a-25ede6ee853f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:23.229524 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe175f-ed24-4d24-af6c-e57c7328e427 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:23.267130 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9cfc9-7007-4e2e-8bd4-5e0f371a7162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:23.267596 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 22/40] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:36:23.272525 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9cfc9-7007-4e2e-8bd4-5e0f371a7162 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:23.272525 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9cfc9-7007-4e2e-8bd4-5e0f371a7162 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:23.272525 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9cfc9-7007-4e2e-8bd4-5e0f371a7162 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:23.272525 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9cfc9-7007-4e2e-8bd4-5e0f371a7162 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:23.272525 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9cfc9-7007-4e2e-8bd4-5e0f371a7162 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:23.293653 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2d0ca-b6f5-4fde-947a-25ede6ee853f None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:23.397274 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec2d0ca-b6f5-4fde-947a-25ede6ee853f None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:23.416927 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 19/41] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Apr 11 16:36:23 2022] POST /identity/v3/projects => generated 301 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:36:23.418463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664a821-0904-4915-85c2-2af307736329 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:23.419412 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664a821-0904-4915-85c2-2af307736329 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:23.419697 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664a821-0904-4915-85c2-2af307736329 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:23.421255 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 20/42] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:23.426946 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e7b95-3bbb-42a8-a520-1cdd0f072866 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:23.427242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e7b95-3bbb-42a8-a520-1cdd0f072866 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:23.427516 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572e7b95-3bbb-42a8-a520-1cdd0f072866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:23.439490 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafca52-a490-4887-80e2-0756b511c121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:23.441370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafca52-a490-4887-80e2-0756b511c121 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:23.442158 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafca52-a490-4887-80e2-0756b511c121 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:23.442684 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafca52-a490-4887-80e2-0756b511c121 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:23.444351 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafca52-a490-4887-80e2-0756b511c121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:23.446167 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-572e7b95-3bbb-42a8-a520-1cdd0f072866 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:23.446515 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafca52-a490-4887-80e2-0756b511c121 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:23.447889 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-572e7b95-3bbb-42a8-a520-1cdd0f072866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:23.448812 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 23/43] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:36:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:23.456362 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafca52-a490-4887-80e2-0756b511c121 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:23.527629 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 21/44] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:36:23.552486 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e7b95-3bbb-42a8-a520-1cdd0f072866 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:23.585796 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafca52-a490-4887-80e2-0756b511c121 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:23.635319 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc139b4-8b7c-4cc0-8ffa-f95c737aabce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:23.635992 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc139b4-8b7c-4cc0-8ffa-f95c737aabce None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:23.636283 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc139b4-8b7c-4cc0-8ffa-f95c737aabce None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:23.636555 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc139b4-8b7c-4cc0-8ffa-f95c737aabce None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:23.637311 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc139b4-8b7c-4cc0-8ffa-f95c737aabce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:23.638847 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc139b4-8b7c-4cc0-8ffa-f95c737aabce None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:23.670362 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572e7b95-3bbb-42a8-a520-1cdd0f072866 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:23.678439 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 24/45] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Apr 11 16:36:23 2022] POST /identity/v3/projects => generated 312 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:36:23.713292 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d67b2ec-62e9-4cf9-bb0e-178d591fff36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:23.713991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67b2ec-62e9-4cf9-bb0e-178d591fff36 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:23.714279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67b2ec-62e9-4cf9-bb0e-178d591fff36 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:23.714558 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67b2ec-62e9-4cf9-bb0e-178d591fff36 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:23.715374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67b2ec-62e9-4cf9-bb0e-178d591fff36 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:23.717534 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d67b2ec-62e9-4cf9-bb0e-178d591fff36 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:23.732601 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 22/46] 10.222.0.73 () {60 vars in 1131 bytes} [Mon Apr 11 16:36:23 2022] POST /identity/v3/roles => generated 223 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:36:25.495169 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fec2ef-bd33-4995-8a4c-eb59c98eef0c None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:25.495709 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fec2ef-bd33-4995-8a4c-eb59c98eef0c None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:25.495709 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fec2ef-bd33-4995-8a4c-eb59c98eef0c None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:25.497707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 25/47] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:25.502821 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e37f2-9445-4c70-9be9-41cd1e4d013e None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:25.503241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e37f2-9445-4c70-9be9-41cd1e4d013e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:25.503387 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e37f2-9445-4c70-9be9-41cd1e4d013e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:25.520395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-221e37f2-9445-4c70-9be9-41cd1e4d013e None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:25.521567 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-221e37f2-9445-4c70-9be9-41cd1e4d013e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:25.586555 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 23/48] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:36:25.609983 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fec2ef-bd33-4995-8a4c-eb59c98eef0c None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:25.709557 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fec2ef-bd33-4995-8a4c-eb59c98eef0c None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:25.740681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87e6b3-e694-465e-a7ce-986c3445ec23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:25.741464 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87e6b3-e694-465e-a7ce-986c3445ec23 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:25.741747 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87e6b3-e694-465e-a7ce-986c3445ec23 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:25.742023 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87e6b3-e694-465e-a7ce-986c3445ec23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:25.752144 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87e6b3-e694-465e-a7ce-986c3445ec23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:25.758971 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-ad87e6b3-e694-465e-a7ce-986c3445ec23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:36:25.760331 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 26/49] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:36:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:25.766837 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e37f2-9445-4c70-9be9-41cd1e4d013e None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:25.857038 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e37f2-9445-4c70-9be9-41cd1e4d013e None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:25.892025 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002bcb1-66ec-49c0-970c-9f77ce19d0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:25.892645 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002bcb1-66ec-49c0-970c-9f77ce19d0e8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:25.892927 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002bcb1-66ec-49c0-970c-9f77ce19d0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:25.893215 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002bcb1-66ec-49c0-970c-9f77ce19d0e8 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:25.893977 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002bcb1-66ec-49c0-970c-9f77ce19d0e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:25.894267 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002bcb1-66ec-49c0-970c-9f77ce19d0e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:25.895808 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002bcb1-66ec-49c0-970c-9f77ce19d0e8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:25.904198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 24/50] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:25.909467 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87e6b3-e694-465e-a7ce-986c3445ec23 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:26.005513 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87e6b3-e694-465e-a7ce-986c3445ec23 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:26.015253 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac6989-6530-4f35-b0a1-1096956eead5 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:26.015725 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac6989-6530-4f35-b0a1-1096956eead5 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:26.016007 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac6989-6530-4f35-b0a1-1096956eead5 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:26.017636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 25/51] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:36:26.022442 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5744712-84a1-4e66-8f26-38e3d3e4e33a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:26.022762 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5744712-84a1-4e66-8f26-38e3d3e4e33a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:26.023044 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5744712-84a1-4e66-8f26-38e3d3e4e33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:26.037373 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ed5b5-fad2-4665-b4ae-abd98f1f22c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:26.038246 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ed5b5-fad2-4665-b4ae-abd98f1f22c2 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:26.038533 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ed5b5-fad2-4665-b4ae-abd98f1f22c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:26.038834 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a5744712-84a1-4e66-8f26-38e3d3e4e33a None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:26.038924 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ed5b5-fad2-4665-b4ae-abd98f1f22c2 None admin] PATH_INFO: `/v3/users/f89fba69f1e24fd6b5126bf48028fdd1` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:26.040023 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a5744712-84a1-4e66-8f26-38e3d3e4e33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:26.040117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ed5b5-fad2-4665-b4ae-abd98f1f22c2 None admin] RBAC: Authorizing `identity:get_user(user_id=f89fba69f1e24fd6b5126bf48028fdd1)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:26.041485 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ed5b5-fad2-4665-b4ae-abd98f1f22c2 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:26.043154 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 27/52] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:25 2022] GET /identity/v3/users/f89fba69f1e24fd6b5126bf48028fdd1 => generated 247 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:26.048882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ed5b5-fad2-4665-b4ae-abd98f1f22c2 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:26.103366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 26/53] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:36:26.128219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5744712-84a1-4e66-8f26-38e3d3e4e33a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:26.142260 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ed5b5-fad2-4665-b4ae-abd98f1f22c2 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:26.173379 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096474aa-f7a3-4791-8613-b95b045f618a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:26.174156 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096474aa-f7a3-4791-8613-b95b045f618a None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:26.174440 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096474aa-f7a3-4791-8613-b95b045f618a None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:26.174747 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096474aa-f7a3-4791-8613-b95b045f618a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:26.175926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096474aa-f7a3-4791-8613-b95b045f618a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:26.177376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096474aa-f7a3-4791-8613-b95b045f618a None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:26.179164 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 28/54] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:36:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:26.185076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096474aa-f7a3-4791-8613-b95b045f618a None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:26.218510 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5744712-84a1-4e66-8f26-38e3d3e4e33a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:26.250276 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813c8b2-f773-4f2b-9c9d-2a9c6b482c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:26.251082 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813c8b2-f773-4f2b-9c9d-2a9c6b482c4b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:26.251364 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813c8b2-f773-4f2b-9c9d-2a9c6b482c4b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:26.251637 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813c8b2-f773-4f2b-9c9d-2a9c6b482c4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:26.252798 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813c8b2-f773-4f2b-9c9d-2a9c6b482c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:26.254232 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813c8b2-f773-4f2b-9c9d-2a9c6b482c4b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:26.256088 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 27/55] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:36:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:26.261168 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813c8b2-f773-4f2b-9c9d-2a9c6b482c4b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:26.276342 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096474aa-f7a3-4791-8613-b95b045f618a None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:26.308283 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2649276-744a-41a3-82ce-9740dc1c38f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:26.308919 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2649276-744a-41a3-82ce-9740dc1c38f6 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:26.309228 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2649276-744a-41a3-82ce-9740dc1c38f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:26.309507 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2649276-744a-41a3-82ce-9740dc1c38f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:26.310330 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2649276-744a-41a3-82ce-9740dc1c38f6 None admin] RBAC: Adding query filter params (role.id=13de1ce875d44fcc988cc31b3a0639be, scope.domain.id=default, user.id=f89fba69f1e24fd6b5126bf48028fdd1) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:26.310666 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2649276-744a-41a3-82ce-9740dc1c38f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:26.312107 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2649276-744a-41a3-82ce-9740dc1c38f6 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:26.317771 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 29/56] 10.222.0.73 () {56 vars in 1322 bytes} [Mon Apr 11 16:36:26 2022] GET /identity/v3/role_assignments?user.id=f89fba69f1e24fd6b5126bf48028fdd1&scope.domain.id=default&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 530 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:26.356587 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813c8b2-f773-4f2b-9c9d-2a9c6b482c4b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:26.390341 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae1da74-c711-4b3f-89d8-910a94b6eee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:26.391032 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1da74-c711-4b3f-89d8-910a94b6eee0 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:26.391580 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1da74-c711-4b3f-89d8-910a94b6eee0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:26.391858 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae1da74-c711-4b3f-89d8-910a94b6eee0 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:26.392575 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1da74-c711-4b3f-89d8-910a94b6eee0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:26.394065 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae1da74-c711-4b3f-89d8-910a94b6eee0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:26.421850 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 28/57] 10.222.0.73 () {60 vars in 1140 bytes} [Mon Apr 11 16:36:26 2022] POST /identity/v3/projects => generated 298 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:36:28.689926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dbfde-8866-4620-b54d-96877fa84056 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:28.690462 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dbfde-8866-4620-b54d-96877fa84056 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:28.690462 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685dbfde-8866-4620-b54d-96877fa84056 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:28.691868 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 30/58] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:28.696997 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808d76-5b8c-47e8-8d2c-d66a8e1215b0 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:28.697383 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808d76-5b8c-47e8-8d2c-d66a8e1215b0 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:28.697553 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f808d76-5b8c-47e8-8d2c-d66a8e1215b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:28.714348 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3f808d76-5b8c-47e8-8d2c-d66a8e1215b0 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:28.715591 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3f808d76-5b8c-47e8-8d2c-d66a8e1215b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:28.777926 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 29/59] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:28.802810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dbfde-8866-4620-b54d-96877fa84056 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:28.898490 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685dbfde-8866-4620-b54d-96877fa84056 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:28.930033 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613cef1-d64f-4235-bf13-60742c1ecd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:28.930844 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613cef1-d64f-4235-bf13-60742c1ecd3d None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:28.931130 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613cef1-d64f-4235-bf13-60742c1ecd3d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:28.931406 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613cef1-d64f-4235-bf13-60742c1ecd3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:28.932563 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613cef1-d64f-4235-bf13-60742c1ecd3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:28.934061 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613cef1-d64f-4235-bf13-60742c1ecd3d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:28.935697 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 31/60] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:36:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:28.941979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f808d76-5b8c-47e8-8d2c-d66a8e1215b0 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:29.033705 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f808d76-5b8c-47e8-8d2c-d66a8e1215b0 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:29.065511 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523abb2-3bc1-4ec5-aac2-1f047a87adda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:29.066160 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523abb2-3bc1-4ec5-aac2-1f047a87adda None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:29.066445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523abb2-3bc1-4ec5-aac2-1f047a87adda None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:29.066751 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523abb2-3bc1-4ec5-aac2-1f047a87adda None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:29.067445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523abb2-3bc1-4ec5-aac2-1f047a87adda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:29.068871 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523abb2-3bc1-4ec5-aac2-1f047a87adda None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:29.092524 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 30/61] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Apr 11 16:36:28 2022] POST /identity/v3/users => generated 275 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:36:32.539030 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a81c7-dc06-4493-9674-fd0fde4ee35a None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:32.540045 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a81c7-dc06-4493-9674-fd0fde4ee35a None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:32.540543 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a81c7-dc06-4493-9674-fd0fde4ee35a None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:32.542389 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 32/62] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:32.548078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3564f5a-7136-4d84-bcdd-6406644e18e0 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:32.548893 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3564f5a-7136-4d84-bcdd-6406644e18e0 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:32.549365 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3564f5a-7136-4d84-bcdd-6406644e18e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:32.571645 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c3564f5a-7136-4d84-bcdd-6406644e18e0 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:32.573198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c3564f5a-7136-4d84-bcdd-6406644e18e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:32.588079 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc217a4-cc8d-4689-a810-296655bba86e None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:32.588675 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc217a4-cc8d-4689-a810-296655bba86e None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:32.589151 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc217a4-cc8d-4689-a810-296655bba86e None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:32.591516 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 33/63] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:32.597021 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80126ac-9aed-4411-b853-2fc2223dadb5 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:32.597561 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80126ac-9aed-4411-b853-2fc2223dadb5 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:32.598041 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80126ac-9aed-4411-b853-2fc2223dadb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:32.638998 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-a80126ac-9aed-4411-b853-2fc2223dadb5 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:32.643136 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a80126ac-9aed-4411-b853-2fc2223dadb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:32.688595 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 31/64] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:32.713743 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3564f5a-7136-4d84-bcdd-6406644e18e0 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:32.760878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 34/65] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:36:32.825607 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80126ac-9aed-4411-b853-2fc2223dadb5 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:32.842741 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3564f5a-7136-4d84-bcdd-6406644e18e0 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:32.880660 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc87890-7824-49ab-be94-2ec26ae440c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:32.881458 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc87890-7824-49ab-be94-2ec26ae440c4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:32.881739 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc87890-7824-49ab-be94-2ec26ae440c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:32.882015 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc87890-7824-49ab-be94-2ec26ae440c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:32.904404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc87890-7824-49ab-be94-2ec26ae440c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:32.911487 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-0bc87890-7824-49ab-be94-2ec26ae440c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:36:32.912904 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 32/66] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:36:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:32.919432 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc87890-7824-49ab-be94-2ec26ae440c4 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:32.991017 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80126ac-9aed-4411-b853-2fc2223dadb5 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:33.032869 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32b480-6bd3-4576-b717-e2b832471581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:33.034192 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32b480-6bd3-4576-b717-e2b832471581 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.034991 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32b480-6bd3-4576-b717-e2b832471581 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.035598 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32b480-6bd3-4576-b717-e2b832471581 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.050053 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32b480-6bd3-4576-b717-e2b832471581 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:33.051645 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc87890-7824-49ab-be94-2ec26ae440c4 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:33.058559 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-4b32b480-6bd3-4576-b717-e2b832471581 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:36:33.060903 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 35/67] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:33.062403 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce7b7a-fe18-4da3-ae1c-e739c8727486 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.062717 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce7b7a-fe18-4da3-ae1c-e739c8727486 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.063001 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce7b7a-fe18-4da3-ae1c-e739c8727486 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.066666 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 36/68] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:33.070497 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce7b7a-fe18-4da3-ae1c-e739c8727486 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:33.091500 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d239ac1-f110-47f2-9f5a-2b7f46c659d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:33.091890 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d239ac1-f110-47f2-9f5a-2b7f46c659d5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.092171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d239ac1-f110-47f2-9f5a-2b7f46c659d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.092449 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d239ac1-f110-47f2-9f5a-2b7f46c659d5 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.093192 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d239ac1-f110-47f2-9f5a-2b7f46c659d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:33.093498 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d239ac1-f110-47f2-9f5a-2b7f46c659d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:33.094927 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d239ac1-f110-47f2-9f5a-2b7f46c659d5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:33.103320 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 33/69] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:33.104293 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ef80b-2cd3-40f2-bad4-aa1b964dfd48 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.104582 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ef80b-2cd3-40f2-bad4-aa1b964dfd48 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.104885 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ef80b-2cd3-40f2-bad4-aa1b964dfd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.121969 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9a3ef80b-2cd3-40f2-bad4-aa1b964dfd48 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:33.123156 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9a3ef80b-2cd3-40f2-bad4-aa1b964dfd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:33.187059 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 34/70] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:33.187687 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce7b7a-fe18-4da3-ae1c-e739c8727486 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:33.188520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b6700-70a9-4a9b-92c9-ae4aa4b709c5 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.188876 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b6700-70a9-4a9b-92c9-ae4aa4b709c5 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.189215 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b6700-70a9-4a9b-92c9-ae4aa4b709c5 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.190534 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 35/71] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:33.191271 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b6700-70a9-4a9b-92c9-ae4aa4b709c5 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:33.231473 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444a2e1-01c4-4b62-82a0-1b939c1a11a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:33.232534 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444a2e1-01c4-4b62-82a0-1b939c1a11a6 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.232818 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444a2e1-01c4-4b62-82a0-1b939c1a11a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.233096 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444a2e1-01c4-4b62-82a0-1b939c1a11a6 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.233846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444a2e1-01c4-4b62-82a0-1b939c1a11a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:33.234155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444a2e1-01c4-4b62-82a0-1b939c1a11a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:33.235592 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444a2e1-01c4-4b62-82a0-1b939c1a11a6 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:33.243425 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 37/72] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:36:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:33.244636 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2ec37-e393-42b4-b9e7-ef0908f2487e None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.244918 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2ec37-e393-42b4-b9e7-ef0908f2487e None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.245193 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2ec37-e393-42b4-b9e7-ef0908f2487e None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.246446 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 38/73] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:33.247524 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5ecd2-da9c-494d-9852-7c48e9edf4bd None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.247806 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5ecd2-da9c-494d-9852-7c48e9edf4bd None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.248086 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5ecd2-da9c-494d-9852-7c48e9edf4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.263550 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-b3d5ecd2-da9c-494d-9852-7c48e9edf4bd None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:33.264718 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b3d5ecd2-da9c-494d-9852-7c48e9edf4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:33.291799 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b6700-70a9-4a9b-92c9-ae4aa4b709c5 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:33.324243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e227b9-91e1-47da-922e-566b54328a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:33.325112 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e227b9-91e1-47da-922e-566b54328a52 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.325393 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e227b9-91e1-47da-922e-566b54328a52 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.325667 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e227b9-91e1-47da-922e-566b54328a52 None admin] PATH_INFO: `/v3/users/f89fba69f1e24fd6b5126bf48028fdd1` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.325912 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 39/74] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:33.326773 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5ecd2-da9c-494d-9852-7c48e9edf4bd None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:33.326873 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e227b9-91e1-47da-922e-566b54328a52 None admin] RBAC: Authorizing `identity:get_user(user_id=f89fba69f1e24fd6b5126bf48028fdd1)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:33.328395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e227b9-91e1-47da-922e-566b54328a52 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:33.330050 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 36/75] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:33 2022] GET /identity/v3/users/f89fba69f1e24fd6b5126bf48028fdd1 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:33.330859 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e227b9-91e1-47da-922e-566b54328a52 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:33.420050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5ecd2-da9c-494d-9852-7c48e9edf4bd None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:33.425553 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e227b9-91e1-47da-922e-566b54328a52 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:33.451472 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2b56c-24fc-43cb-94b0-8cac077c6283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:33.452273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2b56c-24fc-43cb-94b0-8cac077c6283 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.452558 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2b56c-24fc-43cb-94b0-8cac077c6283 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.452834 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2b56c-24fc-43cb-94b0-8cac077c6283 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.457242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0a0c3-a1e6-4df6-b25b-45db24af1d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:33.458098 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0a0c3-a1e6-4df6-b25b-45db24af1d73 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.458376 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0a0c3-a1e6-4df6-b25b-45db24af1d73 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.458679 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0a0c3-a1e6-4df6-b25b-45db24af1d73 None admin] PATH_INFO: `/v3/users/fe3cab871edd46f6ad5f0e3022f6c8c3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.462479 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2b56c-24fc-43cb-94b0-8cac077c6283 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:33.470213 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-3cb2b56c-24fc-43cb-94b0-8cac077c6283 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:36:33.471436 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 40/76] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:36:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:33.472590 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77e764-5c58-4096-a61c-7480990c698b None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.472876 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77e764-5c58-4096-a61c-7480990c698b None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.473153 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77e764-5c58-4096-a61c-7480990c698b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.473422 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0a0c3-a1e6-4df6-b25b-45db24af1d73 None admin] RBAC: Authorizing `identity:get_user(user_id=fe3cab871edd46f6ad5f0e3022f6c8c3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:33.474882 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0a0c3-a1e6-4df6-b25b-45db24af1d73 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:33.476531 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 37/77] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:33 2022] GET /identity/v3/users/fe3cab871edd46f6ad5f0e3022f6c8c3 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:33.479066 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0a0c3-a1e6-4df6-b25b-45db24af1d73 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:33.488775 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-ac77e764-5c58-4096-a61c-7480990c698b None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:33.489953 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-ac77e764-5c58-4096-a61c-7480990c698b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:33.552481 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 41/78] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:33.553300 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77e764-5c58-4096-a61c-7480990c698b None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:33.569529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0a0c3-a1e6-4df6-b25b-45db24af1d73 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:33.602332 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a18ad-3457-4374-839b-4a0e0ca66d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:33.603006 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a18ad-3457-4374-839b-4a0e0ca66d6d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.603293 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a18ad-3457-4374-839b-4a0e0ca66d6d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.603573 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a18ad-3457-4374-839b-4a0e0ca66d6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.644693 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77e764-5c58-4096-a61c-7480990c698b None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:33.666117 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a18ad-3457-4374-839b-4a0e0ca66d6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:33.667608 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a18ad-3457-4374-839b-4a0e0ca66d6d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:33.676038 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07b83b-f1f6-4816-8867-dd72531916fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:33.676764 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07b83b-f1f6-4816-8867-dd72531916fc None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.677040 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07b83b-f1f6-4816-8867-dd72531916fc None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.677313 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07b83b-f1f6-4816-8867-dd72531916fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.686739 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07b83b-f1f6-4816-8867-dd72531916fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:33.693582 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-ad07b83b-f1f6-4816-8867-dd72531916fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:36:33.694931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 42/79] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:33.695529 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07b83b-f1f6-4816-8867-dd72531916fc None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:33.758489 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 38/80] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:36:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:33.759605 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a18ad-3457-4374-839b-4a0e0ca66d6d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:33.787392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07b83b-f1f6-4816-8867-dd72531916fc None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:33.818114 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173c66f-2e75-408e-b19f-ff4f43906adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:33.818806 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173c66f-2e75-408e-b19f-ff4f43906adb None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.819089 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173c66f-2e75-408e-b19f-ff4f43906adb None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.819365 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7173c66f-2e75-408e-b19f-ff4f43906adb None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.820100 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173c66f-2e75-408e-b19f-ff4f43906adb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:33.820402 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173c66f-2e75-408e-b19f-ff4f43906adb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:33.821786 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7173c66f-2e75-408e-b19f-ff4f43906adb None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:33.829824 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 43/81] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:36:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:33.830615 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173c66f-2e75-408e-b19f-ff4f43906adb None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:33.851750 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a18ad-3457-4374-839b-4a0e0ca66d6d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:33.883655 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee7439-a811-487f-abc7-69399c5e5049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:33.884303 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee7439-a811-487f-abc7-69399c5e5049 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.884576 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee7439-a811-487f-abc7-69399c5e5049 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.884850 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee7439-a811-487f-abc7-69399c5e5049 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.921782 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7173c66f-2e75-408e-b19f-ff4f43906adb None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:33.950266 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee7439-a811-487f-abc7-69399c5e5049 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:33.951782 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee7439-a811-487f-abc7-69399c5e5049 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:33.953571 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310c931-3e86-45fd-9625-1025cc7aad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:33.954359 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310c931-3e86-45fd-9625-1025cc7aad26 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:33.954669 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310c931-3e86-45fd-9625-1025cc7aad26 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:33.954947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0310c931-3e86-45fd-9625-1025cc7aad26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:33.956110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310c931-3e86-45fd-9625-1025cc7aad26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:33.957535 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0310c931-3e86-45fd-9625-1025cc7aad26 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:33.959190 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 44/82] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:36:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:33.959948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310c931-3e86-45fd-9625-1025cc7aad26 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:34.043436 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 39/83] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:36:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:34.044223 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee7439-a811-487f-abc7-69399c5e5049 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:34.054258 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0310c931-3e86-45fd-9625-1025cc7aad26 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:34.085835 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415db2fc-dd43-4a8d-ac14-b2a9b2700685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:34.086489 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415db2fc-dd43-4a8d-ac14-b2a9b2700685 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:34.086795 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415db2fc-dd43-4a8d-ac14-b2a9b2700685 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:34.087073 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415db2fc-dd43-4a8d-ac14-b2a9b2700685 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:34.087808 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415db2fc-dd43-4a8d-ac14-b2a9b2700685 None admin] RBAC: Adding query filter params (name=member) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:34.088113 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415db2fc-dd43-4a8d-ac14-b2a9b2700685 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:34.089497 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415db2fc-dd43-4a8d-ac14-b2a9b2700685 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:34.098340 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 45/84] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:36:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:34.099171 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415db2fc-dd43-4a8d-ac14-b2a9b2700685 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:34.135525 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee7439-a811-487f-abc7-69399c5e5049 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:34.167407 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2e08b-4534-4d70-b94d-db8c01570a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:34.168770 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2e08b-4534-4d70-b94d-db8c01570a32 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:34.169051 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2e08b-4534-4d70-b94d-db8c01570a32 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:34.169328 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2e08b-4534-4d70-b94d-db8c01570a32 None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:34.170512 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2e08b-4534-4d70-b94d-db8c01570a32 None admin] RBAC: Authorizing `identity:get_project(project_id=83feba5a40fe4602b9b7b8109feffaf3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:34.171997 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2e08b-4534-4d70-b94d-db8c01570a32 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:34.173690 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 40/85] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:34 2022] GET /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3 => generated 298 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:34.174428 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2e08b-4534-4d70-b94d-db8c01570a32 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:34.196619 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415db2fc-dd43-4a8d-ac14-b2a9b2700685 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:34.227171 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b93ab-dd63-46ee-9f32-ad044c2573bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:34.228029 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b93ab-dd63-46ee-9f32-ad044c2573bb None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:34.228312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b93ab-dd63-46ee-9f32-ad044c2573bb None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:34.228588 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b93ab-dd63-46ee-9f32-ad044c2573bb None admin] PATH_INFO: `/v3/users/fe3cab871edd46f6ad5f0e3022f6c8c3` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:34.229755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b93ab-dd63-46ee-9f32-ad044c2573bb None admin] RBAC: Authorizing `identity:get_user(user_id=fe3cab871edd46f6ad5f0e3022f6c8c3)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:34.231763 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60b93ab-dd63-46ee-9f32-ad044c2573bb None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:34.233370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 46/86] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:34 2022] GET /identity/v3/users/fe3cab871edd46f6ad5f0e3022f6c8c3 => generated 275 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:34.234129 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b93ab-dd63-46ee-9f32-ad044c2573bb None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:34.267758 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2e08b-4534-4d70-b94d-db8c01570a32 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:34.299487 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5565dd9-89e7-4216-9c09-98fc7c08e675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:34.300150 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5565dd9-89e7-4216-9c09-98fc7c08e675 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:34.300439 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5565dd9-89e7-4216-9c09-98fc7c08e675 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:34.300722 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5565dd9-89e7-4216-9c09-98fc7c08e675 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:34.301423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5565dd9-89e7-4216-9c09-98fc7c08e675 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:34.302888 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5565dd9-89e7-4216-9c09-98fc7c08e675 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:34.321562 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 41/87] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Apr 11 16:36:34 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:36:34.322403 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5565dd9-89e7-4216-9c09-98fc7c08e675 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:34.332624 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b93ab-dd63-46ee-9f32-ad044c2573bb None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:34.367858 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f4e55-c519-465a-b58b-fce3e047d821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:34.369099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f4e55-c519-465a-b58b-fce3e047d821 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:34.369577 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f4e55-c519-465a-b58b-fce3e047d821 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:34.370074 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f4e55-c519-465a-b58b-fce3e047d821 None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:34.372072 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f4e55-c519-465a-b58b-fce3e047d821 None admin] RBAC: Authorizing `identity:get_project(project_id=83feba5a40fe4602b9b7b8109feffaf3)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:34.373566 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f4e55-c519-465a-b58b-fce3e047d821 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:34.380494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 47/88] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:34 2022] GET /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:34.380494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f4e55-c519-465a-b58b-fce3e047d821 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:34.428857 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5565dd9-89e7-4216-9c09-98fc7c08e675 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:34.463347 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c76e97-2ddf-449e-8d56-92eecca445fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:34.464150 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c76e97-2ddf-449e-8d56-92eecca445fb None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:34.464431 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c76e97-2ddf-449e-8d56-92eecca445fb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:34.464705 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c76e97-2ddf-449e-8d56-92eecca445fb None admin] PATH_INFO: `/v3/users/fe3cab871edd46f6ad5f0e3022f6c8c3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:34.465976 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c76e97-2ddf-449e-8d56-92eecca445fb None admin] RBAC: Authorizing `identity:get_user(user_id=fe3cab871edd46f6ad5f0e3022f6c8c3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:34.467495 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c76e97-2ddf-449e-8d56-92eecca445fb None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:34.473908 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 42/89] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:34 2022] GET /identity/v3/users/fe3cab871edd46f6ad5f0e3022f6c8c3 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:34.473908 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c76e97-2ddf-449e-8d56-92eecca445fb None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:34.480043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f4e55-c519-465a-b58b-fce3e047d821 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:34.514901 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a42267-7a89-4948-b20a-dab2feb7bcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:34.515560 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a42267-7a89-4948-b20a-dab2feb7bcb9 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:34.515845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a42267-7a89-4948-b20a-dab2feb7bcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:34.516380 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a42267-7a89-4948-b20a-dab2feb7bcb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:34.517266 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a42267-7a89-4948-b20a-dab2feb7bcb9 None admin] RBAC: Adding query filter params (role.id=13de1ce875d44fcc988cc31b3a0639be, scope.project.id=83feba5a40fe4602b9b7b8109feffaf3, user.id=f89fba69f1e24fd6b5126bf48028fdd1) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:34.517599 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a42267-7a89-4948-b20a-dab2feb7bcb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:34.519069 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a42267-7a89-4948-b20a-dab2feb7bcb9 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:34.524706 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 48/90] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:36:34 2022] GET /identity/v3/role_assignments?user.id=f89fba69f1e24fd6b5126bf48028fdd1&scope.project.id=83feba5a40fe4602b9b7b8109feffaf3&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:34.525745 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a42267-7a89-4948-b20a-dab2feb7bcb9 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:34.582180 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c76e97-2ddf-449e-8d56-92eecca445fb None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:34.620447 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799428b-27d6-4c3c-a8e9-5b9b4a3958d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:34.621557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799428b-27d6-4c3c-a8e9-5b9b4a3958d8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:34.622043 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799428b-27d6-4c3c-a8e9-5b9b4a3958d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:34.622514 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2799428b-27d6-4c3c-a8e9-5b9b4a3958d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:34.637774 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a42267-7a89-4948-b20a-dab2feb7bcb9 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:34.674220 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dd2d9-67f2-4b58-9761-dc93718c82ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:34.674920 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dd2d9-67f2-4b58-9761-dc93718c82ab None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:34.675210 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dd2d9-67f2-4b58-9761-dc93718c82ab None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:34.675493 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98dd2d9-67f2-4b58-9761-dc93718c82ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:34.676339 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dd2d9-67f2-4b58-9761-dc93718c82ab None admin] RBAC: Adding query filter params (role.id=7695974856564d4289ab64dbf6dcc119, scope.project.id=83feba5a40fe4602b9b7b8109feffaf3, user.id=fe3cab871edd46f6ad5f0e3022f6c8c3) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:34.676657 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dd2d9-67f2-4b58-9761-dc93718c82ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:34.678139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98dd2d9-67f2-4b58-9761-dc93718c82ab None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:34.685002 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 49/91] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:36:34 2022] GET /identity/v3/role_assignments?user.id=fe3cab871edd46f6ad5f0e3022f6c8c3&scope.project.id=83feba5a40fe4602b9b7b8109feffaf3&role.id=7695974856564d4289ab64dbf6dcc119 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:34.685996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dd2d9-67f2-4b58-9761-dc93718c82ab None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:34.700115 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799428b-27d6-4c3c-a8e9-5b9b4a3958d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:34.702013 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2799428b-27d6-4c3c-a8e9-5b9b4a3958d8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:34.797158 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98dd2d9-67f2-4b58-9761-dc93718c82ab None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:34.816502 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 43/92] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:36:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:34.822569 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799428b-27d6-4c3c-a8e9-5b9b4a3958d8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:34.834480 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529a560-ef21-4bbd-a2bc-da31a4fba362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:34.835177 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a560-ef21-4bbd-a2bc-da31a4fba362 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:34.835463 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a560-ef21-4bbd-a2bc-da31a4fba362 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:34.835744 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529a560-ef21-4bbd-a2bc-da31a4fba362 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:34.912932 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529a560-ef21-4bbd-a2bc-da31a4fba362 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:34.914442 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0529a560-ef21-4bbd-a2bc-da31a4fba362 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:34.928624 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2799428b-27d6-4c3c-a8e9-5b9b4a3958d8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:34.964737 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1659e-b9f1-4a44-8ff9-f3996ec9a24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:34.966043 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1659e-b9f1-4a44-8ff9-f3996ec9a24f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:34.966526 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1659e-b9f1-4a44-8ff9-f3996ec9a24f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:34.967027 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1659e-b9f1-4a44-8ff9-f3996ec9a24f None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:34.968445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1659e-b9f1-4a44-8ff9-f3996ec9a24f None admin] RBAC: Authorizing `identity:get_project(project_id=83feba5a40fe4602b9b7b8109feffaf3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:34.970091 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1659e-b9f1-4a44-8ff9-f3996ec9a24f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:34.972038 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 44/93] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:34 2022] GET /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:34.978261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1659e-b9f1-4a44-8ff9-f3996ec9a24f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:35.021456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 50/94] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:36:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:35.026767 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529a560-ef21-4bbd-a2bc-da31a4fba362 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:35.115290 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1659e-b9f1-4a44-8ff9-f3996ec9a24f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:35.149707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529a560-ef21-4bbd-a2bc-da31a4fba362 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:35.158698 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34799d2-41e3-41ac-a2e0-bbd43a366956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:35.160047 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34799d2-41e3-41ac-a2e0-bbd43a366956 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:35.160554 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34799d2-41e3-41ac-a2e0-bbd43a366956 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:35.161296 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34799d2-41e3-41ac-a2e0-bbd43a366956 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:35.162628 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34799d2-41e3-41ac-a2e0-bbd43a366956 None admin] RBAC: Adding query filter params (role.id=807f93fb1a91497aba7762557ae039dd, scope.project.id=83feba5a40fe4602b9b7b8109feffaf3, user.id=fe3cab871edd46f6ad5f0e3022f6c8c3) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:35.163139 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34799d2-41e3-41ac-a2e0-bbd43a366956 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:35.165461 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34799d2-41e3-41ac-a2e0-bbd43a366956 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:35.177647 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 45/95] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:36:34 2022] GET /identity/v3/role_assignments?user.id=fe3cab871edd46f6ad5f0e3022f6c8c3&scope.project.id=83feba5a40fe4602b9b7b8109feffaf3&role.id=807f93fb1a91497aba7762557ae039dd => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:35.199396 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1394b75-27be-43bb-afb7-f074406d52c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:35.201119 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1394b75-27be-43bb-afb7-f074406d52c0 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:35.201587 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1394b75-27be-43bb-afb7-f074406d52c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:35.202059 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1394b75-27be-43bb-afb7-f074406d52c0 None admin] PATH_INFO: `/v3/projects/1088154a295c41f8b535fb2e1e88431c` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:35.203489 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1394b75-27be-43bb-afb7-f074406d52c0 None admin] RBAC: Authorizing `identity:get_project(project_id=1088154a295c41f8b535fb2e1e88431c)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:35.205203 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1394b75-27be-43bb-afb7-f074406d52c0 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:35.207364 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 51/96] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:35 2022] GET /identity/v3/projects/1088154a295c41f8b535fb2e1e88431c => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:35.213751 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34799d2-41e3-41ac-a2e0-bbd43a366956 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:35.328543 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34799d2-41e3-41ac-a2e0-bbd43a366956 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:35.369839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d29f6-ca36-4fc0-b353-1e1d4349dc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:35.370858 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d29f6-ca36-4fc0-b353-1e1d4349dc67 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:35.371998 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d29f6-ca36-4fc0-b353-1e1d4349dc67 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:35.372606 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d29f6-ca36-4fc0-b353-1e1d4349dc67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:35.374223 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d29f6-ca36-4fc0-b353-1e1d4349dc67 None admin] RBAC: Adding query filter params (role.id=7695974856564d4289ab64dbf6dcc119, scope.project.id=1088154a295c41f8b535fb2e1e88431c, user.id=fe3cab871edd46f6ad5f0e3022f6c8c3) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:35.374969 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d29f6-ca36-4fc0-b353-1e1d4349dc67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:35.377402 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d29f6-ca36-4fc0-b353-1e1d4349dc67 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:35.383878 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 46/97] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:36:35 2022] GET /identity/v3/role_assignments?user.id=fe3cab871edd46f6ad5f0e3022f6c8c3&scope.project.id=1088154a295c41f8b535fb2e1e88431c&role.id=7695974856564d4289ab64dbf6dcc119 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:37.830395 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0531385-eb34-42f4-9d88-19ec6b4c8c2c None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:37.830961 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0531385-eb34-42f4-9d88-19ec6b4c8c2c None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:37.830961 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0531385-eb34-42f4-9d88-19ec6b4c8c2c None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:37.832464 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 52/98] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:37.838372 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196110b0-2373-4f5d-b90f-d70c502b9c14 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:37.839327 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196110b0-2373-4f5d-b90f-d70c502b9c14 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:37.839884 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196110b0-2373-4f5d-b90f-d70c502b9c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:37.865074 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-196110b0-2373-4f5d-b90f-d70c502b9c14 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:37.870615 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-196110b0-2373-4f5d-b90f-d70c502b9c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:37.953150 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 47/99] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:36:37.989627 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0531385-eb34-42f4-9d88-19ec6b4c8c2c None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:38.062863 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab18c1-2645-4399-8358-994398626201 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:38.063270 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab18c1-2645-4399-8358-994398626201 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:38.063528 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeab18c1-2645-4399-8358-994398626201 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:38.064961 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 48/100] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:38.074706 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94837d6c-2d02-4d56-8d01-459c106ff80f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:38.075041 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94837d6c-2d02-4d56-8d01-459c106ff80f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:38.075274 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94837d6c-2d02-4d56-8d01-459c106ff80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:38.098484 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-94837d6c-2d02-4d56-8d01-459c106ff80f None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:38.103720 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-94837d6c-2d02-4d56-8d01-459c106ff80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:38.137705 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0531385-eb34-42f4-9d88-19ec6b4c8c2c None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:38.195314 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783e24f-8a7f-43dc-a20f-eb0b3634e79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:38.196435 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783e24f-8a7f-43dc-a20f-eb0b3634e79a None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:38.196722 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783e24f-8a7f-43dc-a20f-eb0b3634e79a None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:38.196997 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783e24f-8a7f-43dc-a20f-eb0b3634e79a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:38.207258 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 49/101] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:36:38.208604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e1355-fb6c-409d-aad0-0e6ea325377e None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:38.208896 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e1355-fb6c-409d-aad0-0e6ea325377e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:38.209173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e1355-fb6c-409d-aad0-0e6ea325377e None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:38.210612 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 50/102] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:38.217549 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e37f8-c39c-47a7-a544-1e556e74fcc7 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:38.217836 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e37f8-c39c-47a7-a544-1e556e74fcc7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:38.218113 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36e37f8-c39c-47a7-a544-1e556e74fcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:38.220503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783e24f-8a7f-43dc-a20f-eb0b3634e79a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:38.229111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-d783e24f-8a7f-43dc-a20f-eb0b3634e79a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 16:36:38.230338 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 53/103] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:38.239175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783e24f-8a7f-43dc-a20f-eb0b3634e79a None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:38.247658 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-e36e37f8-c39c-47a7-a544-1e556e74fcc7 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:38.248827 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e36e37f8-c39c-47a7-a544-1e556e74fcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:38.356582 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 51/104] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:38.360368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e37f8-c39c-47a7-a544-1e556e74fcc7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:38.418815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783e24f-8a7f-43dc-a20f-eb0b3634e79a None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:38.459036 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5eb57-f9ec-488a-a3c7-ee9c16091ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:38.460390 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5eb57-f9ec-488a-a3c7-ee9c16091ac7 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:38.460898 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5eb57-f9ec-488a-a3c7-ee9c16091ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:38.461514 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5eb57-f9ec-488a-a3c7-ee9c16091ac7 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:38.463066 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5eb57-f9ec-488a-a3c7-ee9c16091ac7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:38.463599 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5eb57-f9ec-488a-a3c7-ee9c16091ac7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:38.466127 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5eb57-f9ec-488a-a3c7-ee9c16091ac7 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:38.475177 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 54/105] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:36:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:38.476302 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5eb57-f9ec-488a-a3c7-ee9c16091ac7 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:38.507951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36e37f8-c39c-47a7-a544-1e556e74fcc7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:38.542365 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1a44f-c9fe-4f2b-baff-01a97701a898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:38.543670 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1a44f-c9fe-4f2b-baff-01a97701a898 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:38.543980 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1a44f-c9fe-4f2b-baff-01a97701a898 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:38.544255 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1a44f-c9fe-4f2b-baff-01a97701a898 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:38.555608 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1a44f-c9fe-4f2b-baff-01a97701a898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:38.562775 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-e7f1a44f-c9fe-4f2b-baff-01a97701a898 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:36:38.564037 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 52/106] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:38.566776 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d8004-1ee9-4432-a616-f3f99a32f86e None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:38.566776 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d8004-1ee9-4432-a616-f3f99a32f86e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:38.566776 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42d8004-1ee9-4432-a616-f3f99a32f86e None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:38.567121 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 53/107] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:38.568105 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67669a30-2dcd-40f9-887c-709e062a7560 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:38.568389 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67669a30-2dcd-40f9-887c-709e062a7560 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:38.568659 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67669a30-2dcd-40f9-887c-709e062a7560 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:38.569857 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 54/108] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:38.572073 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67669a30-2dcd-40f9-887c-709e062a7560 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:38.581267 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5eb57-f9ec-488a-a3c7-ee9c16091ac7 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:38.613665 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92328e18-102a-4a40-9d42-e9934c179fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:38.614554 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92328e18-102a-4a40-9d42-e9934c179fad None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:38.614866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92328e18-102a-4a40-9d42-e9934c179fad None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:38.615140 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92328e18-102a-4a40-9d42-e9934c179fad None admin] PATH_INFO: `/v3/domains/default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:38.616298 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92328e18-102a-4a40-9d42-e9934c179fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:38.617767 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92328e18-102a-4a40-9d42-e9934c179fad None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:38.620628 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 55/109] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:36:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:38.620628 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92328e18-102a-4a40-9d42-e9934c179fad None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:38.685262 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67669a30-2dcd-40f9-887c-709e062a7560 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:38.715622 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92328e18-102a-4a40-9d42-e9934c179fad None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:38.718872 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b34bf-22c3-4fe6-bc26-fb406b488206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:38.719755 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b34bf-22c3-4fe6-bc26-fb406b488206 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:38.720040 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b34bf-22c3-4fe6-bc26-fb406b488206 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:38.720318 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b34bf-22c3-4fe6-bc26-fb406b488206 None admin] PATH_INFO: `/v3/users/c5b2f92348954b20a84e662fd5cbc3f2` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:38.733081 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b34bf-22c3-4fe6-bc26-fb406b488206 None admin] RBAC: Authorizing `identity:get_user(user_id=c5b2f92348954b20a84e662fd5cbc3f2)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:38.734557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b34bf-22c3-4fe6-bc26-fb406b488206 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:38.736421 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 55/110] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:38 2022] GET /identity/v3/users/c5b2f92348954b20a84e662fd5cbc3f2 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:38.740622 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de8ef0-1f47-48b5-a7c3-edc85ff80d0c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:38.741136 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de8ef0-1f47-48b5-a7c3-edc85ff80d0c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:38.741423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de8ef0-1f47-48b5-a7c3-edc85ff80d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:38.749973 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f6df64-517c-4ada-bafa-b5f2d46f4396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:38.750658 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6df64-517c-4ada-bafa-b5f2d46f4396 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:38.750939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6df64-517c-4ada-bafa-b5f2d46f4396 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:38.751211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f6df64-517c-4ada-bafa-b5f2d46f4396 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:38.751949 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6df64-517c-4ada-bafa-b5f2d46f4396 None admin] RBAC: Adding query filter params (name=member) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:38.752257 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6df64-517c-4ada-bafa-b5f2d46f4396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:38.753617 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f6df64-517c-4ada-bafa-b5f2d46f4396 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:38.757695 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b2de8ef0-1f47-48b5-a7c3-edc85ff80d0c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:38.758903 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b2de8ef0-1f47-48b5-a7c3-edc85ff80d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:38.762269 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 56/111] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:36:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:38.763649 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753076f-b2f8-4cca-a2a1-ab99f2d740f2 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:38.763931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753076f-b2f8-4cca-a2a1-ab99f2d740f2 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:38.764205 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753076f-b2f8-4cca-a2a1-ab99f2d740f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:38.787813 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-1753076f-b2f8-4cca-a2a1-ab99f2d740f2 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:38.788996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-1753076f-b2f8-4cca-a2a1-ab99f2d740f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:38.846315 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 56/112] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:38.847222 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de8ef0-1f47-48b5-a7c3-edc85ff80d0c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:38.867427 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 57/113] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:38.868883 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753076f-b2f8-4cca-a2a1-ab99f2d740f2 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:38.967219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de8ef0-1f47-48b5-a7c3-edc85ff80d0c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:38.977432 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753076f-b2f8-4cca-a2a1-ab99f2d740f2 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:39.001716 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fcd61-bbea-42ea-aaea-8e972b4c4284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:39.002470 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fcd61-bbea-42ea-aaea-8e972b4c4284 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:39.002789 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fcd61-bbea-42ea-aaea-8e972b4c4284 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:39.003070 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851fcd61-bbea-42ea-aaea-8e972b4c4284 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:39.003777 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fcd61-bbea-42ea-aaea-8e972b4c4284 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:39.005228 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851fcd61-bbea-42ea-aaea-8e972b4c4284 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:39.010366 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cba32-abe3-4795-bfe3-2e616613be65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:39.011049 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cba32-abe3-4795-bfe3-2e616613be65 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:39.011339 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cba32-abe3-4795-bfe3-2e616613be65 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:39.011675 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65cba32-abe3-4795-bfe3-2e616613be65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:39.043120 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 57/114] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Apr 11 16:36:38 2022] POST /identity/v3/projects => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:36:39.044143 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fcd61-bbea-42ea-aaea-8e972b4c4284 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:39.085675 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cba32-abe3-4795-bfe3-2e616613be65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:39.087603 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65cba32-abe3-4795-bfe3-2e616613be65 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:39.197026 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851fcd61-bbea-42ea-aaea-8e972b4c4284 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:39.201395 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 58/115] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:36:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:39.202446 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cba32-abe3-4795-bfe3-2e616613be65 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:39.236694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e727e72-08f6-4dab-a9d0-483d0179f51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:39.237577 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e727e72-08f6-4dab-a9d0-483d0179f51c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:39.237868 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e727e72-08f6-4dab-a9d0-483d0179f51c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:39.238150 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e727e72-08f6-4dab-a9d0-483d0179f51c None admin] PATH_INFO: `/v3/users/fe3cab871edd46f6ad5f0e3022f6c8c3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:39.239416 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e727e72-08f6-4dab-a9d0-483d0179f51c None admin] RBAC: Authorizing `identity:get_user(user_id=fe3cab871edd46f6ad5f0e3022f6c8c3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:39.240875 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e727e72-08f6-4dab-a9d0-483d0179f51c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:39.242532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 58/116] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:39 2022] GET /identity/v3/users/fe3cab871edd46f6ad5f0e3022f6c8c3 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:39.243415 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e727e72-08f6-4dab-a9d0-483d0179f51c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:39.303608 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65cba32-abe3-4795-bfe3-2e616613be65 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:39.336715 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc10bf5a-7e3e-4d41-b2ea-ec1f92ac15ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:39.337518 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10bf5a-7e3e-4d41-b2ea-ec1f92ac15ed None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:39.337804 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10bf5a-7e3e-4d41-b2ea-ec1f92ac15ed None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:39.338080 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc10bf5a-7e3e-4d41-b2ea-ec1f92ac15ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:39.345185 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e727e72-08f6-4dab-a9d0-483d0179f51c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:39.348098 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc10bf5a-7e3e-4d41-b2ea-ec1f92ac15ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:39.355140 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-bc10bf5a-7e3e-4d41-b2ea-ec1f92ac15ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:36:39.357183 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 59/117] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:36:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:39.358419 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75569d8b-6a36-446f-a1bd-79842e7a5771 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:39.358744 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75569d8b-6a36-446f-a1bd-79842e7a5771 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:39.359027 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75569d8b-6a36-446f-a1bd-79842e7a5771 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:39.363895 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 60/118] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:39.363895 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75569d8b-6a36-446f-a1bd-79842e7a5771 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:39.379233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f59153-f2f7-4b0b-87f4-d558be814476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:39.380050 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f59153-f2f7-4b0b-87f4-d558be814476 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:39.380340 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f59153-f2f7-4b0b-87f4-d558be814476 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:39.380642 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f59153-f2f7-4b0b-87f4-d558be814476 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:39.390545 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f59153-f2f7-4b0b-87f4-d558be814476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:39.398151 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-a3f59153-f2f7-4b0b-87f4-d558be814476 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:36:39.399399 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 59/119] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:36:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:39.400260 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f59153-f2f7-4b0b-87f4-d558be814476 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:39.468057 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75569d8b-6a36-446f-a1bd-79842e7a5771 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:39.498555 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f59153-f2f7-4b0b-87f4-d558be814476 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:39.500335 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796e9b3-e68e-4b1e-a52b-450161ba6e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:39.501189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796e9b3-e68e-4b1e-a52b-450161ba6e9f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:39.501523 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796e9b3-e68e-4b1e-a52b-450161ba6e9f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:39.501777 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796e9b3-e68e-4b1e-a52b-450161ba6e9f None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:39.502976 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796e9b3-e68e-4b1e-a52b-450161ba6e9f None admin] RBAC: Authorizing `identity:get_project(project_id=83feba5a40fe4602b9b7b8109feffaf3)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:39.504424 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796e9b3-e68e-4b1e-a52b-450161ba6e9f None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:39.510866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 61/120] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:39 2022] GET /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:39.510866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796e9b3-e68e-4b1e-a52b-450161ba6e9f None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:39.532197 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1bc2cc-6f81-4cad-825a-80d1bc733166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:39.533055 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bc2cc-6f81-4cad-825a-80d1bc733166 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:39.533348 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bc2cc-6f81-4cad-825a-80d1bc733166 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:39.533631 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1bc2cc-6f81-4cad-825a-80d1bc733166 None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:39.535252 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1bc2cc-6f81-4cad-825a-80d1bc733166 None admin] RBAC: Authorizing `identity:get_project(project_id=83feba5a40fe4602b9b7b8109feffaf3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:39.536736 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1bc2cc-6f81-4cad-825a-80d1bc733166 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:39.538451 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 60/121] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:39 2022] GET /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:39.543716 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a6c88-0405-4f51-9afd-445a2d197653 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:39.543716 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a6c88-0405-4f51-9afd-445a2d197653 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:39.543716 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a6c88-0405-4f51-9afd-445a2d197653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:39.558727 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-cf3a6c88-0405-4f51-9afd-445a2d197653 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:39.559899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-cf3a6c88-0405-4f51-9afd-445a2d197653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:39.607282 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796e9b3-e68e-4b1e-a52b-450161ba6e9f None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:39.622233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 61/122] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:39.623244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a6c88-0405-4f51-9afd-445a2d197653 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:39.639711 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4fb4c-a0a0-4b04-a949-6020005daca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:39.640379 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4fb4c-a0a0-4b04-a949-6020005daca8 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:39.640670 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4fb4c-a0a0-4b04-a949-6020005daca8 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:39.640954 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4fb4c-a0a0-4b04-a949-6020005daca8 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:39.641963 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4fb4c-a0a0-4b04-a949-6020005daca8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:39.642276 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4fb4c-a0a0-4b04-a949-6020005daca8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:39.643704 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4fb4c-a0a0-4b04-a949-6020005daca8 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:39.651828 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 62/123] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:39.653241 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4fb4c-a0a0-4b04-a949-6020005daca8 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:39.728742 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3a6c88-0405-4f51-9afd-445a2d197653 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:39.749636 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4fb4c-a0a0-4b04-a949-6020005daca8 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:39.762660 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719544f-0881-454f-89cf-83cebae303b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:39.763322 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719544f-0881-454f-89cf-83cebae303b8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:39.763609 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719544f-0881-454f-89cf-83cebae303b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:39.763875 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719544f-0881-454f-89cf-83cebae303b8 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:39.764623 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719544f-0881-454f-89cf-83cebae303b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:39.764929 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719544f-0881-454f-89cf-83cebae303b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:39.766566 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719544f-0881-454f-89cf-83cebae303b8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:39.774561 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 62/124] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:36:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:39.775188 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719544f-0881-454f-89cf-83cebae303b8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:39.783861 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65c05e-51a2-4759-968e-6fb73e7cbc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:39.784780 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65c05e-51a2-4759-968e-6fb73e7cbc41 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:39.785245 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65c05e-51a2-4759-968e-6fb73e7cbc41 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:39.785708 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65c05e-51a2-4759-968e-6fb73e7cbc41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:39.786751 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65c05e-51a2-4759-968e-6fb73e7cbc41 None admin] RBAC: Adding query filter params (role.id=0c5e1f6e454b40159cc24d34e2c3fa9f, scope.project.id=83feba5a40fe4602b9b7b8109feffaf3, user.id=c5b2f92348954b20a84e662fd5cbc3f2) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:39.787260 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65c05e-51a2-4759-968e-6fb73e7cbc41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:39.788918 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65c05e-51a2-4759-968e-6fb73e7cbc41 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:39.794979 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 63/125] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:36:39 2022] GET /identity/v3/role_assignments?user.id=c5b2f92348954b20a84e662fd5cbc3f2&scope.project.id=83feba5a40fe4602b9b7b8109feffaf3&role.id=0c5e1f6e454b40159cc24d34e2c3fa9f => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:39.795820 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65c05e-51a2-4759-968e-6fb73e7cbc41 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:39.897669 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719544f-0881-454f-89cf-83cebae303b8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:39.904612 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65c05e-51a2-4759-968e-6fb73e7cbc41 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:39.941667 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd836fb5-768b-4f63-a781-64773ab4d739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:39.942761 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd836fb5-768b-4f63-a781-64773ab4d739 None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:39.942937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd836fb5-768b-4f63-a781-64773ab4d739 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:39.943220 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd836fb5-768b-4f63-a781-64773ab4d739 None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3/users/fe3cab871edd46f6ad5f0e3022f6c8c3/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:39.943891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62192299-afb9-4670-9f48-d9372c4975bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:39.945088 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62192299-afb9-4670-9f48-d9372c4975bb None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:39.945504 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd836fb5-768b-4f63-a781-64773ab4d739 None admin] RBAC: Authorizing `identity:create_grant(project_id=83feba5a40fe4602b9b7b8109feffaf3, user_id=fe3cab871edd46f6ad5f0e3022f6c8c3, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:39.945727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62192299-afb9-4670-9f48-d9372c4975bb None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:39.946186 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62192299-afb9-4670-9f48-d9372c4975bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:39.947231 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd836fb5-768b-4f63-a781-64773ab4d739 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:39.959802 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62192299-afb9-4670-9f48-d9372c4975bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:39.966204 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 63/126] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:36:39 2022] PUT /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3/users/fe3cab871edd46f6ad5f0e3022f6c8c3/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:36:39.967263 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd836fb5-768b-4f63-a781-64773ab4d739 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:39.968507 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-62192299-afb9-4670-9f48-d9372c4975bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:36:39.975310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 64/127] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:39.976565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62192299-afb9-4670-9f48-d9372c4975bb None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:40.079805 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd836fb5-768b-4f63-a781-64773ab4d739 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:40.086275 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62192299-afb9-4670-9f48-d9372c4975bb None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:40.116101 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234b9e9-3845-4caf-b261-35ac93bc8ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:40.117089 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234b9e9-3845-4caf-b261-35ac93bc8ab4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:40.117454 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234b9e9-3845-4caf-b261-35ac93bc8ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:40.117806 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234b9e9-3845-4caf-b261-35ac93bc8ab4 None admin] PATH_INFO: `/v3/users/f89fba69f1e24fd6b5126bf48028fdd1` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:40.119198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234b9e9-3845-4caf-b261-35ac93bc8ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=f89fba69f1e24fd6b5126bf48028fdd1)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:40.120755 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234b9e9-3845-4caf-b261-35ac93bc8ab4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:40.123569 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 64/128] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:39 2022] GET /identity/v3/users/f89fba69f1e24fd6b5126bf48028fdd1 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:40.124324 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234b9e9-3845-4caf-b261-35ac93bc8ab4 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:40.129800 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a427a-c34b-4bad-ba58-781ec0be10d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:40.131082 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a427a-c34b-4bad-ba58-781ec0be10d3 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:40.131586 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a427a-c34b-4bad-ba58-781ec0be10d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:40.132068 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a427a-c34b-4bad-ba58-781ec0be10d3 None admin] PATH_INFO: `/v3/users/fe3cab871edd46f6ad5f0e3022f6c8c3` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:40.133737 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a427a-c34b-4bad-ba58-781ec0be10d3 None admin] RBAC: Authorizing `identity:get_user(user_id=fe3cab871edd46f6ad5f0e3022f6c8c3)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:40.135494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a427a-c34b-4bad-ba58-781ec0be10d3 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:40.137577 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 65/129] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:39 2022] GET /identity/v3/users/fe3cab871edd46f6ad5f0e3022f6c8c3 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:40.138646 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a427a-c34b-4bad-ba58-781ec0be10d3 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:40.233616 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234b9e9-3845-4caf-b261-35ac93bc8ab4 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:40.243679 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a427a-c34b-4bad-ba58-781ec0be10d3 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:40.270434 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9dbe6-9e25-4476-80bf-95fc37ef2fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:40.271077 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9dbe6-9e25-4476-80bf-95fc37ef2fdb None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:40.271367 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9dbe6-9e25-4476-80bf-95fc37ef2fdb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:40.271647 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9dbe6-9e25-4476-80bf-95fc37ef2fdb None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:40.272401 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9dbe6-9e25-4476-80bf-95fc37ef2fdb None admin] RBAC: Adding query filter params (name=member) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:40.272713 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9dbe6-9e25-4476-80bf-95fc37ef2fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:40.274108 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9dbe6-9e25-4476-80bf-95fc37ef2fdb None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:40.280690 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc526a-dc3e-4040-b46b-b878f1616048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:40.281880 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc526a-dc3e-4040-b46b-b878f1616048 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:40.282354 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc526a-dc3e-4040-b46b-b878f1616048 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:40.282895 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dc526a-dc3e-4040-b46b-b878f1616048 None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:40.283884 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 65/130] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:36:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:40.284694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9dbe6-9e25-4476-80bf-95fc37ef2fdb None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:40.285022 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc526a-dc3e-4040-b46b-b878f1616048 None admin] RBAC: Authorizing `identity:get_project(project_id=83feba5a40fe4602b9b7b8109feffaf3)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:40.286685 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dc526a-dc3e-4040-b46b-b878f1616048 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:40.288569 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 66/131] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:40 2022] GET /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:40.295817 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc526a-dc3e-4040-b46b-b878f1616048 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:40.386171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9dbe6-9e25-4476-80bf-95fc37ef2fdb None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:40.399933 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dc526a-dc3e-4040-b46b-b878f1616048 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:40.420923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0723b2-752b-4022-870e-3bea0e3d9092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:40.421576 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0723b2-752b-4022-870e-3bea0e3d9092 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:40.421865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0723b2-752b-4022-870e-3bea0e3d9092 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:40.422147 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0723b2-752b-4022-870e-3bea0e3d9092 None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:40.423374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0723b2-752b-4022-870e-3bea0e3d9092 None admin] RBAC: Authorizing `identity:get_project(project_id=83feba5a40fe4602b9b7b8109feffaf3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:40.424820 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0723b2-752b-4022-870e-3bea0e3d9092 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:40.426522 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 66/132] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:40 2022] GET /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:40.427399 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0723b2-752b-4022-870e-3bea0e3d9092 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:40.436190 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e329c-d795-4c3f-a859-d8c7d4e37e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:40.437390 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e329c-d795-4c3f-a859-d8c7d4e37e21 None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:40.437862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e329c-d795-4c3f-a859-d8c7d4e37e21 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:40.438346 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e329c-d795-4c3f-a859-d8c7d4e37e21 None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3/users/f89fba69f1e24fd6b5126bf48028fdd1/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:40.440555 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e329c-d795-4c3f-a859-d8c7d4e37e21 None admin] RBAC: Authorizing `identity:create_grant(project_id=83feba5a40fe4602b9b7b8109feffaf3, user_id=f89fba69f1e24fd6b5126bf48028fdd1, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:40.442310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0e329c-d795-4c3f-a859-d8c7d4e37e21 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:40.467520 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 67/133] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:36:40 2022] PUT /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3/users/f89fba69f1e24fd6b5126bf48028fdd1/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:36:40.468679 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e329c-d795-4c3f-a859-d8c7d4e37e21 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:40.532518 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0723b2-752b-4022-870e-3bea0e3d9092 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:40.568529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b0d4a-c0b7-4557-a3d1-a49d4c66ebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:40.569463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b0d4a-c0b7-4557-a3d1-a49d4c66ebc0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:40.569750 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b0d4a-c0b7-4557-a3d1-a49d4c66ebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:40.570029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406b0d4a-c0b7-4557-a3d1-a49d4c66ebc0 None admin] PATH_INFO: `/v3/users/fe3cab871edd46f6ad5f0e3022f6c8c3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:40.571666 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b0d4a-c0b7-4557-a3d1-a49d4c66ebc0 None admin] RBAC: Authorizing `identity:get_user(user_id=fe3cab871edd46f6ad5f0e3022f6c8c3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:40.572899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406b0d4a-c0b7-4557-a3d1-a49d4c66ebc0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:40.575157 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 67/134] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:40 2022] GET /identity/v3/users/fe3cab871edd46f6ad5f0e3022f6c8c3 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:40.580828 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b0d4a-c0b7-4557-a3d1-a49d4c66ebc0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:40.599093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0e329c-d795-4c3f-a859-d8c7d4e37e21 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:40.634087 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f931e5b-bf21-443c-aa0c-d2247c96128f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:40.635448 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f931e5b-bf21-443c-aa0c-d2247c96128f None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:40.635948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f931e5b-bf21-443c-aa0c-d2247c96128f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:40.637004 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f931e5b-bf21-443c-aa0c-d2247c96128f None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3/users/fe3cab871edd46f6ad5f0e3022f6c8c3/roles/807f93fb1a91497aba7762557ae039dd` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:40.639752 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f931e5b-bf21-443c-aa0c-d2247c96128f None admin] RBAC: Authorizing `identity:create_grant(project_id=83feba5a40fe4602b9b7b8109feffaf3, user_id=fe3cab871edd46f6ad5f0e3022f6c8c3, role_id=807f93fb1a91497aba7762557ae039dd)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:40.641769 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f931e5b-bf21-443c-aa0c-d2247c96128f None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:40.659612 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 68/135] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:36:40 2022] PUT /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3/users/fe3cab871edd46f6ad5f0e3022f6c8c3/roles/807f93fb1a91497aba7762557ae039dd => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:36:40.693482 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406b0d4a-c0b7-4557-a3d1-a49d4c66ebc0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:40.738486 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782770e-33cd-4862-9b8a-afad0deac5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:40.739444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782770e-33cd-4862-9b8a-afad0deac5b5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:40.739736 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782770e-33cd-4862-9b8a-afad0deac5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:40.740106 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782770e-33cd-4862-9b8a-afad0deac5b5 None admin] PATH_INFO: `/v3/projects/1088154a295c41f8b535fb2e1e88431c` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:40.741355 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782770e-33cd-4862-9b8a-afad0deac5b5 None admin] RBAC: Authorizing `identity:get_project(project_id=1088154a295c41f8b535fb2e1e88431c)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:40.742933 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782770e-33cd-4862-9b8a-afad0deac5b5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:40.746276 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 68/136] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:40 2022] GET /identity/v3/projects/1088154a295c41f8b535fb2e1e88431c => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:40.751504 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f931e5b-bf21-443c-aa0c-d2247c96128f None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:40.864674 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f931e5b-bf21-443c-aa0c-d2247c96128f None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:40.900457 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ea9ee-2446-4b66-a355-3ba863906e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:40.901764 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ea9ee-2446-4b66-a355-3ba863906e99 None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:40.902906 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ea9ee-2446-4b66-a355-3ba863906e99 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:40.903400 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ea9ee-2446-4b66-a355-3ba863906e99 None admin] PATH_INFO: `/v3/projects/1088154a295c41f8b535fb2e1e88431c/users/fe3cab871edd46f6ad5f0e3022f6c8c3/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:40.905722 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ea9ee-2446-4b66-a355-3ba863906e99 None admin] RBAC: Authorizing `identity:create_grant(project_id=1088154a295c41f8b535fb2e1e88431c, user_id=fe3cab871edd46f6ad5f0e3022f6c8c3, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:40.907952 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ea9ee-2446-4b66-a355-3ba863906e99 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:40.931937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 69/137] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:36:40 2022] PUT /identity/v3/projects/1088154a295c41f8b535fb2e1e88431c/users/fe3cab871edd46f6ad5f0e3022f6c8c3/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:36:41.722543 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe3d6c-8bb7-4fe5-b428-def7a3ee8db4 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:41.723070 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe3d6c-8bb7-4fe5-b428-def7a3ee8db4 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:41.723143 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe3d6c-8bb7-4fe5-b428-def7a3ee8db4 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:41.724509 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 69/138] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:41.729790 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67427e3b-be05-4981-a54a-68746cf6d8a9 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:41.730920 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67427e3b-be05-4981-a54a-68746cf6d8a9 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:41.731390 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67427e3b-be05-4981-a54a-68746cf6d8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:41.754947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-67427e3b-be05-4981-a54a-68746cf6d8a9 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:41.756436 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-67427e3b-be05-4981-a54a-68746cf6d8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:41.835695 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 70/139] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:41.877165 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe3d6c-8bb7-4fe5-b428-def7a3ee8db4 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:41.991334 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe3d6c-8bb7-4fe5-b428-def7a3ee8db4 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:42.033634 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195f412-ed87-4bb2-9e74-437185b1aa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:42.034442 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195f412-ed87-4bb2-9e74-437185b1aa4a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:42.034758 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195f412-ed87-4bb2-9e74-437185b1aa4a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:42.035040 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195f412-ed87-4bb2-9e74-437185b1aa4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:42.036411 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195f412-ed87-4bb2-9e74-437185b1aa4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:42.037870 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195f412-ed87-4bb2-9e74-437185b1aa4a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:42.039880 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 70/140] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:36:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:42.045647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67427e3b-be05-4981-a54a-68746cf6d8a9 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:42.167516 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67427e3b-be05-4981-a54a-68746cf6d8a9 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:42.211102 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c836f72-df1a-48c8-8e8d-db5e55ac4261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:42.211779 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c836f72-df1a-48c8-8e8d-db5e55ac4261 None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:42.212069 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c836f72-df1a-48c8-8e8d-db5e55ac4261 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:42.212351 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c836f72-df1a-48c8-8e8d-db5e55ac4261 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:42.213069 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c836f72-df1a-48c8-8e8d-db5e55ac4261 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:42.214571 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c836f72-df1a-48c8-8e8d-db5e55ac4261 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:42.248589 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 71/141] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Apr 11 16:36:42 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:36:43.411359 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4990a5-ee76-4f54-afae-286c732ff0b1 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:43.411854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4990a5-ee76-4f54-afae-286c732ff0b1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:43.411928 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4990a5-ee76-4f54-afae-286c732ff0b1 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:43.413298 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 71/142] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:43.419480 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a982b3-fc8f-4644-a290-bce1fe319d53 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:43.419927 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a982b3-fc8f-4644-a290-bce1fe319d53 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:43.420109 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a982b3-fc8f-4644-a290-bce1fe319d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:43.442610 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-c3a982b3-fc8f-4644-a290-bce1fe319d53 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:43.443791 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-c3a982b3-fc8f-4644-a290-bce1fe319d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:43.489074 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edec05e-161a-440b-b1f5-43ef3ca0dee6 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:43.489384 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edec05e-161a-440b-b1f5-43ef3ca0dee6 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:43.489640 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edec05e-161a-440b-b1f5-43ef3ca0dee6 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:43.491054 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 72/143] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:43.503777 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ac37c-982d-4159-9581-d3ea750088f7 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:43.504581 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ac37c-982d-4159-9581-d3ea750088f7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:43.505475 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ac37c-982d-4159-9581-d3ea750088f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:43.529599 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-745ac37c-982d-4159-9581-d3ea750088f7 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:43.531316 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-745ac37c-982d-4159-9581-d3ea750088f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:43.531820 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 72/144] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:43.590767 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a982b3-fc8f-4644-a290-bce1fe319d53 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:43.608452 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 73/145] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:36:43.653650 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ac37c-982d-4159-9581-d3ea750088f7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:43.770569 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a982b3-fc8f-4644-a290-bce1fe319d53 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:43.820207 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5dd4b-60bd-4a72-bd76-af3a5496f4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:43.821393 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5dd4b-60bd-4a72-bd76-af3a5496f4d3 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:43.821878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5dd4b-60bd-4a72-bd76-af3a5496f4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:43.822352 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5dd4b-60bd-4a72-bd76-af3a5496f4d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:43.834621 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ac37c-982d-4159-9581-d3ea750088f7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:43.838401 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5dd4b-60bd-4a72-bd76-af3a5496f4d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:43.846634 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-4fd5dd4b-60bd-4a72-bd76-af3a5496f4d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 16:36:43.856198 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 73/146] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:36:43.857447 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e120f-3cf6-40b9-8517-da973ca89dac None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:43.857743 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e120f-3cf6-40b9-8517-da973ca89dac None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:43.858024 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e120f-3cf6-40b9-8517-da973ca89dac None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:43.859485 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 74/147] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:43.865416 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e120f-3cf6-40b9-8517-da973ca89dac None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:43.869716 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94004064-3b66-4c7b-917b-512a1749ae21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:43.870530 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94004064-3b66-4c7b-917b-512a1749ae21 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:43.870867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94004064-3b66-4c7b-917b-512a1749ae21 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:43.871144 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94004064-3b66-4c7b-917b-512a1749ae21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:43.883721 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94004064-3b66-4c7b-917b-512a1749ae21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:43.892326 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-94004064-3b66-4c7b-917b-512a1749ae21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:36:43.893937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 74/148] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:36:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:43.895027 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9249e-0919-4e26-b8f3-20062ee63721 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:43.895755 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9249e-0919-4e26-b8f3-20062ee63721 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:43.896050 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c9249e-0919-4e26-b8f3-20062ee63721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:43.920875 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-16c9249e-0919-4e26-b8f3-20062ee63721 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:43.922107 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-16c9249e-0919-4e26-b8f3-20062ee63721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:44.033985 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 75/149] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:44.034841 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9249e-0919-4e26-b8f3-20062ee63721 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:44.047296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e120f-3cf6-40b9-8517-da973ca89dac None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:44.094679 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462e55e-70d4-4e41-b32b-80f16332b23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:44.094679 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462e55e-70d4-4e41-b32b-80f16332b23b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:44.094679 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462e55e-70d4-4e41-b32b-80f16332b23b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:44.094679 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462e55e-70d4-4e41-b32b-80f16332b23b None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:44.095081 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462e55e-70d4-4e41-b32b-80f16332b23b None admin] RBAC: Adding query filter params (name=reader) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:44.095081 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462e55e-70d4-4e41-b32b-80f16332b23b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:44.095081 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462e55e-70d4-4e41-b32b-80f16332b23b None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:44.112898 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 75/150] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:36:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:44.114684 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e75cac-82db-4482-bfa9-a19fc992aa54 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:44.115183 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e75cac-82db-4482-bfa9-a19fc992aa54 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:44.115657 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e75cac-82db-4482-bfa9-a19fc992aa54 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:44.117135 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 76/151] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:44.118051 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e75cac-82db-4482-bfa9-a19fc992aa54 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:44.171450 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c9249e-0919-4e26-b8f3-20062ee63721 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:44.213373 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36e322-36af-4ed8-bf67-ddf67ceddade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:44.214618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36e322-36af-4ed8-bf67-ddf67ceddade None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:44.215113 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36e322-36af-4ed8-bf67-ddf67ceddade None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:44.215605 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36e322-36af-4ed8-bf67-ddf67ceddade None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:44.216550 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36e322-36af-4ed8-bf67-ddf67ceddade None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:44.217051 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36e322-36af-4ed8-bf67-ddf67ceddade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:44.219396 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36e322-36af-4ed8-bf67-ddf67ceddade None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:44.234992 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 76/152] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:44.236732 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36e322-36af-4ed8-bf67-ddf67ceddade None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:44.340034 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e75cac-82db-4482-bfa9-a19fc992aa54 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:44.422754 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0477523-9a44-487b-b682-82a833bd9e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:44.422754 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0477523-9a44-487b-b682-82a833bd9e57 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:44.422754 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0477523-9a44-487b-b682-82a833bd9e57 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:44.422754 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0477523-9a44-487b-b682-82a833bd9e57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:44.442766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0477523-9a44-487b-b682-82a833bd9e57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:44.445978 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-f0477523-9a44-487b-b682-82a833bd9e57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:36:44.447541 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 77/153] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:44.449030 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d5379-f302-4a9e-a487-ead676140c2b None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:44.449514 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d5379-f302-4a9e-a487-ead676140c2b None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:44.450000 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d5379-f302-4a9e-a487-ead676140c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:44.462943 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36e322-36af-4ed8-bf67-ddf67ceddade None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:44.484982 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-438d5379-f302-4a9e-a487-ead676140c2b None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:44.486285 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-438d5379-f302-4a9e-a487-ead676140c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:44.515717 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e0416-9396-4aa5-aba6-24bf8299951f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:44.517213 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e0416-9396-4aa5-aba6-24bf8299951f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:44.517666 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e0416-9396-4aa5-aba6-24bf8299951f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:44.518124 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e0416-9396-4aa5-aba6-24bf8299951f None admin] PATH_INFO: `/v3/users/c5b2f92348954b20a84e662fd5cbc3f2` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:44.519534 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e0416-9396-4aa5-aba6-24bf8299951f None admin] RBAC: Authorizing `identity:get_user(user_id=c5b2f92348954b20a84e662fd5cbc3f2)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:44.521154 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e0416-9396-4aa5-aba6-24bf8299951f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:44.523034 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 77/154] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:44 2022] GET /identity/v3/users/c5b2f92348954b20a84e662fd5cbc3f2 => generated 289 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:44.524010 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e0416-9396-4aa5-aba6-24bf8299951f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:44.601200 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 78/155] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:44.601705 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d5379-f302-4a9e-a487-ead676140c2b None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:44.729023 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d5379-f302-4a9e-a487-ead676140c2b None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:44.754199 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e0416-9396-4aa5-aba6-24bf8299951f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:44.772152 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c8dbb-c377-4a3d-95ba-21b80a724f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:44.772832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c8dbb-c377-4a3d-95ba-21b80a724f07 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:44.773115 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c8dbb-c377-4a3d-95ba-21b80a724f07 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:44.773386 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c8dbb-c377-4a3d-95ba-21b80a724f07 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:44.774132 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c8dbb-c377-4a3d-95ba-21b80a724f07 None admin] RBAC: Adding query filter params (name=member) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:44.774436 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c8dbb-c377-4a3d-95ba-21b80a724f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:44.775838 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c8dbb-c377-4a3d-95ba-21b80a724f07 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:44.794329 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 79/156] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:36:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:44.795617 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c8dbb-c377-4a3d-95ba-21b80a724f07 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:44.843865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a68037-b9e3-4e5e-ab12-1cc652b23bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:44.844995 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a68037-b9e3-4e5e-ab12-1cc652b23bf2 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:44.845422 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a68037-b9e3-4e5e-ab12-1cc652b23bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:44.845839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a68037-b9e3-4e5e-ab12-1cc652b23bf2 None admin] PATH_INFO: `/v3/users/f89fba69f1e24fd6b5126bf48028fdd1` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:44.851354 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a68037-b9e3-4e5e-ab12-1cc652b23bf2 None admin] RBAC: Authorizing `identity:get_user(user_id=f89fba69f1e24fd6b5126bf48028fdd1)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:44.852967 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a68037-b9e3-4e5e-ab12-1cc652b23bf2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:44.854796 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 78/157] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:44 2022] GET /identity/v3/users/f89fba69f1e24fd6b5126bf48028fdd1 => generated 247 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:44.855846 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a68037-b9e3-4e5e-ab12-1cc652b23bf2 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:44.976597 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a68037-b9e3-4e5e-ab12-1cc652b23bf2 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:45.013386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933f0ca-0dfc-4908-b702-ddacf0c10110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:45.014438 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933f0ca-0dfc-4908-b702-ddacf0c10110 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:45.014895 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933f0ca-0dfc-4908-b702-ddacf0c10110 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:45.015597 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933f0ca-0dfc-4908-b702-ddacf0c10110 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:45.026165 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c8dbb-c377-4a3d-95ba-21b80a724f07 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:45.027166 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933f0ca-0dfc-4908-b702-ddacf0c10110 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:45.035855 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-f933f0ca-0dfc-4908-b702-ddacf0c10110 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:36:45.037674 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 79/158] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:36:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:45.038616 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933f0ca-0dfc-4908-b702-ddacf0c10110 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:45.107486 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8f53a-7185-41f9-9290-b8b0aad87278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:45.108273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8f53a-7185-41f9-9290-b8b0aad87278 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:45.108551 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8f53a-7185-41f9-9290-b8b0aad87278 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:45.108870 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8f53a-7185-41f9-9290-b8b0aad87278 None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:45.110892 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8f53a-7185-41f9-9290-b8b0aad87278 None admin] RBAC: Authorizing `identity:get_project(project_id=83feba5a40fe4602b9b7b8109feffaf3)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:45.112362 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8f53a-7185-41f9-9290-b8b0aad87278 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:45.114804 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 80/159] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:44 2022] GET /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3 => generated 298 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:45.116117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad77bf8-dbd3-4a90-90a5-5e9d5c683c99 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:45.116397 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad77bf8-dbd3-4a90-90a5-5e9d5c683c99 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:45.116668 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad77bf8-dbd3-4a90-90a5-5e9d5c683c99 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:45.118059 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 81/160] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:45.118616 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad77bf8-dbd3-4a90-90a5-5e9d5c683c99 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:45.177005 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933f0ca-0dfc-4908-b702-ddacf0c10110 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:45.213460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93ac66-c49b-4656-a229-375e8824766d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:45.214395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93ac66-c49b-4656-a229-375e8824766d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:45.217649 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93ac66-c49b-4656-a229-375e8824766d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:45.217946 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb93ac66-c49b-4656-a229-375e8824766d None admin] PATH_INFO: `/v3/users/fe3cab871edd46f6ad5f0e3022f6c8c3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:45.220503 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93ac66-c49b-4656-a229-375e8824766d None admin] RBAC: Authorizing `identity:get_user(user_id=fe3cab871edd46f6ad5f0e3022f6c8c3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:45.222012 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb93ac66-c49b-4656-a229-375e8824766d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:45.223870 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 80/161] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:45 2022] GET /identity/v3/users/fe3cab871edd46f6ad5f0e3022f6c8c3 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:45.226218 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93ac66-c49b-4656-a229-375e8824766d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:45.342601 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad77bf8-dbd3-4a90-90a5-5e9d5c683c99 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:45.401241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb93ac66-c49b-4656-a229-375e8824766d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:45.423396 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12948f-2352-4a11-8486-896eaf77be44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:45.424064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12948f-2352-4a11-8486-896eaf77be44 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:45.424350 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12948f-2352-4a11-8486-896eaf77be44 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:45.424622 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12948f-2352-4a11-8486-896eaf77be44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:45.446508 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a516a73-127f-4cf5-89df-4ce0843f27d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:45.447236 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a516a73-127f-4cf5-89df-4ce0843f27d5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:45.447524 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a516a73-127f-4cf5-89df-4ce0843f27d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:45.447864 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a516a73-127f-4cf5-89df-4ce0843f27d5 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:45.448641 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a516a73-127f-4cf5-89df-4ce0843f27d5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:45.448989 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a516a73-127f-4cf5-89df-4ce0843f27d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:45.450484 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a516a73-127f-4cf5-89df-4ce0843f27d5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:45.464024 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 81/162] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:36:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:45.466108 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9a540-32a4-4fb9-8a34-72c90087c435 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:45.466404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9a540-32a4-4fb9-8a34-72c90087c435 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:45.469381 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9a540-32a4-4fb9-8a34-72c90087c435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:45.499967 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-35e9a540-32a4-4fb9-8a34-72c90087c435 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:45.500151 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12948f-2352-4a11-8486-896eaf77be44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:45.506609 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-35e9a540-32a4-4fb9-8a34-72c90087c435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:45.506814 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12948f-2352-4a11-8486-896eaf77be44 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:45.611267 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 82/163] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:36:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:45.612109 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12948f-2352-4a11-8486-896eaf77be44 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:45.624329 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 82/164] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:45.625192 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9a540-32a4-4fb9-8a34-72c90087c435 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:45.736302 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12948f-2352-4a11-8486-896eaf77be44 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:45.780723 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a112ee5-2241-457c-9464-8cbbc2b53c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:45.781613 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a112ee5-2241-457c-9464-8cbbc2b53c92 None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:45.781890 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a112ee5-2241-457c-9464-8cbbc2b53c92 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:45.782157 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a112ee5-2241-457c-9464-8cbbc2b53c92 None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3/users/c5b2f92348954b20a84e662fd5cbc3f2/roles/0c5e1f6e454b40159cc24d34e2c3fa9f` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:45.787880 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a112ee5-2241-457c-9464-8cbbc2b53c92 None admin] RBAC: Authorizing `identity:create_grant(project_id=83feba5a40fe4602b9b7b8109feffaf3, user_id=c5b2f92348954b20a84e662fd5cbc3f2, role_id=0c5e1f6e454b40159cc24d34e2c3fa9f)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:45.788497 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9a540-32a4-4fb9-8a34-72c90087c435 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:45.789330 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a112ee5-2241-457c-9464-8cbbc2b53c92 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:45.812933 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 83/165] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:36:45 2022] PUT /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3/users/c5b2f92348954b20a84e662fd5cbc3f2/roles/0c5e1f6e454b40159cc24d34e2c3fa9f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:36:45.813559 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a112ee5-2241-457c-9464-8cbbc2b53c92 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:45.834633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d77d70-1e47-4672-b8a5-d95a562c5397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:45.835500 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d77d70-1e47-4672-b8a5-d95a562c5397 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:45.835800 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d77d70-1e47-4672-b8a5-d95a562c5397 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:45.836065 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d77d70-1e47-4672-b8a5-d95a562c5397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:45.952365 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d77d70-1e47-4672-b8a5-d95a562c5397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:45.953886 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d77d70-1e47-4672-b8a5-d95a562c5397 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:46.004406 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a112ee5-2241-457c-9464-8cbbc2b53c92 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:46.068111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84744e67-31b6-4d5e-8abd-cba1000235cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:46.069010 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84744e67-31b6-4d5e-8abd-cba1000235cb None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:46.069289 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84744e67-31b6-4d5e-8abd-cba1000235cb None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:46.069560 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84744e67-31b6-4d5e-8abd-cba1000235cb None admin] PATH_INFO: `/v3/users/fe3cab871edd46f6ad5f0e3022f6c8c3` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:46.075613 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84744e67-31b6-4d5e-8abd-cba1000235cb None admin] RBAC: Authorizing `identity:get_user(user_id=fe3cab871edd46f6ad5f0e3022f6c8c3)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:46.077160 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84744e67-31b6-4d5e-8abd-cba1000235cb None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:46.078982 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 84/166] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:45 2022] GET /identity/v3/users/fe3cab871edd46f6ad5f0e3022f6c8c3 => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:46.079782 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84744e67-31b6-4d5e-8abd-cba1000235cb None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:46.193238 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84744e67-31b6-4d5e-8abd-cba1000235cb None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:46.207315 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 83/167] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:36:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:46.208504 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d77d70-1e47-4672-b8a5-d95a562c5397 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:46.236680 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e67f8c-1f19-4591-afc7-13e6b8100251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:46.237547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e67f8c-1f19-4591-afc7-13e6b8100251 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:46.237825 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e67f8c-1f19-4591-afc7-13e6b8100251 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:46.238098 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e67f8c-1f19-4591-afc7-13e6b8100251 None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:46.239410 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e67f8c-1f19-4591-afc7-13e6b8100251 None admin] RBAC: Authorizing `identity:get_project(project_id=83feba5a40fe4602b9b7b8109feffaf3)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:46.240877 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e67f8c-1f19-4591-afc7-13e6b8100251 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:46.242605 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 85/168] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:46 2022] GET /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:46.243370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e67f8c-1f19-4591-afc7-13e6b8100251 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:46.395919 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d77d70-1e47-4672-b8a5-d95a562c5397 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:46.451614 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be655e-c08b-4b38-8933-79e5ab8878b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:46.452469 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be655e-c08b-4b38-8933-79e5ab8878b8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:46.452915 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be655e-c08b-4b38-8933-79e5ab8878b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:46.453242 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e67f8c-1f19-4591-afc7-13e6b8100251 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:46.453816 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be655e-c08b-4b38-8933-79e5ab8878b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:46.475676 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61be655e-c08b-4b38-8933-79e5ab8878b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:46.487691 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-61be655e-c08b-4b38-8933-79e5ab8878b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:36:46.489159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 84/169] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:46.490162 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be655e-c08b-4b38-8933-79e5ab8878b8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:46.523837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a08b34-425e-4045-9a0d-eb74495e01c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:46.524831 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a08b34-425e-4045-9a0d-eb74495e01c2 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:46.525313 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a08b34-425e-4045-9a0d-eb74495e01c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:46.525779 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a08b34-425e-4045-9a0d-eb74495e01c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:46.616370 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61be655e-c08b-4b38-8933-79e5ab8878b8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:46.655279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd2a79-3672-4439-af7b-6a9dda730954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:46.656853 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a08b34-425e-4045-9a0d-eb74495e01c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:46.658448 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd2a79-3672-4439-af7b-6a9dda730954 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:46.658788 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd2a79-3672-4439-af7b-6a9dda730954 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:46.659070 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd2a79-3672-4439-af7b-6a9dda730954 None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:46.659835 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a08b34-425e-4045-9a0d-eb74495e01c2 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:46.662541 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd2a79-3672-4439-af7b-6a9dda730954 None admin] RBAC: Authorizing `identity:get_project(project_id=83feba5a40fe4602b9b7b8109feffaf3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:46.664057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd2a79-3672-4439-af7b-6a9dda730954 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:46.666056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 85/170] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:46 2022] GET /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:46.668470 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd2a79-3672-4439-af7b-6a9dda730954 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:46.802615 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd2a79-3672-4439-af7b-6a9dda730954 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:46.822613 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 86/171] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:36:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:46.823585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a08b34-425e-4045-9a0d-eb74495e01c2 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:46.841335 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f052f-9ad7-4a28-930d-b3fa08e8357e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:46.841999 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f052f-9ad7-4a28-930d-b3fa08e8357e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:46.842273 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f052f-9ad7-4a28-930d-b3fa08e8357e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:46.842542 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f052f-9ad7-4a28-930d-b3fa08e8357e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:46.843409 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f052f-9ad7-4a28-930d-b3fa08e8357e None admin] RBAC: Adding query filter params (role.id=13de1ce875d44fcc988cc31b3a0639be, scope.project.id=83feba5a40fe4602b9b7b8109feffaf3, user.id=f89fba69f1e24fd6b5126bf48028fdd1) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:46.843715 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f052f-9ad7-4a28-930d-b3fa08e8357e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:46.845147 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f052f-9ad7-4a28-930d-b3fa08e8357e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:46.859618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 86/172] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:36:46 2022] GET /identity/v3/role_assignments?user.id=f89fba69f1e24fd6b5126bf48028fdd1&scope.project.id=83feba5a40fe4602b9b7b8109feffaf3&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:46.860282 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f052f-9ad7-4a28-930d-b3fa08e8357e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:46.953239 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a08b34-425e-4045-9a0d-eb74495e01c2 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:46.992545 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b0061c-145f-4ef6-8f9c-c350e4e040de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:46.993643 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0061c-145f-4ef6-8f9c-c350e4e040de None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:46.994122 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0061c-145f-4ef6-8f9c-c350e4e040de None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:46.999139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b0061c-145f-4ef6-8f9c-c350e4e040de None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:46.999939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0061c-145f-4ef6-8f9c-c350e4e040de None admin] RBAC: Adding query filter params (name=member) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:47.000254 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0061c-145f-4ef6-8f9c-c350e4e040de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:47.001703 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b0061c-145f-4ef6-8f9c-c350e4e040de None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:47.015776 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 87/173] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:36:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:47.017475 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5aab4-4f48-4f3b-84df-ad4c3fdce7de None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:47.017761 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5aab4-4f48-4f3b-84df-ad4c3fdce7de None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:47.018032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5aab4-4f48-4f3b-84df-ad4c3fdce7de None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:47.019583 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 88/174] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:47.020295 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5aab4-4f48-4f3b-84df-ad4c3fdce7de None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:47.063336 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f052f-9ad7-4a28-930d-b3fa08e8357e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:47.099580 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b247ea-a55f-498b-942c-c2589ad5386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:47.100248 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b247ea-a55f-498b-942c-c2589ad5386a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:47.100529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b247ea-a55f-498b-942c-c2589ad5386a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:47.100806 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b247ea-a55f-498b-942c-c2589ad5386a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:47.101645 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b247ea-a55f-498b-942c-c2589ad5386a None admin] RBAC: Adding query filter params (role.id=7695974856564d4289ab64dbf6dcc119, scope.project.id=83feba5a40fe4602b9b7b8109feffaf3, user.id=fe3cab871edd46f6ad5f0e3022f6c8c3) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:47.101958 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b247ea-a55f-498b-942c-c2589ad5386a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:47.103457 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b247ea-a55f-498b-942c-c2589ad5386a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:47.110462 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 87/175] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:36:46 2022] GET /identity/v3/role_assignments?user.id=fe3cab871edd46f6ad5f0e3022f6c8c3&scope.project.id=83feba5a40fe4602b9b7b8109feffaf3&role.id=7695974856564d4289ab64dbf6dcc119 => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:47.111881 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4625eff-4a2d-442b-831b-8636c438c3d0 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:47.112173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4625eff-4a2d-442b-831b-8636c438c3d0 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:47.112452 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4625eff-4a2d-442b-831b-8636c438c3d0 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:47.113906 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 88/176] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:47.119345 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53056bdb-45d3-4a45-8948-35763b3f41f6 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:47.119682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53056bdb-45d3-4a45-8948-35763b3f41f6 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:47.119907 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53056bdb-45d3-4a45-8948-35763b3f41f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:47.139005 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-53056bdb-45d3-4a45-8948-35763b3f41f6 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:47.140233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-53056bdb-45d3-4a45-8948-35763b3f41f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:47.220264 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5aab4-4f48-4f3b-84df-ad4c3fdce7de None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:47.220902 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 89/177] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:47.221953 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53056bdb-45d3-4a45-8948-35763b3f41f6 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:47.263996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902f99b-3970-48e5-b6a4-a502e5ad815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:47.265233 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f99b-3970-48e5-b6a4-a502e5ad815b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:47.265233 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f99b-3970-48e5-b6a4-a502e5ad815b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:47.265505 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902f99b-3970-48e5-b6a4-a502e5ad815b None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:47.267712 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902f99b-3970-48e5-b6a4-a502e5ad815b None admin] RBAC: Authorizing `identity:get_project(project_id=83feba5a40fe4602b9b7b8109feffaf3)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:47.269243 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902f99b-3970-48e5-b6a4-a502e5ad815b None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:47.271862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 89/178] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:47 2022] GET /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:47.273607 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973fb93-f92b-4a54-be52-bcf5f43375f4 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:47.273899 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973fb93-f92b-4a54-be52-bcf5f43375f4 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:47.274179 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973fb93-f92b-4a54-be52-bcf5f43375f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:47.305265 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-f973fb93-f92b-4a54-be52-bcf5f43375f4 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:47.306477 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f973fb93-f92b-4a54-be52-bcf5f43375f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:47.356691 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53056bdb-45d3-4a45-8948-35763b3f41f6 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:47.395771 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 90/179] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:47.396749 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca6063-1546-4d3d-a02a-15c89255249c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:47.399471 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca6063-1546-4d3d-a02a-15c89255249c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:47.399471 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca6063-1546-4d3d-a02a-15c89255249c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:47.399471 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca6063-1546-4d3d-a02a-15c89255249c None admin] PATH_INFO: `/v3/users/fe3cab871edd46f6ad5f0e3022f6c8c3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:47.399471 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca6063-1546-4d3d-a02a-15c89255249c None admin] RBAC: Authorizing `identity:get_user(user_id=fe3cab871edd46f6ad5f0e3022f6c8c3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:47.399971 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4e6c9-b34d-4fb7-b59c-e7349fccedf3 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:47.400450 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4e6c9-b34d-4fb7-b59c-e7349fccedf3 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:47.400810 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ca6063-1546-4d3d-a02a-15c89255249c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:47.401150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4e6c9-b34d-4fb7-b59c-e7349fccedf3 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:47.403078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 90/180] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:47 2022] GET /identity/v3/users/fe3cab871edd46f6ad5f0e3022f6c8c3 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:47.403562 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 91/181] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:47.403837 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca6063-1546-4d3d-a02a-15c89255249c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:47.404665 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4e6c9-b34d-4fb7-b59c-e7349fccedf3 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:47.523012 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca6063-1546-4d3d-a02a-15c89255249c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:47.531721 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4e6c9-b34d-4fb7-b59c-e7349fccedf3 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:47.556263 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251deabd-33b6-4c1c-a2b2-5ebc97bd1eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:47.557049 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251deabd-33b6-4c1c-a2b2-5ebc97bd1eab None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:47.557330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251deabd-33b6-4c1c-a2b2-5ebc97bd1eab None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:47.557613 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251deabd-33b6-4c1c-a2b2-5ebc97bd1eab None admin] PATH_INFO: `/v3/domains/default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:47.558817 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251deabd-33b6-4c1c-a2b2-5ebc97bd1eab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:47.560249 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251deabd-33b6-4c1c-a2b2-5ebc97bd1eab None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:47.561853 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 91/182] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:36:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:47.562637 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251deabd-33b6-4c1c-a2b2-5ebc97bd1eab None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:47.569082 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa842133-dbe4-4b82-91fa-3e4f815bfaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:47.569982 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa842133-dbe4-4b82-91fa-3e4f815bfaa8 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:47.570442 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa842133-dbe4-4b82-91fa-3e4f815bfaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:47.570767 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa842133-dbe4-4b82-91fa-3e4f815bfaa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:47.571597 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa842133-dbe4-4b82-91fa-3e4f815bfaa8 None admin] RBAC: Adding query filter params (role.id=807f93fb1a91497aba7762557ae039dd, scope.project.id=83feba5a40fe4602b9b7b8109feffaf3, user.id=fe3cab871edd46f6ad5f0e3022f6c8c3) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:47.571910 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa842133-dbe4-4b82-91fa-3e4f815bfaa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:47.573342 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa842133-dbe4-4b82-91fa-3e4f815bfaa8 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:47.586837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 92/183] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:36:47 2022] GET /identity/v3/role_assignments?user.id=fe3cab871edd46f6ad5f0e3022f6c8c3&scope.project.id=83feba5a40fe4602b9b7b8109feffaf3&role.id=807f93fb1a91497aba7762557ae039dd => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:47.586837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733bbdd-590c-4009-b558-78ad4a179bd5 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:47.586837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733bbdd-590c-4009-b558-78ad4a179bd5 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:47.586837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733bbdd-590c-4009-b558-78ad4a179bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:47.607606 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-e733bbdd-590c-4009-b558-78ad4a179bd5 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:47.608825 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-e733bbdd-590c-4009-b558-78ad4a179bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:47.684899 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 93/184] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:47.685871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733bbdd-590c-4009-b558-78ad4a179bd5 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:47.691184 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251deabd-33b6-4c1c-a2b2-5ebc97bd1eab None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:47.734987 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dc524-79eb-4351-aa8a-46ec89f5d15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:47.735957 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dc524-79eb-4351-aa8a-46ec89f5d15e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:47.736249 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dc524-79eb-4351-aa8a-46ec89f5d15e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:47.736530 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91dc524-79eb-4351-aa8a-46ec89f5d15e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:47.810379 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91dc524-79eb-4351-aa8a-46ec89f5d15e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:47.810676 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733bbdd-590c-4009-b558-78ad4a179bd5 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:47.811819 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91dc524-79eb-4351-aa8a-46ec89f5d15e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:47.858209 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2459c-62ab-4a9f-9898-69f5edd16b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:47.859343 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2459c-62ab-4a9f-9898-69f5edd16b7c None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:47.859621 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2459c-62ab-4a9f-9898-69f5edd16b7c None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:47.859901 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2459c-62ab-4a9f-9898-69f5edd16b7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:47.870272 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2459c-62ab-4a9f-9898-69f5edd16b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:47.877832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-dbf2459c-62ab-4a9f-9898-69f5edd16b7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:36:47.879109 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 94/185] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:36:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:47.879872 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2459c-62ab-4a9f-9898-69f5edd16b7c None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:47.933686 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 92/186] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:36:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:47.934860 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dc524-79eb-4351-aa8a-46ec89f5d15e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:47.993817 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2459c-62ab-4a9f-9898-69f5edd16b7c None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:48.026573 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b3474-8de5-4d3d-ae22-85c7f767cede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:48.027392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b3474-8de5-4d3d-ae22-85c7f767cede None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:48.027570 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b3474-8de5-4d3d-ae22-85c7f767cede None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:48.027812 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0b3474-8de5-4d3d-ae22-85c7f767cede None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:48.028507 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b3474-8de5-4d3d-ae22-85c7f767cede None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:48.029934 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0b3474-8de5-4d3d-ae22-85c7f767cede None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:48.030027 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91dc524-79eb-4351-aa8a-46ec89f5d15e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:48.049167 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 95/187] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Apr 11 16:36:47 2022] POST /identity/v3/users => generated 297 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:36:48.050307 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b3474-8de5-4d3d-ae22-85c7f767cede None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:48.080527 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fa6ad-f3ca-4318-8891-65ec4d7b36cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:48.081284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fa6ad-f3ca-4318-8891-65ec4d7b36cc None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:48.081975 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fa6ad-f3ca-4318-8891-65ec4d7b36cc None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:48.082253 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6fa6ad-f3ca-4318-8891-65ec4d7b36cc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:48.097404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6fa6ad-f3ca-4318-8891-65ec4d7b36cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:48.108957 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-1c6fa6ad-f3ca-4318-8891-65ec4d7b36cc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:36:48.111930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 93/188] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:36:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:48.111930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fa6ad-f3ca-4318-8891-65ec4d7b36cc None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:48.185152 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0b3474-8de5-4d3d-ae22-85c7f767cede None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:48.221841 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6fa6ad-f3ca-4318-8891-65ec4d7b36cc None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:48.229669 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e6652-8439-4c80-89bf-94ee2f47f6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:48.230985 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e6652-8439-4c80-89bf-94ee2f47f6ae None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:48.231267 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e6652-8439-4c80-89bf-94ee2f47f6ae None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:48.231542 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e6652-8439-4c80-89bf-94ee2f47f6ae None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:48.232354 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e6652-8439-4c80-89bf-94ee2f47f6ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:48.232661 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e6652-8439-4c80-89bf-94ee2f47f6ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:48.234698 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e6652-8439-4c80-89bf-94ee2f47f6ae None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:48.244183 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 96/189] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:48.246418 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e6652-8439-4c80-89bf-94ee2f47f6ae None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:48.264364 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34baed0-bec8-4d30-91af-740ce0c0e5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:48.265559 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34baed0-bec8-4d30-91af-740ce0c0e5a3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:48.266316 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34baed0-bec8-4d30-91af-740ce0c0e5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:48.266856 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34baed0-bec8-4d30-91af-740ce0c0e5a3 None admin] PATH_INFO: `/v3/projects/1088154a295c41f8b535fb2e1e88431c` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:48.268313 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34baed0-bec8-4d30-91af-740ce0c0e5a3 None admin] RBAC: Authorizing `identity:get_project(project_id=1088154a295c41f8b535fb2e1e88431c)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:48.269853 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34baed0-bec8-4d30-91af-740ce0c0e5a3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:48.271704 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 94/190] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:48 2022] GET /identity/v3/projects/1088154a295c41f8b535fb2e1e88431c => generated 312 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:48.272488 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34baed0-bec8-4d30-91af-740ce0c0e5a3 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:48.368478 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e6652-8439-4c80-89bf-94ee2f47f6ae None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:48.405167 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34baed0-bec8-4d30-91af-740ce0c0e5a3 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:48.412226 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b065a-a548-49ac-bda6-f17ac4de3fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:48.412902 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b065a-a548-49ac-bda6-f17ac4de3fb0 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:48.413179 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b065a-a548-49ac-bda6-f17ac4de3fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:48.413448 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65b065a-a548-49ac-bda6-f17ac4de3fb0 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:48.414193 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b065a-a548-49ac-bda6-f17ac4de3fb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:48.414498 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b065a-a548-49ac-bda6-f17ac4de3fb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:48.415975 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65b065a-a548-49ac-bda6-f17ac4de3fb0 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:48.427815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 97/191] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:36:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:48.428494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b065a-a548-49ac-bda6-f17ac4de3fb0 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:48.448214 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d95ac-7616-43ba-9d32-a5d739d767d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:48.449119 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d95ac-7616-43ba-9d32-a5d739d767d3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:48.449399 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d95ac-7616-43ba-9d32-a5d739d767d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:48.449669 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d95ac-7616-43ba-9d32-a5d739d767d3 None admin] PATH_INFO: `/v3/users/cf684e3d9e8e4ce2bd294d261fad9d44` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:48.463227 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d95ac-7616-43ba-9d32-a5d739d767d3 None admin] RBAC: Authorizing `identity:get_user(user_id=cf684e3d9e8e4ce2bd294d261fad9d44)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:48.465237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d95ac-7616-43ba-9d32-a5d739d767d3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:48.467245 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 95/192] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:48 2022] GET /identity/v3/users/cf684e3d9e8e4ce2bd294d261fad9d44 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:48.467861 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d95ac-7616-43ba-9d32-a5d739d767d3 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:48.529401 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65b065a-a548-49ac-bda6-f17ac4de3fb0 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:48.564244 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d4fbd-346f-4ff3-9861-81a4dbfaddd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:48.564964 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d4fbd-346f-4ff3-9861-81a4dbfaddd1 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:48.565175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d4fbd-346f-4ff3-9861-81a4dbfaddd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:48.565449 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d4fbd-346f-4ff3-9861-81a4dbfaddd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:48.566279 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d4fbd-346f-4ff3-9861-81a4dbfaddd1 None admin] RBAC: Adding query filter params (role.id=7695974856564d4289ab64dbf6dcc119, scope.project.id=1088154a295c41f8b535fb2e1e88431c, user.id=fe3cab871edd46f6ad5f0e3022f6c8c3) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:48.566599 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d4fbd-346f-4ff3-9861-81a4dbfaddd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:48.566894 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d95ac-7616-43ba-9d32-a5d739d767d3 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:48.568064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d4fbd-346f-4ff3-9861-81a4dbfaddd1 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:48.574169 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 98/193] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:36:48 2022] GET /identity/v3/role_assignments?user.id=fe3cab871edd46f6ad5f0e3022f6c8c3&scope.project.id=1088154a295c41f8b535fb2e1e88431c&role.id=7695974856564d4289ab64dbf6dcc119 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:48.575002 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d4fbd-346f-4ff3-9861-81a4dbfaddd1 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:48.623478 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f01411-c136-444e-adbe-95b67501ba6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:48.624287 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f01411-c136-444e-adbe-95b67501ba6f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:48.624566 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f01411-c136-444e-adbe-95b67501ba6f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:48.624839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f01411-c136-444e-adbe-95b67501ba6f None admin] PATH_INFO: `/v3/users/cf684e3d9e8e4ce2bd294d261fad9d44` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:48.626110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f01411-c136-444e-adbe-95b67501ba6f None admin] RBAC: Authorizing `identity:get_user(user_id=cf684e3d9e8e4ce2bd294d261fad9d44)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:48.627574 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f01411-c136-444e-adbe-95b67501ba6f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:48.629373 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 96/194] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:48 2022] GET /identity/v3/users/cf684e3d9e8e4ce2bd294d261fad9d44 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:48.635517 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f01411-c136-444e-adbe-95b67501ba6f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:48.680385 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d4fbd-346f-4ff3-9861-81a4dbfaddd1 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:48.715060 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdc2b5-e353-4945-84ff-308ede559f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:48.715717 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdc2b5-e353-4945-84ff-308ede559f96 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:48.715998 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdc2b5-e353-4945-84ff-308ede559f96 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:48.716273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdc2b5-e353-4945-84ff-308ede559f96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:48.777300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f01411-c136-444e-adbe-95b67501ba6f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:48.788304 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdc2b5-e353-4945-84ff-308ede559f96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:48.789818 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdc2b5-e353-4945-84ff-308ede559f96 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:48.821954 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266be2f-7482-4460-8fbd-fc089ef53302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:48.822775 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266be2f-7482-4460-8fbd-fc089ef53302 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:48.823066 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266be2f-7482-4460-8fbd-fc089ef53302 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:48.823347 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266be2f-7482-4460-8fbd-fc089ef53302 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:48.894683 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 99/195] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:36:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:48.896020 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e6f29-8bdd-498c-90a2-16c45c24c47a None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:48.896304 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e6f29-8bdd-498c-90a2-16c45c24c47a None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:48.896577 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804e6f29-8bdd-498c-90a2-16c45c24c47a None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:48.897912 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 100/196] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:48.903681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e6f29-8bdd-498c-90a2-16c45c24c47a None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:48.914309 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266be2f-7482-4460-8fbd-fc089ef53302 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:48.916233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266be2f-7482-4460-8fbd-fc089ef53302 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:49.020355 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804e6f29-8bdd-498c-90a2-16c45c24c47a None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:49.042993 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 97/197] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:36:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:49.045308 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d89f4-4e67-460a-8f66-5eac00f79ac5 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:49.045772 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d89f4-4e67-460a-8f66-5eac00f79ac5 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:49.046374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d89f4-4e67-460a-8f66-5eac00f79ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:49.058215 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69533c5b-9e75-4a2f-bd8c-c01681e013d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:49.059108 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69533c5b-9e75-4a2f-bd8c-c01681e013d9 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:49.059475 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69533c5b-9e75-4a2f-bd8c-c01681e013d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:49.059755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69533c5b-9e75-4a2f-bd8c-c01681e013d9 None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:49.061373 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69533c5b-9e75-4a2f-bd8c-c01681e013d9 None admin] RBAC: Authorizing `identity:get_project(project_id=e9fda6800be44b51ba84452d77f4ad81)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:49.062853 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69533c5b-9e75-4a2f-bd8c-c01681e013d9 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:49.064707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 101/198] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:48 2022] GET /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:49.065399 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69533c5b-9e75-4a2f-bd8c-c01681e013d9 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:49.072345 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a97d89f4-4e67-460a-8f66-5eac00f79ac5 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:49.074351 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a97d89f4-4e67-460a-8f66-5eac00f79ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:49.156617 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 98/199] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:49.158206 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d89f4-4e67-460a-8f66-5eac00f79ac5 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:49.174569 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69533c5b-9e75-4a2f-bd8c-c01681e013d9 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:49.219607 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b210b-538b-4e86-ab97-ddc3d3e80b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:49.220530 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b210b-538b-4e86-ab97-ddc3d3e80b33 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:49.220857 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b210b-538b-4e86-ab97-ddc3d3e80b33 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:49.221137 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b210b-538b-4e86-ab97-ddc3d3e80b33 None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:49.222691 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b210b-538b-4e86-ab97-ddc3d3e80b33 None admin] RBAC: Authorizing `identity:get_project(project_id=e9fda6800be44b51ba84452d77f4ad81)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:49.224585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b210b-538b-4e86-ab97-ddc3d3e80b33 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:49.227009 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 102/200] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:49 2022] GET /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:49.228041 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b210b-538b-4e86-ab97-ddc3d3e80b33 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:49.279537 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d89f4-4e67-460a-8f66-5eac00f79ac5 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:49.314205 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d2a86-3c32-402c-a62f-a5246076c5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:49.314892 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d2a86-3c32-402c-a62f-a5246076c5d1 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:49.315171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d2a86-3c32-402c-a62f-a5246076c5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:49.315446 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763d2a86-3c32-402c-a62f-a5246076c5d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:49.316337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d2a86-3c32-402c-a62f-a5246076c5d1 None admin] RBAC: Adding query filter params (role.id=13de1ce875d44fcc988cc31b3a0639be, scope.project.id=e9fda6800be44b51ba84452d77f4ad81, user.id=cf684e3d9e8e4ce2bd294d261fad9d44) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:49.316633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d2a86-3c32-402c-a62f-a5246076c5d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:49.318083 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763d2a86-3c32-402c-a62f-a5246076c5d1 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:49.323782 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 99/201] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:36:49 2022] GET /identity/v3/role_assignments?user.id=cf684e3d9e8e4ce2bd294d261fad9d44&scope.project.id=e9fda6800be44b51ba84452d77f4ad81&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:49.324574 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d2a86-3c32-402c-a62f-a5246076c5d1 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:49.341752 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b210b-538b-4e86-ab97-ddc3d3e80b33 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:49.387165 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b8fa7-0c3a-4ace-8ef1-21c883167489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:49.388727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b8fa7-0c3a-4ace-8ef1-21c883167489 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:49.389174 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b8fa7-0c3a-4ace-8ef1-21c883167489 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:49.389584 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b8fa7-0c3a-4ace-8ef1-21c883167489 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:49.407073 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b8fa7-0c3a-4ace-8ef1-21c883167489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:49.416470 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-122b8fa7-0c3a-4ace-8ef1-21c883167489 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 16:36:49.418531 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 103/202] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:49.426512 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b8fa7-0c3a-4ace-8ef1-21c883167489 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:49.449601 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763d2a86-3c32-402c-a62f-a5246076c5d1 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:49.502106 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cbcf8-cd1f-4961-9c48-c092562993e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:49.502811 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cbcf8-cd1f-4961-9c48-c092562993e1 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:49.503095 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cbcf8-cd1f-4961-9c48-c092562993e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:49.503369 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cbcf8-cd1f-4961-9c48-c092562993e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:49.504212 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cbcf8-cd1f-4961-9c48-c092562993e1 None admin] RBAC: Adding query filter params (role.id=807f93fb1a91497aba7762557ae039dd, scope.project.id=e9fda6800be44b51ba84452d77f4ad81, user.id=cf684e3d9e8e4ce2bd294d261fad9d44) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:49.504522 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cbcf8-cd1f-4961-9c48-c092562993e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:49.505972 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cbcf8-cd1f-4961-9c48-c092562993e1 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:49.512171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 100/203] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:36:49 2022] GET /identity/v3/role_assignments?user.id=cf684e3d9e8e4ce2bd294d261fad9d44&scope.project.id=e9fda6800be44b51ba84452d77f4ad81&role.id=807f93fb1a91497aba7762557ae039dd => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:49.585967 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b8fa7-0c3a-4ace-8ef1-21c883167489 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:49.624195 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984ae2f-1c1c-4e94-8458-824a8d3b5f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:49.624894 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984ae2f-1c1c-4e94-8458-824a8d3b5f1b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:49.625179 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984ae2f-1c1c-4e94-8458-824a8d3b5f1b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:49.625457 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984ae2f-1c1c-4e94-8458-824a8d3b5f1b None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:49.626244 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984ae2f-1c1c-4e94-8458-824a8d3b5f1b None admin] RBAC: Adding query filter params (name=reader) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:49.626558 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984ae2f-1c1c-4e94-8458-824a8d3b5f1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:49.628058 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9984ae2f-1c1c-4e94-8458-824a8d3b5f1b None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:49.638512 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 104/204] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:36:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:49.644810 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cbcf8-cd1f-4961-9c48-c092562993e1 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:49.748476 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cbcf8-cd1f-4961-9c48-c092562993e1 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:49.791014 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439de7e-441b-4a83-a16d-ecb198f2d8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:49.791956 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439de7e-441b-4a83-a16d-ecb198f2d8ea None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:49.792268 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439de7e-441b-4a83-a16d-ecb198f2d8ea None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:49.792547 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439de7e-441b-4a83-a16d-ecb198f2d8ea None admin] PATH_INFO: `/v3/users/c5b2f92348954b20a84e662fd5cbc3f2` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:49.793820 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439de7e-441b-4a83-a16d-ecb198f2d8ea None admin] RBAC: Authorizing `identity:get_user(user_id=c5b2f92348954b20a84e662fd5cbc3f2)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:49.795320 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439de7e-441b-4a83-a16d-ecb198f2d8ea None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:49.796974 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 101/205] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:49 2022] GET /identity/v3/users/c5b2f92348954b20a84e662fd5cbc3f2 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:49.802666 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984ae2f-1c1c-4e94-8458-824a8d3b5f1b None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:49.921068 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984ae2f-1c1c-4e94-8458-824a8d3b5f1b None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:49.955218 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94415008-fb8f-4619-8acc-51507cde52aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:49.955873 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94415008-fb8f-4619-8acc-51507cde52aa None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:49.956158 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94415008-fb8f-4619-8acc-51507cde52aa None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:49.956436 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94415008-fb8f-4619-8acc-51507cde52aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:50.025139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94415008-fb8f-4619-8acc-51507cde52aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:50.026522 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94415008-fb8f-4619-8acc-51507cde52aa None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:50.124837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 105/206] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:36:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:50.130547 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439de7e-441b-4a83-a16d-ecb198f2d8ea None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:50.258201 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439de7e-441b-4a83-a16d-ecb198f2d8ea None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:50.299544 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b687620-d01d-40fb-9473-1db544e85930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:50.300338 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b687620-d01d-40fb-9473-1db544e85930 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:50.300623 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b687620-d01d-40fb-9473-1db544e85930 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:50.300902 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b687620-d01d-40fb-9473-1db544e85930 None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:50.306535 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b687620-d01d-40fb-9473-1db544e85930 None admin] RBAC: Authorizing `identity:get_project(project_id=83feba5a40fe4602b9b7b8109feffaf3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:50.308166 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b687620-d01d-40fb-9473-1db544e85930 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:50.310067 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 102/207] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:50 2022] GET /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:50.315859 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94415008-fb8f-4619-8acc-51507cde52aa None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:50.429649 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94415008-fb8f-4619-8acc-51507cde52aa None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:50.463539 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e4ea1-d337-4ac3-8660-32469364d172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:50.464749 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e4ea1-d337-4ac3-8660-32469364d172 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:50.465038 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e4ea1-d337-4ac3-8660-32469364d172 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:50.465312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e4ea1-d337-4ac3-8660-32469364d172 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:50.466139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e4ea1-d337-4ac3-8660-32469364d172 None admin] RBAC: Adding query filter params (role.id=0c5e1f6e454b40159cc24d34e2c3fa9f, scope.project.id=83feba5a40fe4602b9b7b8109feffaf3, user.id=c5b2f92348954b20a84e662fd5cbc3f2) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:50.466446 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e4ea1-d337-4ac3-8660-32469364d172 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:50.467913 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9e4ea1-d337-4ac3-8660-32469364d172 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:50.473869 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 106/208] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:36:50 2022] GET /identity/v3/role_assignments?user.id=c5b2f92348954b20a84e662fd5cbc3f2&scope.project.id=83feba5a40fe4602b9b7b8109feffaf3&role.id=0c5e1f6e454b40159cc24d34e2c3fa9f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:51.005254 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a79be-3792-4a78-98df-9bb96797be81 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:51.005767 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a79be-3792-4a78-98df-9bb96797be81 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:51.005767 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a79be-3792-4a78-98df-9bb96797be81 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:51.007183 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 103/209] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:51.013406 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550f4e0-696a-4084-8324-dd69b71b3d95 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:51.013806 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550f4e0-696a-4084-8324-dd69b71b3d95 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:51.013992 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550f4e0-696a-4084-8324-dd69b71b3d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:51.032679 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-b550f4e0-696a-4084-8324-dd69b71b3d95 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:51.033864 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b550f4e0-696a-4084-8324-dd69b71b3d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:51.103532 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 107/210] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:51.131025 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a79be-3792-4a78-98df-9bb96797be81 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:51.242746 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91a79be-3792-4a78-98df-9bb96797be81 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:51.248061 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec6315-136c-44c6-b82f-4b7c24531ab6 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:51.248346 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec6315-136c-44c6-b82f-4b7c24531ab6 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:51.248621 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecec6315-136c-44c6-b82f-4b7c24531ab6 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:51.249982 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 108/211] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:36:51.254840 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27ba57-d5be-47bc-a663-596709613e64 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:51.255125 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27ba57-d5be-47bc-a663-596709613e64 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:51.255400 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27ba57-d5be-47bc-a663-596709613e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:51.275149 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-0c27ba57-d5be-47bc-a663-596709613e64 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:51.276664 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-0c27ba57-d5be-47bc-a663-596709613e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:51.278447 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8ee24-b715-4fe3-b100-07c3d27bd3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:51.279327 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8ee24-b715-4fe3-b100-07c3d27bd3bc None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:51.279612 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8ee24-b715-4fe3-b100-07c3d27bd3bc None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:51.279885 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8ee24-b715-4fe3-b100-07c3d27bd3bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:51.290030 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8ee24-b715-4fe3-b100-07c3d27bd3bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:51.297605 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-1fe8ee24-b715-4fe3-b100-07c3d27bd3bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:36:51.298906 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 104/212] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:51.304583 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8ee24-b715-4fe3-b100-07c3d27bd3bc None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:51.360537 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 109/213] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:36:51.386765 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27ba57-d5be-47bc-a663-596709613e64 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:51.422449 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8ee24-b715-4fe3-b100-07c3d27bd3bc None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:51.455715 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d57425-5404-480d-b15f-12cfc2617e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:51.456767 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d57425-5404-480d-b15f-12cfc2617e91 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:51.457244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d57425-5404-480d-b15f-12cfc2617e91 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:51.457756 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d57425-5404-480d-b15f-12cfc2617e91 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:51.458736 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d57425-5404-480d-b15f-12cfc2617e91 None admin] RBAC: Adding query filter params (name=member) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:51.459235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d57425-5404-480d-b15f-12cfc2617e91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:51.460840 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d57425-5404-480d-b15f-12cfc2617e91 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:51.474734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 105/214] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:36:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:51.475880 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d57425-5404-480d-b15f-12cfc2617e91 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:51.499968 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27ba57-d5be-47bc-a663-596709613e64 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:51.534256 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909f1f9-6ab7-40be-a146-e69db011abaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:51.535013 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909f1f9-6ab7-40be-a146-e69db011abaf None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:51.535407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909f1f9-6ab7-40be-a146-e69db011abaf None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:51.535690 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909f1f9-6ab7-40be-a146-e69db011abaf None admin] PATH_INFO: `/v3/domains/default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:51.536845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909f1f9-6ab7-40be-a146-e69db011abaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:51.538294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909f1f9-6ab7-40be-a146-e69db011abaf None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:51.544908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 110/215] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:36:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:51.546769 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909f1f9-6ab7-40be-a146-e69db011abaf None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:51.585228 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d57425-5404-480d-b15f-12cfc2617e91 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:51.619938 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345eed5b-cc99-4e41-bd81-6b9c101849a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:51.621250 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345eed5b-cc99-4e41-bd81-6b9c101849a2 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:51.621793 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345eed5b-cc99-4e41-bd81-6b9c101849a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:51.622260 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345eed5b-cc99-4e41-bd81-6b9c101849a2 None admin] PATH_INFO: `/v3/users/548f12efe8f247bcaa86bdce2eaea005` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:51.636286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345eed5b-cc99-4e41-bd81-6b9c101849a2 None admin] RBAC: Authorizing `identity:get_user(user_id=548f12efe8f247bcaa86bdce2eaea005)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:51.638079 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345eed5b-cc99-4e41-bd81-6b9c101849a2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:51.640068 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 106/216] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:51 2022] GET /identity/v3/users/548f12efe8f247bcaa86bdce2eaea005 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:51.645697 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909f1f9-6ab7-40be-a146-e69db011abaf None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:51.646112 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345eed5b-cc99-4e41-bd81-6b9c101849a2 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:51.680297 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29aa230-0075-4007-b7b8-5bbc3364e8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:51.680950 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29aa230-0075-4007-b7b8-5bbc3364e8ea None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:51.681231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29aa230-0075-4007-b7b8-5bbc3364e8ea None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:51.681504 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29aa230-0075-4007-b7b8-5bbc3364e8ea None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:51.682210 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29aa230-0075-4007-b7b8-5bbc3364e8ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:51.683886 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29aa230-0075-4007-b7b8-5bbc3364e8ea None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:51.714649 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 111/217] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Apr 11 16:36:51 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:36:51.764696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345eed5b-cc99-4e41-bd81-6b9c101849a2 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:51.809973 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e9a25-a30c-4410-88e5-07fdd6f39f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:51.811060 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e9a25-a30c-4410-88e5-07fdd6f39f80 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:51.811564 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e9a25-a30c-4410-88e5-07fdd6f39f80 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:51.812059 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e9a25-a30c-4410-88e5-07fdd6f39f80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:51.887255 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e9a25-a30c-4410-88e5-07fdd6f39f80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:51.889159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e9a25-a30c-4410-88e5-07fdd6f39f80 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:51.999300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 107/218] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:36:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:52.004512 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29aa230-0075-4007-b7b8-5bbc3364e8ea None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:52.105906 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29aa230-0075-4007-b7b8-5bbc3364e8ea None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:52.141543 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6718e0-ac36-42d5-b90e-69844d62fa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:52.142670 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6718e0-ac36-42d5-b90e-69844d62fa6f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:52.143094 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6718e0-ac36-42d5-b90e-69844d62fa6f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:52.143532 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6718e0-ac36-42d5-b90e-69844d62fa6f None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:52.144973 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6718e0-ac36-42d5-b90e-69844d62fa6f None admin] RBAC: Authorizing `identity:get_project(project_id=e9fda6800be44b51ba84452d77f4ad81)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:52.146657 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6718e0-ac36-42d5-b90e-69844d62fa6f None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:52.149567 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34526509-4440-482c-b429-75041dff76ea None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:52.150006 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 112/219] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:52 2022] GET /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:52.150537 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34526509-4440-482c-b429-75041dff76ea None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:52.151040 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34526509-4440-482c-b429-75041dff76ea None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:52.153183 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 108/220] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:36:52.157156 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6718e0-ac36-42d5-b90e-69844d62fa6f None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:52.158656 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9eb956-758b-4723-8bde-a0deeda732ac None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:52.159169 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9eb956-758b-4723-8bde-a0deeda732ac None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:52.159645 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9eb956-758b-4723-8bde-a0deeda732ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:52.185754 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-5a9eb956-758b-4723-8bde-a0deeda732ac None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:52.187351 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5a9eb956-758b-4723-8bde-a0deeda732ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:52.268345 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6718e0-ac36-42d5-b90e-69844d62fa6f None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:52.270182 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 109/221] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:52.303169 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b18c21-7e57-430e-a1cd-3a8e58cddc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:52.303830 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b18c21-7e57-430e-a1cd-3a8e58cddc81 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:52.304109 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b18c21-7e57-430e-a1cd-3a8e58cddc81 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:52.304383 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b18c21-7e57-430e-a1cd-3a8e58cddc81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:52.305192 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9eb956-758b-4723-8bde-a0deeda732ac None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:52.305297 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b18c21-7e57-430e-a1cd-3a8e58cddc81 None admin] RBAC: Adding query filter params (role.id=7695974856564d4289ab64dbf6dcc119, scope.project.id=e9fda6800be44b51ba84452d77f4ad81, user.id=548f12efe8f247bcaa86bdce2eaea005) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:52.305505 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b18c21-7e57-430e-a1cd-3a8e58cddc81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:52.306961 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b18c21-7e57-430e-a1cd-3a8e58cddc81 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:52.318622 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 113/222] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:36:52 2022] GET /identity/v3/role_assignments?user.id=548f12efe8f247bcaa86bdce2eaea005&scope.project.id=e9fda6800be44b51ba84452d77f4ad81&role.id=7695974856564d4289ab64dbf6dcc119 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:52.428501 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9eb956-758b-4723-8bde-a0deeda732ac None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:52.435920 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac9b09-1e67-4fe9-81e2-5019a4913000 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:52.436210 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac9b09-1e67-4fe9-81e2-5019a4913000 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:52.436475 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aac9b09-1e67-4fe9-81e2-5019a4913000 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:52.438063 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 114/223] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:52.452527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbddca-dbb3-4d6f-9e54-c3c7f7c9714f None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:52.452830 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbddca-dbb3-4d6f-9e54-c3c7f7c9714f None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:52.453079 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbddca-dbb3-4d6f-9e54-c3c7f7c9714f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:52.465298 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26562019-bed9-432e-bab9-ecd9a8197ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:52.466123 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26562019-bed9-432e-bab9-ecd9a8197ecb None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:52.466404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26562019-bed9-432e-bab9-ecd9a8197ecb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:52.466705 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26562019-bed9-432e-bab9-ecd9a8197ecb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:52.488065 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-88bbddca-dbb3-4d6f-9e54-c3c7f7c9714f None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:52.489532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26562019-bed9-432e-bab9-ecd9a8197ecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:52.495486 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-88bbddca-dbb3-4d6f-9e54-c3c7f7c9714f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:52.497133 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-26562019-bed9-432e-bab9-ecd9a8197ecb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:36:52.498697 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 110/224] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:36:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:52.504644 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26562019-bed9-432e-bab9-ecd9a8197ecb None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:52.600937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 115/225] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:52.621995 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26562019-bed9-432e-bab9-ecd9a8197ecb None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:52.630729 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbddca-dbb3-4d6f-9e54-c3c7f7c9714f None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:52.664824 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00942590-9d59-4157-8b17-8edd0243bf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:52.665836 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00942590-9d59-4157-8b17-8edd0243bf56 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:52.666316 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00942590-9d59-4157-8b17-8edd0243bf56 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:52.666815 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00942590-9d59-4157-8b17-8edd0243bf56 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:52.667810 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00942590-9d59-4157-8b17-8edd0243bf56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:52.668375 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00942590-9d59-4157-8b17-8edd0243bf56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:52.669940 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00942590-9d59-4157-8b17-8edd0243bf56 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:52.686634 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 111/226] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:36:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:52.696999 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00942590-9d59-4157-8b17-8edd0243bf56 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:52.775888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbddca-dbb3-4d6f-9e54-c3c7f7c9714f None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:52.822006 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f520428-aa3f-4dca-9aa4-53318388da0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:52.822838 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f520428-aa3f-4dca-9aa4-53318388da0b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:52.823119 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f520428-aa3f-4dca-9aa4-53318388da0b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:52.823926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f520428-aa3f-4dca-9aa4-53318388da0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:52.848424 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f520428-aa3f-4dca-9aa4-53318388da0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:52.863047 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-1f520428-aa3f-4dca-9aa4-53318388da0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:36:52.864311 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 116/227] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:36:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:36:52.888170 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f520428-aa3f-4dca-9aa4-53318388da0b None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:52.902867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00942590-9d59-4157-8b17-8edd0243bf56 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:52.951327 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac1b02-498d-4f65-af6b-7ac72734db64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:52.952226 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac1b02-498d-4f65-af6b-7ac72734db64 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:52.952501 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac1b02-498d-4f65-af6b-7ac72734db64 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:52.952782 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac1b02-498d-4f65-af6b-7ac72734db64 None admin] PATH_INFO: `/v3/users/cf684e3d9e8e4ce2bd294d261fad9d44` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:52.954023 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac1b02-498d-4f65-af6b-7ac72734db64 None admin] RBAC: Authorizing `identity:get_user(user_id=cf684e3d9e8e4ce2bd294d261fad9d44)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:52.955498 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac1b02-498d-4f65-af6b-7ac72734db64 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:52.957140 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 112/228] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:52 2022] GET /identity/v3/users/cf684e3d9e8e4ce2bd294d261fad9d44 => generated 283 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:52.962443 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac1b02-498d-4f65-af6b-7ac72734db64 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:53.057175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f520428-aa3f-4dca-9aa4-53318388da0b None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:53.075392 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac1b02-498d-4f65-af6b-7ac72734db64 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:53.110283 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62084c-b18c-446f-9972-badf665fdfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:53.111764 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62084c-b18c-446f-9972-badf665fdfe0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:53.112390 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62084c-b18c-446f-9972-badf665fdfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:53.112890 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62084c-b18c-446f-9972-badf665fdfe0 None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:53.114284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62084c-b18c-446f-9972-badf665fdfe0 None admin] RBAC: Authorizing `identity:get_project(project_id=e9fda6800be44b51ba84452d77f4ad81)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:53.116430 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62084c-b18c-446f-9972-badf665fdfe0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:53.118627 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 113/229] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:52 2022] GET /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:53.125156 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62084c-b18c-446f-9972-badf665fdfe0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:53.130357 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d92471-d32d-45c8-817f-7c1c699a5a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:53.131108 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d92471-d32d-45c8-817f-7c1c699a5a5e None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:53.131390 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d92471-d32d-45c8-817f-7c1c699a5a5e None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:53.131719 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d92471-d32d-45c8-817f-7c1c699a5a5e None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:53.132466 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d92471-d32d-45c8-817f-7c1c699a5a5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:53.132771 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d92471-d32d-45c8-817f-7c1c699a5a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:53.134163 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d92471-d32d-45c8-817f-7c1c699a5a5e None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:53.153842 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 117/230] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:53.160677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d92471-d32d-45c8-817f-7c1c699a5a5e None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:53.243397 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62084c-b18c-446f-9972-badf665fdfe0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:53.328793 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d92471-d32d-45c8-817f-7c1c699a5a5e None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:53.335799 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dea00-22a2-4f79-8796-756fb346abba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:53.336700 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dea00-22a2-4f79-8796-756fb346abba None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:53.336986 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dea00-22a2-4f79-8796-756fb346abba None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:53.337266 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1dea00-22a2-4f79-8796-756fb346abba None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81/users/cf684e3d9e8e4ce2bd294d261fad9d44/roles/807f93fb1a91497aba7762557ae039dd` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:53.344393 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dea00-22a2-4f79-8796-756fb346abba None admin] RBAC: Authorizing `identity:create_grant(project_id=e9fda6800be44b51ba84452d77f4ad81, user_id=cf684e3d9e8e4ce2bd294d261fad9d44, role_id=807f93fb1a91497aba7762557ae039dd)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:53.345839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1dea00-22a2-4f79-8796-756fb346abba None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:53.365484 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255ccc3-7c49-444c-ab9d-f99913eeae71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:53.366731 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255ccc3-7c49-444c-ab9d-f99913eeae71 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:53.367203 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255ccc3-7c49-444c-ab9d-f99913eeae71 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:53.367703 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255ccc3-7c49-444c-ab9d-f99913eeae71 None admin] PATH_INFO: `/v3/users/cf684e3d9e8e4ce2bd294d261fad9d44` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:53.369064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255ccc3-7c49-444c-ab9d-f99913eeae71 None admin] RBAC: Authorizing `identity:get_user(user_id=cf684e3d9e8e4ce2bd294d261fad9d44)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:53.369837 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 114/231] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:36:53 2022] PUT /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81/users/cf684e3d9e8e4ce2bd294d261fad9d44/roles/807f93fb1a91497aba7762557ae039dd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:36:53.378628 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255ccc3-7c49-444c-ab9d-f99913eeae71 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:53.381080 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 118/232] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:53 2022] GET /identity/v3/users/cf684e3d9e8e4ce2bd294d261fad9d44 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:53.387078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dea00-22a2-4f79-8796-756fb346abba None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:53.549283 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1dea00-22a2-4f79-8796-756fb346abba None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:53.584919 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b2eb7-8532-453d-bba4-d5c8072edb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:53.585781 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b2eb7-8532-453d-bba4-d5c8072edb73 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:53.586062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b2eb7-8532-453d-bba4-d5c8072edb73 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:53.586338 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b2eb7-8532-453d-bba4-d5c8072edb73 None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:53.587557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b2eb7-8532-453d-bba4-d5c8072edb73 None admin] RBAC: Authorizing `identity:get_project(project_id=e9fda6800be44b51ba84452d77f4ad81)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:53.589094 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b2eb7-8532-453d-bba4-d5c8072edb73 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:53.591177 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 115/233] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:53 2022] GET /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:53.597056 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255ccc3-7c49-444c-ab9d-f99913eeae71 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:53.709231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255ccc3-7c49-444c-ab9d-f99913eeae71 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:53.745450 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79e103-1ddb-4efe-8718-3b8e47774d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:53.746337 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79e103-1ddb-4efe-8718-3b8e47774d49 None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:53.746642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79e103-1ddb-4efe-8718-3b8e47774d49 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:53.746921 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79e103-1ddb-4efe-8718-3b8e47774d49 None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81/users/cf684e3d9e8e4ce2bd294d261fad9d44/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:53.748881 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79e103-1ddb-4efe-8718-3b8e47774d49 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9fda6800be44b51ba84452d77f4ad81, user_id=cf684e3d9e8e4ce2bd294d261fad9d44, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:53.750314 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c79e103-1ddb-4efe-8718-3b8e47774d49 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:53.772711 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 119/234] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:36:53 2022] PUT /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81/users/cf684e3d9e8e4ce2bd294d261fad9d44/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:36:54.676926 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a89d0-58fb-4417-bc7d-a4f1146034d9 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:54.677460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a89d0-58fb-4417-bc7d-a4f1146034d9 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:54.677460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830a89d0-58fb-4417-bc7d-a4f1146034d9 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:54.678874 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 116/235] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:54.685203 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c62f6-b1a2-4189-afc2-d46e090d38ff None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:54.686006 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c62f6-b1a2-4189-afc2-d46e090d38ff None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:54.686499 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c62f6-b1a2-4189-afc2-d46e090d38ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:54.706681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-618c62f6-b1a2-4189-afc2-d46e090d38ff None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:54.708286 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-618c62f6-b1a2-4189-afc2-d46e090d38ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:54.778705 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 120/236] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:54.821004 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a89d0-58fb-4417-bc7d-a4f1146034d9 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:54.824229 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856aa81-62fd-48bc-a16e-05a8d5b3d53d None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:54.824981 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856aa81-62fd-48bc-a16e-05a8d5b3d53d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:54.825473 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856aa81-62fd-48bc-a16e-05a8d5b3d53d None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:54.827966 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 121/237] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:54.836760 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a372b-08b2-42aa-9145-6fbbde4f6b95 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:54.837350 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a372b-08b2-42aa-9145-6fbbde4f6b95 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:54.837853 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819a372b-08b2-42aa-9145-6fbbde4f6b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:54.871280 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-819a372b-08b2-42aa-9145-6fbbde4f6b95 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:54.872471 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-819a372b-08b2-42aa-9145-6fbbde4f6b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:54.999914 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 122/238] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:55.001474 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8210f-9a03-40a0-ad2c-bf7b683d90b0 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:55.001906 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8210f-9a03-40a0-ad2c-bf7b683d90b0 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:55.002323 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8210f-9a03-40a0-ad2c-bf7b683d90b0 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:55.003770 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 123/239] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:55.008426 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830a89d0-58fb-4417-bc7d-a4f1146034d9 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:55.009755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420386c-c1b4-4794-ae59-b04f9306adfb None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:55.011647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420386c-c1b4-4794-ae59-b04f9306adfb None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:55.012072 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420386c-c1b4-4794-ae59-b04f9306adfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:55.043996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-5420386c-c1b4-4794-ae59-b04f9306adfb None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:55.045848 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-5420386c-c1b4-4794-ae59-b04f9306adfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:55.054815 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c5187-0f8d-48eb-9c5a-cb85bcb5f906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:55.056717 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c5187-0f8d-48eb-9c5a-cb85bcb5f906 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:55.058511 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c5187-0f8d-48eb-9c5a-cb85bcb5f906 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:55.059021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c5187-0f8d-48eb-9c5a-cb85bcb5f906 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:55.073032 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c5187-0f8d-48eb-9c5a-cb85bcb5f906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:55.085250 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-d42c5187-0f8d-48eb-9c5a-cb85bcb5f906 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 16:36:55.087104 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 117/240] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:55.089119 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c5187-0f8d-48eb-9c5a-cb85bcb5f906 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:55.132462 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 124/241] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:55.133778 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420386c-c1b4-4794-ae59-b04f9306adfb None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:55.219297 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c5187-0f8d-48eb-9c5a-cb85bcb5f906 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:55.250495 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420386c-c1b4-4794-ae59-b04f9306adfb None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:55.260481 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac987b-afd8-4cb4-af9d-a573ae811377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:55.261318 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac987b-afd8-4cb4-af9d-a573ae811377 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:55.261901 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac987b-afd8-4cb4-af9d-a573ae811377 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:55.262183 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac987b-afd8-4cb4-af9d-a573ae811377 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:55.263593 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac987b-afd8-4cb4-af9d-a573ae811377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:55.265065 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac987b-afd8-4cb4-af9d-a573ae811377 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:55.267700 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 118/242] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:36:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:55.268676 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac987b-afd8-4cb4-af9d-a573ae811377 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:55.293089 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7fdec-542c-4161-a183-56faf8a28552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:55.294078 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7fdec-542c-4161-a183-56faf8a28552 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:55.294555 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7fdec-542c-4161-a183-56faf8a28552 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:55.295089 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c7fdec-542c-4161-a183-56faf8a28552 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:55.296080 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7fdec-542c-4161-a183-56faf8a28552 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:55.296600 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7fdec-542c-4161-a183-56faf8a28552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:55.298225 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c7fdec-542c-4161-a183-56faf8a28552 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:55.306445 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 125/243] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:36:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:55.307464 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7fdec-542c-4161-a183-56faf8a28552 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:55.399418 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac987b-afd8-4cb4-af9d-a573ae811377 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:55.415100 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c7fdec-542c-4161-a183-56faf8a28552 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:55.438448 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b28487-0da5-4c59-95b3-b4692a4cc6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:55.439653 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b28487-0da5-4c59-95b3-b4692a4cc6c9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:55.440134 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b28487-0da5-4c59-95b3-b4692a4cc6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:55.440627 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b28487-0da5-4c59-95b3-b4692a4cc6c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:55.450981 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b28487-0da5-4c59-95b3-b4692a4cc6c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:55.454606 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42fb08-5a77-4db6-a650-ee8cfb705892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:55.455279 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42fb08-5a77-4db6-a650-ee8cfb705892 None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:55.455562 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42fb08-5a77-4db6-a650-ee8cfb705892 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:55.455838 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42fb08-5a77-4db6-a650-ee8cfb705892 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:55.456540 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42fb08-5a77-4db6-a650-ee8cfb705892 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:55.457972 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42fb08-5a77-4db6-a650-ee8cfb705892 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:55.459876 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-44b28487-0da5-4c59-95b3-b4692a4cc6c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:36:55.466691 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 119/244] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:55.467764 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b28487-0da5-4c59-95b3-b4692a4cc6c9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:55.482005 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 126/245] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Apr 11 16:36:55 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:36:55.486886 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42fb08-5a77-4db6-a650-ee8cfb705892 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:55.662569 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b28487-0da5-4c59-95b3-b4692a4cc6c9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:55.673049 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42fb08-5a77-4db6-a650-ee8cfb705892 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:55.719943 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf5f4b-955c-4035-99d0-d3f65eaed18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:55.721510 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf5f4b-955c-4035-99d0-d3f65eaed18e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:55.721999 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf5f4b-955c-4035-99d0-d3f65eaed18e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:55.722473 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf5f4b-955c-4035-99d0-d3f65eaed18e None admin] PATH_INFO: `/v3/users/e47927ee68da44ec82806b66a8397db4` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:55.731621 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6488af-3960-4100-ae78-f44575f83815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:55.732891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6488af-3960-4100-ae78-f44575f83815 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:55.733317 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6488af-3960-4100-ae78-f44575f83815 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:55.733775 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6488af-3960-4100-ae78-f44575f83815 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:55.734685 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6488af-3960-4100-ae78-f44575f83815 None admin] RBAC: Adding query filter params (name=member) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:55.735128 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6488af-3960-4100-ae78-f44575f83815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:55.736734 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6488af-3960-4100-ae78-f44575f83815 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:55.739498 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf5f4b-955c-4035-99d0-d3f65eaed18e None admin] RBAC: Authorizing `identity:get_user(user_id=e47927ee68da44ec82806b66a8397db4)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:55.741109 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf5f4b-955c-4035-99d0-d3f65eaed18e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:55.743327 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 120/246] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:55 2022] GET /identity/v3/users/e47927ee68da44ec82806b66a8397db4 => generated 297 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:55.747700 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 127/247] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:36:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:55.754144 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf5f4b-955c-4035-99d0-d3f65eaed18e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:55.754438 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6488af-3960-4100-ae78-f44575f83815 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:55.856943 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6488af-3960-4100-ae78-f44575f83815 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:55.858379 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf5f4b-955c-4035-99d0-d3f65eaed18e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:55.893150 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16db5b-5a73-4cfe-997a-8f53f75106cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:55.894264 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16db5b-5a73-4cfe-997a-8f53f75106cc None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:55.894774 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16db5b-5a73-4cfe-997a-8f53f75106cc None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:55.895265 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea16db5b-5a73-4cfe-997a-8f53f75106cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:55.897996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebc2c9-3438-4332-8f1a-d684cd41a983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:55.899088 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebc2c9-3438-4332-8f1a-d684cd41a983 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:55.899535 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebc2c9-3438-4332-8f1a-d684cd41a983 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:55.900028 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebc2c9-3438-4332-8f1a-d684cd41a983 None admin] PATH_INFO: `/v3/users/548f12efe8f247bcaa86bdce2eaea005` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:55.907455 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebc2c9-3438-4332-8f1a-d684cd41a983 None admin] RBAC: Authorizing `identity:get_user(user_id=548f12efe8f247bcaa86bdce2eaea005)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:55.909335 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebc2c9-3438-4332-8f1a-d684cd41a983 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:55.911459 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 128/248] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:55 2022] GET /identity/v3/users/548f12efe8f247bcaa86bdce2eaea005 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:55.921573 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebc2c9-3438-4332-8f1a-d684cd41a983 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:55.982701 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16db5b-5a73-4cfe-997a-8f53f75106cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:55.984246 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea16db5b-5a73-4cfe-997a-8f53f75106cc None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:56.054549 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebc2c9-3438-4332-8f1a-d684cd41a983 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:56.086168 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 121/249] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:36:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:56.091759 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16db5b-5a73-4cfe-997a-8f53f75106cc None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:56.092761 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca28361-371c-442b-8c28-fbfa28273b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:56.093628 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca28361-371c-442b-8c28-fbfa28273b56 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:56.093909 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca28361-371c-442b-8c28-fbfa28273b56 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:56.094178 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca28361-371c-442b-8c28-fbfa28273b56 None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:56.095391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca28361-371c-442b-8c28-fbfa28273b56 None admin] RBAC: Authorizing `identity:get_project(project_id=e9fda6800be44b51ba84452d77f4ad81)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:56.096824 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca28361-371c-442b-8c28-fbfa28273b56 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:56.098966 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 129/250] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:55 2022] GET /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:56.105160 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca28361-371c-442b-8c28-fbfa28273b56 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:56.214108 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea16db5b-5a73-4cfe-997a-8f53f75106cc None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:56.251274 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca28361-371c-442b-8c28-fbfa28273b56 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:56.272245 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb210702-ea89-48f3-8218-59cd6f0a1258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:56.273496 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb210702-ea89-48f3-8218-59cd6f0a1258 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:56.273982 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb210702-ea89-48f3-8218-59cd6f0a1258 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:56.274536 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb210702-ea89-48f3-8218-59cd6f0a1258 None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:56.277844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb210702-ea89-48f3-8218-59cd6f0a1258 None admin] RBAC: Authorizing `identity:get_project(project_id=e9fda6800be44b51ba84452d77f4ad81)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:56.279547 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb210702-ea89-48f3-8218-59cd6f0a1258 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:56.281486 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 122/251] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:56 2022] GET /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:56.288176 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb210702-ea89-48f3-8218-59cd6f0a1258 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:56.299276 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e810750-1c7a-464a-81c2-2f39e9d4dd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:56.300172 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e810750-1c7a-464a-81c2-2f39e9d4dd6e None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:56.300451 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e810750-1c7a-464a-81c2-2f39e9d4dd6e None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:56.300777 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e810750-1c7a-464a-81c2-2f39e9d4dd6e None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81/users/548f12efe8f247bcaa86bdce2eaea005/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:56.312124 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e810750-1c7a-464a-81c2-2f39e9d4dd6e None admin] RBAC: Authorizing `identity:create_grant(project_id=e9fda6800be44b51ba84452d77f4ad81, user_id=548f12efe8f247bcaa86bdce2eaea005, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:56.313776 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e810750-1c7a-464a-81c2-2f39e9d4dd6e None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:56.337407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 130/252] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:36:56 2022] PUT /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81/users/548f12efe8f247bcaa86bdce2eaea005/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:36:56.440941 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38604d80-1870-4791-abdb-4e882c1d81e2 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:56.441223 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38604d80-1870-4791-abdb-4e882c1d81e2 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:56.441659 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38604d80-1870-4791-abdb-4e882c1d81e2 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:56.443530 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 131/253] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:36:56.460097 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d9779-1758-4534-afa1-cec6aab09bc6 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:56.460604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb210702-ea89-48f3-8218-59cd6f0a1258 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:56.460832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d9779-1758-4534-afa1-cec6aab09bc6 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:56.461247 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9d9779-1758-4534-afa1-cec6aab09bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:56.492111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-ad9d9779-1758-4534-afa1-cec6aab09bc6 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:56.493569 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-ad9d9779-1758-4534-afa1-cec6aab09bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:56.522769 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37c252-bb67-4b12-bff1-06821149d90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:56.523362 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37c252-bb67-4b12-bff1-06821149d90c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:56.523641 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37c252-bb67-4b12-bff1-06821149d90c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:56.523917 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37c252-bb67-4b12-bff1-06821149d90c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:56.524945 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37c252-bb67-4b12-bff1-06821149d90c None admin] RBAC: Adding query filter params (role.id=0c5e1f6e454b40159cc24d34e2c3fa9f, scope.project.id=e9fda6800be44b51ba84452d77f4ad81, user.id=e47927ee68da44ec82806b66a8397db4) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:56.525133 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37c252-bb67-4b12-bff1-06821149d90c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:56.526737 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37c252-bb67-4b12-bff1-06821149d90c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:56.532994 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 123/254] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:36:56 2022] GET /identity/v3/role_assignments?user.id=e47927ee68da44ec82806b66a8397db4&scope.project.id=e9fda6800be44b51ba84452d77f4ad81&role.id=0c5e1f6e454b40159cc24d34e2c3fa9f => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:56.603928 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 132/255] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:36:56.643033 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37c252-bb67-4b12-bff1-06821149d90c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:56.775565 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37c252-bb67-4b12-bff1-06821149d90c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:56.814682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37a54e-0362-43c2-b147-e76ef70ca5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:56.815731 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37a54e-0362-43c2-b147-e76ef70ca5ea None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:56.816152 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37a54e-0362-43c2-b147-e76ef70ca5ea None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:56.816561 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37a54e-0362-43c2-b147-e76ef70ca5ea None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:56.827593 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37a54e-0362-43c2-b147-e76ef70ca5ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:56.835354 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-aa37a54e-0362-43c2-b147-e76ef70ca5ea None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:36:56.836744 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 124/256] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:36:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:56.843067 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d9779-1758-4534-afa1-cec6aab09bc6 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:56.863321 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1840090-0d6b-4527-996e-f369f33ed91e None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:56.863864 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1840090-0d6b-4527-996e-f369f33ed91e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:56.864144 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1840090-0d6b-4527-996e-f369f33ed91e None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:56.865645 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 125/257] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:36:56.871301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d547ec5-8895-4685-b04a-2f05689d23f0 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:56.871817 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d547ec5-8895-4685-b04a-2f05689d23f0 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:56.872310 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d547ec5-8895-4685-b04a-2f05689d23f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:56.892967 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-1d547ec5-8895-4685-b04a-2f05689d23f0 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:56.894487 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1d547ec5-8895-4685-b04a-2f05689d23f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:56.982944 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9d9779-1758-4534-afa1-cec6aab09bc6 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:57.016513 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e84c3-1516-4d7e-b921-ccfd8e51a16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:57.017412 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e84c3-1516-4d7e-b921-ccfd8e51a16c None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:57.017832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e84c3-1516-4d7e-b921-ccfd8e51a16c None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:57.018335 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e84c3-1516-4d7e-b921-ccfd8e51a16c None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:57.019251 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e84c3-1516-4d7e-b921-ccfd8e51a16c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:57.019793 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e84c3-1516-4d7e-b921-ccfd8e51a16c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:57.021307 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e84c3-1516-4d7e-b921-ccfd8e51a16c None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:57.025327 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 126/258] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:36:57.036948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 133/259] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:36:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:57.042627 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d547ec5-8895-4685-b04a-2f05689d23f0 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:57.069038 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e84c3-1516-4d7e-b921-ccfd8e51a16c None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:57.214559 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e84c3-1516-4d7e-b921-ccfd8e51a16c None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:57.238221 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d547ec5-8895-4685-b04a-2f05689d23f0 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:57.266237 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cc3cf-f248-400f-8b83-e90522a8560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:57.267068 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cc3cf-f248-400f-8b83-e90522a8560a None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:57.267363 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cc3cf-f248-400f-8b83-e90522a8560a None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:57.267619 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5cc3cf-f248-400f-8b83-e90522a8560a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:57.277998 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5cc3cf-f248-400f-8b83-e90522a8560a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:57.293726 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-1c5cc3cf-f248-400f-8b83-e90522a8560a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:36:57.294933 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 134/260] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:36:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:36:57.300661 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cc3cf-f248-400f-8b83-e90522a8560a None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:57.315870 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470cb9b-3102-4b1c-80ef-310d904ffd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:57.316759 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470cb9b-3102-4b1c-80ef-310d904ffd72 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:57.317205 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470cb9b-3102-4b1c-80ef-310d904ffd72 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:57.317625 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470cb9b-3102-4b1c-80ef-310d904ffd72 None admin] PATH_INFO: `/v3/users/cf684e3d9e8e4ce2bd294d261fad9d44` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:57.319004 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470cb9b-3102-4b1c-80ef-310d904ffd72 None admin] RBAC: Authorizing `identity:get_user(user_id=cf684e3d9e8e4ce2bd294d261fad9d44)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:57.320614 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470cb9b-3102-4b1c-80ef-310d904ffd72 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:57.322819 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 127/261] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:57 2022] GET /identity/v3/users/cf684e3d9e8e4ce2bd294d261fad9d44 => generated 283 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:57.327864 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470cb9b-3102-4b1c-80ef-310d904ffd72 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:57.401053 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5cc3cf-f248-400f-8b83-e90522a8560a None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:57.443703 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe15a4f-4ff3-4ace-aab4-2a74e6b581bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:57.444661 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe15a4f-4ff3-4ace-aab4-2a74e6b581bf None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:57.445085 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe15a4f-4ff3-4ace-aab4-2a74e6b581bf None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:57.445500 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe15a4f-4ff3-4ace-aab4-2a74e6b581bf None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:57.446392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe15a4f-4ff3-4ace-aab4-2a74e6b581bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:57.446875 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe15a4f-4ff3-4ace-aab4-2a74e6b581bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:57.448469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe15a4f-4ff3-4ace-aab4-2a74e6b581bf None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:57.457938 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 135/262] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:57.464364 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe15a4f-4ff3-4ace-aab4-2a74e6b581bf None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:57.519684 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470cb9b-3102-4b1c-80ef-310d904ffd72 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:57.563681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe15a4f-4ff3-4ace-aab4-2a74e6b581bf None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:57.598494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d69fc-1dc5-4b0e-a430-0218739008ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:57.599471 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497aeef-1cbe-4326-b8aa-1a16c45cd01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:57.600570 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d69fc-1dc5-4b0e-a430-0218739008ec None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:57.601406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497aeef-1cbe-4326-b8aa-1a16c45cd01d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:57.601878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d69fc-1dc5-4b0e-a430-0218739008ec None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:57.602360 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497aeef-1cbe-4326-b8aa-1a16c45cd01d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:57.602848 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d69fc-1dc5-4b0e-a430-0218739008ec None admin] PATH_INFO: `/v3/users/cf684e3d9e8e4ce2bd294d261fad9d44` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:57.603314 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497aeef-1cbe-4326-b8aa-1a16c45cd01d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:57.605853 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d69fc-1dc5-4b0e-a430-0218739008ec None admin] RBAC: Authorizing `identity:get_user(user_id=cf684e3d9e8e4ce2bd294d261fad9d44)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:57.607519 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d69fc-1dc5-4b0e-a430-0218739008ec None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:57.611403 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 136/263] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:36:57 2022] GET /identity/v3/users/cf684e3d9e8e4ce2bd294d261fad9d44 => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:57.622208 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d69fc-1dc5-4b0e-a430-0218739008ec None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:57.768579 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d69fc-1dc5-4b0e-a430-0218739008ec None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:57.803423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497aeef-1cbe-4326-b8aa-1a16c45cd01d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:57.805541 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497aeef-1cbe-4326-b8aa-1a16c45cd01d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:57.815393 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dac47d-d964-488c-93e8-1e0cc9d9c6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:57.815975 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dac47d-d964-488c-93e8-1e0cc9d9c6d7 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:57.816255 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dac47d-d964-488c-93e8-1e0cc9d9c6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:57.816528 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dac47d-d964-488c-93e8-1e0cc9d9c6d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:57.896929 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dac47d-d964-488c-93e8-1e0cc9d9c6d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:57.899135 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dac47d-d964-488c-93e8-1e0cc9d9c6d7 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:58.004170 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 137/264] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:36:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:36:58.012036 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dac47d-d964-488c-93e8-1e0cc9d9c6d7 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:58.063470 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 128/265] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:36:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 16:36:58.069774 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497aeef-1cbe-4326-b8aa-1a16c45cd01d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:58.175771 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497aeef-1cbe-4326-b8aa-1a16c45cd01d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:58.218519 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d7433-5d32-4d56-94a6-38cafd1fbda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:58.219414 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d7433-5d32-4d56-94a6-38cafd1fbda7 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:58.219697 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d7433-5d32-4d56-94a6-38cafd1fbda7 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:58.219974 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d7433-5d32-4d56-94a6-38cafd1fbda7 None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:58.223531 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d7433-5d32-4d56-94a6-38cafd1fbda7 None admin] RBAC: Authorizing `identity:get_project(project_id=e9fda6800be44b51ba84452d77f4ad81)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:58.224983 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d7433-5d32-4d56-94a6-38cafd1fbda7 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:58.226718 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 129/266] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:58 2022] GET /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:36:58.233324 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d7433-5d32-4d56-94a6-38cafd1fbda7 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:58.251030 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dac47d-d964-488c-93e8-1e0cc9d9c6d7 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:58.331362 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcab449-2123-4cab-bd5e-04a6efc111bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:58.332149 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcab449-2123-4cab-bd5e-04a6efc111bb None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:58.332428 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcab449-2123-4cab-bd5e-04a6efc111bb None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:58.332699 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcab449-2123-4cab-bd5e-04a6efc111bb None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:58.333906 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcab449-2123-4cab-bd5e-04a6efc111bb None admin] RBAC: Authorizing `identity:get_project(project_id=e9fda6800be44b51ba84452d77f4ad81)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:58.335460 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcab449-2123-4cab-bd5e-04a6efc111bb None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:58.337152 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 138/267] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:36:58 2022] GET /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81 => generated 302 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:58.342995 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcab449-2123-4cab-bd5e-04a6efc111bb None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:58.403288 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d7433-5d32-4d56-94a6-38cafd1fbda7 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:58.463533 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1cb98-8631-45fa-8de6-b985bc688b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:58.464243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1cb98-8631-45fa-8de6-b985bc688b6c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:58.464527 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1cb98-8631-45fa-8de6-b985bc688b6c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:58.464803 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1cb98-8631-45fa-8de6-b985bc688b6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:58.465657 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1cb98-8631-45fa-8de6-b985bc688b6c None admin] RBAC: Adding query filter params (role.id=807f93fb1a91497aba7762557ae039dd, scope.project.id=e9fda6800be44b51ba84452d77f4ad81, user.id=cf684e3d9e8e4ce2bd294d261fad9d44) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:58.465974 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1cb98-8631-45fa-8de6-b985bc688b6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:58.467492 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d1cb98-8631-45fa-8de6-b985bc688b6c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:58.476367 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 130/268] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:36:58 2022] GET /identity/v3/role_assignments?user.id=cf684e3d9e8e4ce2bd294d261fad9d44&scope.project.id=e9fda6800be44b51ba84452d77f4ad81&role.id=807f93fb1a91497aba7762557ae039dd => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:58.537725 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcab449-2123-4cab-bd5e-04a6efc111bb None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:58.587550 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b644ee5-abc2-4cfb-856a-b6b5d41d07af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:58.588132 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b644ee5-abc2-4cfb-856a-b6b5d41d07af None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:58.588443 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b644ee5-abc2-4cfb-856a-b6b5d41d07af None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:58.588711 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b644ee5-abc2-4cfb-856a-b6b5d41d07af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:58.589573 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b644ee5-abc2-4cfb-856a-b6b5d41d07af None admin] RBAC: Adding query filter params (role.id=13de1ce875d44fcc988cc31b3a0639be, scope.project.id=e9fda6800be44b51ba84452d77f4ad81, user.id=cf684e3d9e8e4ce2bd294d261fad9d44) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:36:58.589882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b644ee5-abc2-4cfb-856a-b6b5d41d07af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:58.591445 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b644ee5-abc2-4cfb-856a-b6b5d41d07af None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:58.599271 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 139/269] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:36:58 2022] GET /identity/v3/role_assignments?user.id=cf684e3d9e8e4ce2bd294d261fad9d44&scope.project.id=e9fda6800be44b51ba84452d77f4ad81&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:58.992915 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4adbe-23a0-4afe-8b6d-eea2173abe05 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:58.993410 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4adbe-23a0-4afe-8b6d-eea2173abe05 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:58.993484 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4adbe-23a0-4afe-8b6d-eea2173abe05 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:58.994939 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 131/270] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:59.000994 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05367fca-7508-4235-b4c3-346ed19c075e None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:59.001463 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05367fca-7508-4235-b4c3-346ed19c075e None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:59.001540 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05367fca-7508-4235-b4c3-346ed19c075e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:59.021647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-05367fca-7508-4235-b4c3-346ed19c075e None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:59.023213 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-05367fca-7508-4235-b4c3-346ed19c075e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:59.094685 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 140/271] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:59.122845 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4adbe-23a0-4afe-8b6d-eea2173abe05 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:59.228950 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4adbe-23a0-4afe-8b6d-eea2173abe05 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:59.271733 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd72e34-ca1a-4709-ae90-8714baaf4874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:59.272886 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd72e34-ca1a-4709-ae90-8714baaf4874 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:59.273391 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd72e34-ca1a-4709-ae90-8714baaf4874 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:59.273866 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd72e34-ca1a-4709-ae90-8714baaf4874 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:59.277463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd72e34-ca1a-4709-ae90-8714baaf4874 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:59.279201 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd72e34-ca1a-4709-ae90-8714baaf4874 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:59.282584 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 132/272] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:36:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:36:59.287464 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05367fca-7508-4235-b4c3-346ed19c075e None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:59.396566 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05367fca-7508-4235-b4c3-346ed19c075e None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:59.431967 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae20f2-fb2a-43d4-90e7-55150a03ce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:59.433011 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae20f2-fb2a-43d4-90e7-55150a03ce72 None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:59.433529 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae20f2-fb2a-43d4-90e7-55150a03ce72 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:59.434020 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae20f2-fb2a-43d4-90e7-55150a03ce72 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:59.434946 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae20f2-fb2a-43d4-90e7-55150a03ce72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:36:59.436732 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae20f2-fb2a-43d4-90e7-55150a03ce72 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:36:59.463291 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 141/273] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Apr 11 16:36:59 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:36:59.466830 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa7e2e-587a-4bb1-b7db-602e18953f23 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:59.467341 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa7e2e-587a-4bb1-b7db-602e18953f23 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:59.467837 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa7e2e-587a-4bb1-b7db-602e18953f23 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:59.469433 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 133/274] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:59.476636 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21346a64-c04b-48c8-9233-a2227b22ce75 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:59.477258 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21346a64-c04b-48c8-9233-a2227b22ce75 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:59.477786 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21346a64-c04b-48c8-9233-a2227b22ce75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:59.496613 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-21346a64-c04b-48c8-9233-a2227b22ce75 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:59.498155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-21346a64-c04b-48c8-9233-a2227b22ce75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:59.579234 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 142/275] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:59.604954 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa7e2e-587a-4bb1-b7db-602e18953f23 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:59.751525 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a73c2-c6f8-4995-9c69-4a8c3ca6f213 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:59.751873 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a73c2-c6f8-4995-9c69-4a8c3ca6f213 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:59.752044 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a73c2-c6f8-4995-9c69-4a8c3ca6f213 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:59.753641 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 143/276] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:36:59.758902 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c385a-6bc2-40fb-b558-edb843089db5 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:59.759187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c385a-6bc2-40fb-b558-edb843089db5 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:59.759461 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c385a-6bc2-40fb-b558-edb843089db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:59.838854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa7e2e-587a-4bb1-b7db-602e18953f23 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:36:59.879279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349951ed-4f64-46e3-9e2f-5bae5dfe5ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:36:59.880090 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349951ed-4f64-46e3-9e2f-5bae5dfe5ab9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:36:59.880376 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349951ed-4f64-46e3-9e2f-5bae5dfe5ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:36:59.880650 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349951ed-4f64-46e3-9e2f-5bae5dfe5ab9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:36:59.894774 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349951ed-4f64-46e3-9e2f-5bae5dfe5ab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:36:59.899872 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-dc4c385a-6bc2-40fb-b558-edb843089db5 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:36:59.904288 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-349951ed-4f64-46e3-9e2f-5bae5dfe5ab9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:36:59.906726 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-dc4c385a-6bc2-40fb-b558-edb843089db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:36:59.908324 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 134/277] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:36:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:36:59.909577 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349951ed-4f64-46e3-9e2f-5bae5dfe5ab9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:36:59.997881 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 144/278] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:36:59.999792 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ff065-02c1-4af2-8e19-e8e3330683fb None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:00.000102 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ff065-02c1-4af2-8e19-e8e3330683fb None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:00.000376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ff065-02c1-4af2-8e19-e8e3330683fb None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:00.002191 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 145/279] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:00.007254 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfafff-6f11-4cbf-9fae-f819f1d89a57 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:00.007538 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfafff-6f11-4cbf-9fae-f819f1d89a57 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:00.007813 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfafff-6f11-4cbf-9fae-f819f1d89a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:00.024908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-81cfafff-6f11-4cbf-9fae-f819f1d89a57 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:00.026300 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-81cfafff-6f11-4cbf-9fae-f819f1d89a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:00.029142 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349951ed-4f64-46e3-9e2f-5bae5dfe5ab9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:00.064050 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54665dbf-3a34-44a7-998e-b7e88ab7a480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:00.065171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54665dbf-3a34-44a7-998e-b7e88ab7a480 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:00.065646 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54665dbf-3a34-44a7-998e-b7e88ab7a480 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:00.066110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54665dbf-3a34-44a7-998e-b7e88ab7a480 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:00.067139 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54665dbf-3a34-44a7-998e-b7e88ab7a480 None admin] RBAC: Adding query filter params (name=member) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:00.067644 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54665dbf-3a34-44a7-998e-b7e88ab7a480 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:00.069262 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54665dbf-3a34-44a7-998e-b7e88ab7a480 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:00.078650 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 135/280] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:36:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:00.079758 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54665dbf-3a34-44a7-998e-b7e88ab7a480 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:00.092873 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 146/281] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:37:00.093746 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfafff-6f11-4cbf-9fae-f819f1d89a57 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:00.180084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54665dbf-3a34-44a7-998e-b7e88ab7a480 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:00.212747 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfafff-6f11-4cbf-9fae-f819f1d89a57 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:00.213942 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1c55a-9e74-4fd3-b38b-a1236c492a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:00.214980 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1c55a-9e74-4fd3-b38b-a1236c492a72 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:00.215473 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1c55a-9e74-4fd3-b38b-a1236c492a72 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:00.215951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1c55a-9e74-4fd3-b38b-a1236c492a72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:00.226407 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1c55a-9e74-4fd3-b38b-a1236c492a72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:00.234173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-34c1c55a-9e74-4fd3-b38b-a1236c492a72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:37:00.235674 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 136/282] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:00.236689 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1c55a-9e74-4fd3-b38b-a1236c492a72 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:00.246581 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f270a3-8538-4eb5-882b-e5b9d7f060ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:00.247468 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f270a3-8538-4eb5-882b-e5b9d7f060ec None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:00.247745 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f270a3-8538-4eb5-882b-e5b9d7f060ec None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:00.248012 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f270a3-8538-4eb5-882b-e5b9d7f060ec None admin] PATH_INFO: `/v3/users/817766343b6f4d76b7aaf3602af46694` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:00.261316 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f270a3-8538-4eb5-882b-e5b9d7f060ec None admin] RBAC: Authorizing `identity:get_user(user_id=817766343b6f4d76b7aaf3602af46694)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:00.262494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f270a3-8538-4eb5-882b-e5b9d7f060ec None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:00.264377 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 147/283] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:37:00 2022] GET /identity/v3/users/817766343b6f4d76b7aaf3602af46694 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:00.264921 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f270a3-8538-4eb5-882b-e5b9d7f060ec None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:00.342663 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1c55a-9e74-4fd3-b38b-a1236c492a72 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:00.364753 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f270a3-8538-4eb5-882b-e5b9d7f060ec None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:00.378036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5cb85-516f-4663-b575-6380994f2ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:00.379199 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5cb85-516f-4663-b575-6380994f2ad8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:00.379719 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5cb85-516f-4663-b575-6380994f2ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:00.380250 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5cb85-516f-4663-b575-6380994f2ad8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:00.390955 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf5cb85-516f-4663-b575-6380994f2ad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:00.398472 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-8bf5cb85-516f-4663-b575-6380994f2ad8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 16:37:00.399336 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93825689-ff3c-44ff-81cb-1d79232746c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:00.400000 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93825689-ff3c-44ff-81cb-1d79232746c2 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:00.400278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93825689-ff3c-44ff-81cb-1d79232746c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:00.400550 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93825689-ff3c-44ff-81cb-1d79232746c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:00.401171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 137/284] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:00.401301 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93825689-ff3c-44ff-81cb-1d79232746c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:00.401600 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93825689-ff3c-44ff-81cb-1d79232746c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:00.402482 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5cb85-516f-4663-b575-6380994f2ad8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:00.407047 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93825689-ff3c-44ff-81cb-1d79232746c2 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:00.417644 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 148/285] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:37:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:00.419420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93825689-ff3c-44ff-81cb-1d79232746c2 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:00.525298 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf5cb85-516f-4663-b575-6380994f2ad8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:00.540646 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93825689-ff3c-44ff-81cb-1d79232746c2 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:00.564314 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a46680-0ef7-497b-9cda-350e81285033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:00.564974 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a46680-0ef7-497b-9cda-350e81285033 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:00.565686 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a46680-0ef7-497b-9cda-350e81285033 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:00.565977 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a46680-0ef7-497b-9cda-350e81285033 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:00.566832 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a46680-0ef7-497b-9cda-350e81285033 None admin] RBAC: Adding query filter params (role.id=7695974856564d4289ab64dbf6dcc119, user.id=817766343b6f4d76b7aaf3602af46694, scope.system=all) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:00.567276 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a46680-0ef7-497b-9cda-350e81285033 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:00.569032 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a46680-0ef7-497b-9cda-350e81285033 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:00.576193 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 138/286] 10.222.0.73 () {56 vars in 1308 bytes} [Mon Apr 11 16:37:00 2022] GET /identity/v3/role_assignments?user.id=817766343b6f4d76b7aaf3602af46694&scope.system=all&role.id=7695974856564d4289ab64dbf6dcc119 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:00.577671 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a46680-0ef7-497b-9cda-350e81285033 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:00.582559 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dccdd-a9c8-4d84-8f24-19ae4353fb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:00.583658 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dccdd-a9c8-4d84-8f24-19ae4353fb1e None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:00.584162 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dccdd-a9c8-4d84-8f24-19ae4353fb1e None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:00.584633 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7dccdd-a9c8-4d84-8f24-19ae4353fb1e None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:00.585603 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dccdd-a9c8-4d84-8f24-19ae4353fb1e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:00.586118 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dccdd-a9c8-4d84-8f24-19ae4353fb1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:00.588407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7dccdd-a9c8-4d84-8f24-19ae4353fb1e None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:00.602942 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 149/287] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:37:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:00.611110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dccdd-a9c8-4d84-8f24-19ae4353fb1e None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:00.691839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a46680-0ef7-497b-9cda-350e81285033 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:00.712361 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7dccdd-a9c8-4d84-8f24-19ae4353fb1e None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:00.728423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5b7f5-3e59-43b5-b924-d5d5985b4406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:00.730277 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5b7f5-3e59-43b5-b924-d5d5985b4406 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:00.730779 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5b7f5-3e59-43b5-b924-d5d5985b4406 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:00.731249 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a5b7f5-3e59-43b5-b924-d5d5985b4406 None admin] PATH_INFO: `/v3/users/548f12efe8f247bcaa86bdce2eaea005` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:00.732641 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5b7f5-3e59-43b5-b924-d5d5985b4406 None admin] RBAC: Authorizing `identity:get_user(user_id=548f12efe8f247bcaa86bdce2eaea005)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:00.734294 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a5b7f5-3e59-43b5-b924-d5d5985b4406 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:00.736654 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 139/288] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:37:00 2022] GET /identity/v3/users/548f12efe8f247bcaa86bdce2eaea005 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:00.743689 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5b7f5-3e59-43b5-b924-d5d5985b4406 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:00.748000 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca42533-d03c-4fe0-af3b-9ff762ba3dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:00.748891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca42533-d03c-4fe0-af3b-9ff762ba3dc9 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:00.749171 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca42533-d03c-4fe0-af3b-9ff762ba3dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:00.749445 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca42533-d03c-4fe0-af3b-9ff762ba3dc9 None admin] PATH_INFO: `/v3/users/e47927ee68da44ec82806b66a8397db4` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:00.750725 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca42533-d03c-4fe0-af3b-9ff762ba3dc9 None admin] RBAC: Authorizing `identity:get_user(user_id=e47927ee68da44ec82806b66a8397db4)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:00.752919 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca42533-d03c-4fe0-af3b-9ff762ba3dc9 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:00.754175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 150/289] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:37:00 2022] GET /identity/v3/users/e47927ee68da44ec82806b66a8397db4 => generated 297 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:00.764236 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca42533-d03c-4fe0-af3b-9ff762ba3dc9 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:00.886790 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca42533-d03c-4fe0-af3b-9ff762ba3dc9 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:00.946983 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a5b7f5-3e59-43b5-b924-d5d5985b4406 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:00.952163 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4437337-436c-4db4-8549-98fde3e05f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:00.953035 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4437337-436c-4db4-8549-98fde3e05f7b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:00.953314 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4437337-436c-4db4-8549-98fde3e05f7b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:00.953585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4437337-436c-4db4-8549-98fde3e05f7b None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:00.955382 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4437337-436c-4db4-8549-98fde3e05f7b None admin] RBAC: Authorizing `identity:get_project(project_id=e9fda6800be44b51ba84452d77f4ad81)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:00.956834 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4437337-436c-4db4-8549-98fde3e05f7b None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:00.958882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 151/290] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:37:00 2022] GET /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:00.974193 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4437337-436c-4db4-8549-98fde3e05f7b None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:00.990705 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71452d88-0fb7-4919-818c-92ede7941b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:00.991354 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71452d88-0fb7-4919-818c-92ede7941b73 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:00.991636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71452d88-0fb7-4919-818c-92ede7941b73 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:00.991910 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71452d88-0fb7-4919-818c-92ede7941b73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:01.058915 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71452d88-0fb7-4919-818c-92ede7941b73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:01.060364 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71452d88-0fb7-4919-818c-92ede7941b73 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:01.159741 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 140/291] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:01.161616 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4437337-436c-4db4-8549-98fde3e05f7b None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:01.165216 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71452d88-0fb7-4919-818c-92ede7941b73 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:01.195259 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8feeb-e1e4-4dd0-ac0a-a1e9c862daef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:01.196156 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8feeb-e1e4-4dd0-ac0a-a1e9c862daef None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:01.196435 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8feeb-e1e4-4dd0-ac0a-a1e9c862daef None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:01.196709 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db8feeb-e1e4-4dd0-ac0a-a1e9c862daef None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81/users/e47927ee68da44ec82806b66a8397db4/roles/0c5e1f6e454b40159cc24d34e2c3fa9f` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:01.202813 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8feeb-e1e4-4dd0-ac0a-a1e9c862daef None admin] RBAC: Authorizing `identity:create_grant(project_id=e9fda6800be44b51ba84452d77f4ad81, user_id=e47927ee68da44ec82806b66a8397db4, role_id=0c5e1f6e454b40159cc24d34e2c3fa9f)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:01.204253 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db8feeb-e1e4-4dd0-ac0a-a1e9c862daef None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:01.229998 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 152/292] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:37:00 2022] PUT /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81/users/e47927ee68da44ec82806b66a8397db4/roles/0c5e1f6e454b40159cc24d34e2c3fa9f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:37:01.302548 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71452d88-0fb7-4919-818c-92ede7941b73 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:01.352744 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fc070-4a70-4db8-bfe7-0ef706696b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:01.353614 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fc070-4a70-4db8-bfe7-0ef706696b4d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:01.353901 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fc070-4a70-4db8-bfe7-0ef706696b4d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:01.354207 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fc070-4a70-4db8-bfe7-0ef706696b4d None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:01.355468 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fc070-4a70-4db8-bfe7-0ef706696b4d None admin] RBAC: Authorizing `identity:get_project(project_id=e9fda6800be44b51ba84452d77f4ad81)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:01.356908 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fc070-4a70-4db8-bfe7-0ef706696b4d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:01.358620 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 141/293] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:37:01 2022] GET /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:01.364603 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8feeb-e1e4-4dd0-ac0a-a1e9c862daef None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:01.471414 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db8feeb-e1e4-4dd0-ac0a-a1e9c862daef None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:01.505713 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6944e-2766-4f77-8340-5ec169857362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:01.506374 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6944e-2766-4f77-8340-5ec169857362 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:01.506678 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6944e-2766-4f77-8340-5ec169857362 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:01.506958 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6944e-2766-4f77-8340-5ec169857362 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:01.507797 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6944e-2766-4f77-8340-5ec169857362 None admin] RBAC: Adding query filter params (role.id=7695974856564d4289ab64dbf6dcc119, scope.project.id=e9fda6800be44b51ba84452d77f4ad81, user.id=548f12efe8f247bcaa86bdce2eaea005) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:01.508108 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6944e-2766-4f77-8340-5ec169857362 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:01.509553 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6944e-2766-4f77-8340-5ec169857362 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:01.517011 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 153/294] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:37:01 2022] GET /identity/v3/role_assignments?user.id=548f12efe8f247bcaa86bdce2eaea005&scope.project.id=e9fda6800be44b51ba84452d77f4ad81&role.id=7695974856564d4289ab64dbf6dcc119 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:02.213303 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bf067-dad2-48b2-93c5-1349d99b8f12 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:02.214531 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bf067-dad2-48b2-93c5-1349d99b8f12 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:02.214531 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bf067-dad2-48b2-93c5-1349d99b8f12 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:02.216067 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 142/295] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:02.221033 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5269d-79cc-49df-986b-ce2165fc9e14 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:02.221513 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5269d-79cc-49df-986b-ce2165fc9e14 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:02.221663 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5269d-79cc-49df-986b-ce2165fc9e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:02.239532 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-26b5269d-79cc-49df-986b-ce2165fc9e14 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:02.240704 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-26b5269d-79cc-49df-986b-ce2165fc9e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:02.308950 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 154/296] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:02.333680 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bf067-dad2-48b2-93c5-1349d99b8f12 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:02.432269 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a7cf7-2ec5-46e6-9d3c-ae4194e767b3 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:02.432896 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a7cf7-2ec5-46e6-9d3c-ae4194e767b3 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:02.433395 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a7cf7-2ec5-46e6-9d3c-ae4194e767b3 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:02.435015 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 155/297] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:37:02.437939 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bf067-dad2-48b2-93c5-1349d99b8f12 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:02.440423 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d17f6-2769-4748-a288-30601e1f6f63 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:02.440956 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d17f6-2769-4748-a288-30601e1f6f63 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:02.441439 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97d17f6-2769-4748-a288-30601e1f6f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:02.458479 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-d97d17f6-2769-4748-a288-30601e1f6f63 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:02.459650 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d97d17f6-2769-4748-a288-30601e1f6f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:02.474467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0d088-a030-45a0-a8d1-ce6d866e928c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:02.475237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0d088-a030-45a0-a8d1-ce6d866e928c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:02.475522 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0d088-a030-45a0-a8d1-ce6d866e928c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:02.475792 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0d088-a030-45a0-a8d1-ce6d866e928c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:02.486157 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0d088-a030-45a0-a8d1-ce6d866e928c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:02.493334 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-48a0d088-a030-45a0-a8d1-ce6d866e928c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 16:37:02.494940 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 143/298] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:02.503540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0d088-a030-45a0-a8d1-ce6d866e928c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:02.526645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 156/299] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:02.550430 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d17f6-2769-4748-a288-30601e1f6f63 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:02.623624 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0d088-a030-45a0-a8d1-ce6d866e928c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:02.651744 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97d17f6-2769-4748-a288-30601e1f6f63 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:02.667151 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3eb0e-18ec-4077-a601-a3119839ae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:02.668251 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3eb0e-18ec-4077-a601-a3119839ae5b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:02.668965 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3eb0e-18ec-4077-a601-a3119839ae5b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:02.669414 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3eb0e-18ec-4077-a601-a3119839ae5b None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:02.670321 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3eb0e-18ec-4077-a601-a3119839ae5b None admin] RBAC: Adding query filter params (name=reader) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:02.670844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3eb0e-18ec-4077-a601-a3119839ae5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:02.673111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3eb0e-18ec-4077-a601-a3119839ae5b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:02.684650 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 144/300] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:37:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:02.685585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3603112-42e8-432c-aa11-ec060cc60347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:02.686450 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3603112-42e8-432c-aa11-ec060cc60347 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:02.686837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3603112-42e8-432c-aa11-ec060cc60347 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:02.687179 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3603112-42e8-432c-aa11-ec060cc60347 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:02.688393 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3603112-42e8-432c-aa11-ec060cc60347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:02.689619 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3eb0e-18ec-4077-a601-a3119839ae5b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:02.690422 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3603112-42e8-432c-aa11-ec060cc60347 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:02.696723 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 157/301] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:02.697651 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3603112-42e8-432c-aa11-ec060cc60347 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:02.797766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3603112-42e8-432c-aa11-ec060cc60347 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:02.813648 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3eb0e-18ec-4077-a601-a3119839ae5b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:02.834907 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70eaa7-26ce-4707-84ed-9b8f04576dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:02.835896 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70eaa7-26ce-4707-84ed-9b8f04576dec None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:02.836353 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70eaa7-26ce-4707-84ed-9b8f04576dec None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:02.836605 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e70eaa7-26ce-4707-84ed-9b8f04576dec None admin] PATH_INFO: `/v3/groups` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:02.837376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70eaa7-26ce-4707-84ed-9b8f04576dec None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:02.838995 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e70eaa7-26ce-4707-84ed-9b8f04576dec None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:02.856939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 158/302] 10.222.0.73 () {60 vars in 1134 bytes} [Mon Apr 11 16:37:02 2022] POST /identity/v3/groups => generated 229 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:37:02.857205 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad625db-d200-41cf-8dee-7fa35446f14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:02.858352 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad625db-d200-41cf-8dee-7fa35446f14e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:02.858821 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad625db-d200-41cf-8dee-7fa35446f14e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:02.859248 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad625db-d200-41cf-8dee-7fa35446f14e None admin] PATH_INFO: `/v3/users/150c219550c245d7ad8f1b4f559cc446` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:02.881111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad625db-d200-41cf-8dee-7fa35446f14e None admin] RBAC: Authorizing `identity:get_user(user_id=150c219550c245d7ad8f1b4f559cc446)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:02.883031 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad625db-d200-41cf-8dee-7fa35446f14e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:02.885270 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 145/303] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:37:02 2022] GET /identity/v3/users/150c219550c245d7ad8f1b4f559cc446 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:02.891760 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70eaa7-26ce-4707-84ed-9b8f04576dec None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:03.014669 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e70eaa7-26ce-4707-84ed-9b8f04576dec None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:03.051713 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc8983-1807-4105-97b5-8b96b0f4e9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:03.052302 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc8983-1807-4105-97b5-8b96b0f4e9ed None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:03.052584 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc8983-1807-4105-97b5-8b96b0f4e9ed None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:03.052864 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc8983-1807-4105-97b5-8b96b0f4e9ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:03.053757 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc8983-1807-4105-97b5-8b96b0f4e9ed None admin] RBAC: Adding query filter params (role.id=0c5e1f6e454b40159cc24d34e2c3fa9f, user.id=150c219550c245d7ad8f1b4f559cc446, scope.system=all) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:03.054068 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc8983-1807-4105-97b5-8b96b0f4e9ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:03.055591 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc8983-1807-4105-97b5-8b96b0f4e9ed None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:03.061669 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 159/304] 10.222.0.73 () {56 vars in 1308 bytes} [Mon Apr 11 16:37:02 2022] GET /identity/v3/role_assignments?user.id=150c219550c245d7ad8f1b4f559cc446&scope.system=all&role.id=0c5e1f6e454b40159cc24d34e2c3fa9f => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:03.208884 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4eec0-9e30-4cdb-9dfe-bf8a734e757f None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:03.209225 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4eec0-9e30-4cdb-9dfe-bf8a734e757f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:03.209440 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4eec0-9e30-4cdb-9dfe-bf8a734e757f None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:03.211101 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 146/305] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:03.219371 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c5853-65aa-40d1-8148-641ba25b5e81 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:03.219695 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c5853-65aa-40d1-8148-641ba25b5e81 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:03.219926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c5853-65aa-40d1-8148-641ba25b5e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:03.238144 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-445c5853-65aa-40d1-8148-641ba25b5e81 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:03.239377 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-445c5853-65aa-40d1-8148-641ba25b5e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:03.306926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 160/306] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:03.329788 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4eec0-9e30-4cdb-9dfe-bf8a734e757f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:03.431871 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4eec0-9e30-4cdb-9dfe-bf8a734e757f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:03.466311 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b84aca-88d4-492e-81d0-268c905ee58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:03.467138 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b84aca-88d4-492e-81d0-268c905ee58f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:03.467482 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b84aca-88d4-492e-81d0-268c905ee58f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:03.467762 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b84aca-88d4-492e-81d0-268c905ee58f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:03.477927 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b84aca-88d4-492e-81d0-268c905ee58f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:03.485656 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-34b84aca-88d4-492e-81d0-268c905ee58f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:37:03.487068 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 147/307] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:03.492705 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c5853-65aa-40d1-8148-641ba25b5e81 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:03.594669 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c5853-65aa-40d1-8148-641ba25b5e81 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:03.632787 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb9f8d-4a10-4899-ae28-7ddb10e1001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:03.633794 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb9f8d-4a10-4899-ae28-7ddb10e1001f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:03.634272 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb9f8d-4a10-4899-ae28-7ddb10e1001f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:03.634794 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb9f8d-4a10-4899-ae28-7ddb10e1001f None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:03.635760 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb9f8d-4a10-4899-ae28-7ddb10e1001f None admin] RBAC: Adding query filter params (name=member) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:03.636272 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb9f8d-4a10-4899-ae28-7ddb10e1001f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:03.637823 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb9f8d-4a10-4899-ae28-7ddb10e1001f None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:03.646759 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 161/308] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:37:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:03.654646 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b84aca-88d4-492e-81d0-268c905ee58f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:03.754152 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b84aca-88d4-492e-81d0-268c905ee58f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:03.788433 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e60cc3-6464-4031-9f84-07182d9f78d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:03.789312 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e60cc3-6464-4031-9f84-07182d9f78d9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:03.789590 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e60cc3-6464-4031-9f84-07182d9f78d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:03.789860 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e60cc3-6464-4031-9f84-07182d9f78d9 None admin] PATH_INFO: `/v3/users/817766343b6f4d76b7aaf3602af46694` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:03.791167 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e60cc3-6464-4031-9f84-07182d9f78d9 None admin] RBAC: Authorizing `identity:get_user(user_id=817766343b6f4d76b7aaf3602af46694)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:03.793166 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e60cc3-6464-4031-9f84-07182d9f78d9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:03.795240 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 148/309] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:37:03 2022] GET /identity/v3/users/817766343b6f4d76b7aaf3602af46694 => generated 293 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:03.800846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb9f8d-4a10-4899-ae28-7ddb10e1001f None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:03.901396 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb9f8d-4a10-4899-ae28-7ddb10e1001f None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:03.931159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f28044-f965-4fae-b9e7-4a6efbf3c97e None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:03.931507 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f28044-f965-4fae-b9e7-4a6efbf3c97e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:03.931725 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f28044-f965-4fae-b9e7-4a6efbf3c97e None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:03.935464 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 149/310] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:03.941500 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277fc08-fee5-458d-90a2-b6776122e378 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:03.941500 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277fc08-fee5-458d-90a2-b6776122e378 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:03.941500 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277fc08-fee5-458d-90a2-b6776122e378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:03.945231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8024b6-6b06-4b35-93fb-76cbf5ac774b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:03.945231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8024b6-6b06-4b35-93fb-76cbf5ac774b None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:03.945231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8024b6-6b06-4b35-93fb-76cbf5ac774b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:03.945231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8024b6-6b06-4b35-93fb-76cbf5ac774b None admin] PATH_INFO: `/v3/system/users/817766343b6f4d76b7aaf3602af46694/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:03.945795 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8024b6-6b06-4b35-93fb-76cbf5ac774b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=817766343b6f4d76b7aaf3602af46694, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:03.947720 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8024b6-6b06-4b35-93fb-76cbf5ac774b None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:03.957862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 162/311] 10.222.0.73 () {58 vars in 1334 bytes} [Mon Apr 11 16:37:03 2022] PUT /identity/v3/system/users/817766343b6f4d76b7aaf3602af46694/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:37:03.959881 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b277fc08-fee5-458d-90a2-b6776122e378 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:03.961379 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b277fc08-fee5-458d-90a2-b6776122e378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:04.045748 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 150/312] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:37:04.071022 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8024b6-6b06-4b35-93fb-76cbf5ac774b None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:04.181014 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8024b6-6b06-4b35-93fb-76cbf5ac774b None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:04.214247 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec693b1-fd3a-4e70-bd4b-68f487990dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:04.215071 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec693b1-fd3a-4e70-bd4b-68f487990dec None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:04.215350 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec693b1-fd3a-4e70-bd4b-68f487990dec None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:04.215623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec693b1-fd3a-4e70-bd4b-68f487990dec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:04.225540 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec693b1-fd3a-4e70-bd4b-68f487990dec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:04.233120 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-cec693b1-fd3a-4e70-bd4b-68f487990dec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 16:37:04.234651 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 163/313] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:04.240242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277fc08-fee5-458d-90a2-b6776122e378 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:04.339944 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277fc08-fee5-458d-90a2-b6776122e378 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:04.377824 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4ab4a-83f6-4058-8124-6f1f1ce11a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:04.378851 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4ab4a-83f6-4058-8124-6f1f1ce11a5b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:04.379354 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4ab4a-83f6-4058-8124-6f1f1ce11a5b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:04.379817 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4ab4a-83f6-4058-8124-6f1f1ce11a5b None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:04.380749 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4ab4a-83f6-4058-8124-6f1f1ce11a5b None admin] RBAC: Adding query filter params (name=reader) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:04.381265 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4ab4a-83f6-4058-8124-6f1f1ce11a5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:04.382839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4ab4a-83f6-4058-8124-6f1f1ce11a5b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:04.392071 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 151/314] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:37:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:04.397434 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec693b1-fd3a-4e70-bd4b-68f487990dec None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:04.497032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec693b1-fd3a-4e70-bd4b-68f487990dec None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:04.530102 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241e875-6b32-456d-9f33-32721af91d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:04.531019 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241e875-6b32-456d-9f33-32721af91d99 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:04.531341 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241e875-6b32-456d-9f33-32721af91d99 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:04.531608 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241e875-6b32-456d-9f33-32721af91d99 None admin] PATH_INFO: `/v3/users/e47927ee68da44ec82806b66a8397db4` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:04.532779 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241e875-6b32-456d-9f33-32721af91d99 None admin] RBAC: Authorizing `identity:get_user(user_id=e47927ee68da44ec82806b66a8397db4)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:04.534204 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7241e875-6b32-456d-9f33-32721af91d99 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:04.536050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 164/315] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:37:04 2022] GET /identity/v3/users/e47927ee68da44ec82806b66a8397db4 => generated 297 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:04.541308 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4ab4a-83f6-4058-8124-6f1f1ce11a5b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:04.638214 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4ab4a-83f6-4058-8124-6f1f1ce11a5b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:04.671751 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f124e-0dca-49a6-819e-fd64c051e3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:04.672397 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f124e-0dca-49a6-819e-fd64c051e3d7 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:04.672728 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f124e-0dca-49a6-819e-fd64c051e3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:04.673007 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2f124e-0dca-49a6-819e-fd64c051e3d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:04.738163 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f124e-0dca-49a6-819e-fd64c051e3d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:04.739674 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2f124e-0dca-49a6-819e-fd64c051e3d7 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:04.844034 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 152/316] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:04.849303 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241e875-6b32-456d-9f33-32721af91d99 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:04.953537 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7241e875-6b32-456d-9f33-32721af91d99 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:04.986533 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103340c-9c58-44c8-be73-4381c54ccd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:04.987419 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103340c-9c58-44c8-be73-4381c54ccd58 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:04.987695 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103340c-9c58-44c8-be73-4381c54ccd58 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:04.987964 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103340c-9c58-44c8-be73-4381c54ccd58 None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:04.989133 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103340c-9c58-44c8-be73-4381c54ccd58 None admin] RBAC: Authorizing `identity:get_project(project_id=e9fda6800be44b51ba84452d77f4ad81)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:04.990555 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103340c-9c58-44c8-be73-4381c54ccd58 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:04.992548 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 165/317] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:37:04 2022] GET /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:04.998901 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f124e-0dca-49a6-819e-fd64c051e3d7 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:05.093989 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2f124e-0dca-49a6-819e-fd64c051e3d7 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:05.129455 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e93b94-6157-4984-8d09-19eb65d4e301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:05.130534 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e93b94-6157-4984-8d09-19eb65d4e301 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:05.131126 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e93b94-6157-4984-8d09-19eb65d4e301 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:05.131634 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e93b94-6157-4984-8d09-19eb65d4e301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:05.132683 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e93b94-6157-4984-8d09-19eb65d4e301 None admin] RBAC: Adding query filter params (role.id=0c5e1f6e454b40159cc24d34e2c3fa9f, scope.project.id=e9fda6800be44b51ba84452d77f4ad81, user.id=e47927ee68da44ec82806b66a8397db4) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:05.133204 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e93b94-6157-4984-8d09-19eb65d4e301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:05.134948 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e93b94-6157-4984-8d09-19eb65d4e301 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:05.142926 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 153/318] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:37:04 2022] GET /identity/v3/role_assignments?user.id=e47927ee68da44ec82806b66a8397db4&scope.project.id=e9fda6800be44b51ba84452d77f4ad81&role.id=0c5e1f6e454b40159cc24d34e2c3fa9f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:05.256149 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3754c-9681-41a7-b059-0f30894dd385 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:05.256426 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3754c-9681-41a7-b059-0f30894dd385 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:05.256934 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d3754c-9681-41a7-b059-0f30894dd385 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:05.258836 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 166/319] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:05.264737 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfeedb-ce75-4e53-8cff-bea4cdf4fbf7 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:05.265351 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfeedb-ce75-4e53-8cff-bea4cdf4fbf7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:05.266085 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfeedb-ce75-4e53-8cff-bea4cdf4fbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:05.284628 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6abfeedb-ce75-4e53-8cff-bea4cdf4fbf7 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:05.286189 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6abfeedb-ce75-4e53-8cff-bea4cdf4fbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:05.355156 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 154/320] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:05.380032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3754c-9681-41a7-b059-0f30894dd385 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:05.484692 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d3754c-9681-41a7-b059-0f30894dd385 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:05.516957 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f51d55-ea97-42c5-a3ef-a0b3955d2219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:05.517742 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f51d55-ea97-42c5-a3ef-a0b3955d2219 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:05.518025 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f51d55-ea97-42c5-a3ef-a0b3955d2219 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:05.518299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f51d55-ea97-42c5-a3ef-a0b3955d2219 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:05.519499 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f51d55-ea97-42c5-a3ef-a0b3955d2219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:05.520936 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f51d55-ea97-42c5-a3ef-a0b3955d2219 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:05.522584 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 167/321] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:05.528191 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfeedb-ce75-4e53-8cff-bea4cdf4fbf7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:05.600799 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c2e0c-fc00-4422-a6c8-22206e414bbb None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:05.601084 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c2e0c-fc00-4422-a6c8-22206e414bbb None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:05.601537 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c2e0c-fc00-4422-a6c8-22206e414bbb None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:05.602926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 168/322] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:37:05.608539 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af539da-0385-4049-b16b-eb7020479573 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:05.608826 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af539da-0385-4049-b16b-eb7020479573 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:05.609099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af539da-0385-4049-b16b-eb7020479573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:05.626305 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-6af539da-0385-4049-b16b-eb7020479573 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:05.626611 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfeedb-ce75-4e53-8cff-bea4cdf4fbf7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:05.627503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-6af539da-0385-4049-b16b-eb7020479573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:05.658654 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bb7b1-2884-40e8-ac39-fe473a3060bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:05.659262 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bb7b1-2884-40e8-ac39-fe473a3060bc None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:05.659539 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bb7b1-2884-40e8-ac39-fe473a3060bc None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:05.659806 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0bb7b1-2884-40e8-ac39-fe473a3060bc None admin] PATH_INFO: `/v3/groups` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:05.660478 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bb7b1-2884-40e8-ac39-fe473a3060bc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:05.661889 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0bb7b1-2884-40e8-ac39-fe473a3060bc None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:05.678277 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 155/323] 10.222.0.73 () {60 vars in 1134 bytes} [Mon Apr 11 16:37:05 2022] POST /identity/v3/groups => generated 226 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:37:05.693626 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 169/324] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:37:05.716910 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bb7b1-2884-40e8-ac39-fe473a3060bc None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:05.821930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0bb7b1-2884-40e8-ac39-fe473a3060bc None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:05.856175 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f4ffb-e7d9-48b9-ad79-89bc06dc15ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:05.856979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f4ffb-e7d9-48b9-ad79-89bc06dc15ad None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:05.857259 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f4ffb-e7d9-48b9-ad79-89bc06dc15ad None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:05.857527 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f4ffb-e7d9-48b9-ad79-89bc06dc15ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:05.867701 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f4ffb-e7d9-48b9-ad79-89bc06dc15ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:05.874734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-4f1f4ffb-e7d9-48b9-ad79-89bc06dc15ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 16:37:05.875956 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 156/325] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:05.881715 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af539da-0385-4049-b16b-eb7020479573 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:05.994375 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af539da-0385-4049-b16b-eb7020479573 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:06.028863 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f72a6-9345-428f-ae54-99e60297fede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:06.029918 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f72a6-9345-428f-ae54-99e60297fede None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:06.030416 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f72a6-9345-428f-ae54-99e60297fede None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:06.030924 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114f72a6-9345-428f-ae54-99e60297fede None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:06.031897 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f72a6-9345-428f-ae54-99e60297fede None admin] RBAC: Adding query filter params (name=reader) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:06.032408 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f72a6-9345-428f-ae54-99e60297fede None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:06.033998 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114f72a6-9345-428f-ae54-99e60297fede None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:06.043938 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 170/326] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:37:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:06.051544 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f4ffb-e7d9-48b9-ad79-89bc06dc15ad None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:06.157712 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f4ffb-e7d9-48b9-ad79-89bc06dc15ad None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:06.191773 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b654b8-3f9f-4e72-a268-3e772a0b0334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:06.192710 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b654b8-3f9f-4e72-a268-3e772a0b0334 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:06.192941 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b654b8-3f9f-4e72-a268-3e772a0b0334 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:06.193219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b654b8-3f9f-4e72-a268-3e772a0b0334 None admin] PATH_INFO: `/v3/users/150c219550c245d7ad8f1b4f559cc446` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:06.194430 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b654b8-3f9f-4e72-a268-3e772a0b0334 None admin] RBAC: Authorizing `identity:get_user(user_id=150c219550c245d7ad8f1b4f559cc446)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:06.195907 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b654b8-3f9f-4e72-a268-3e772a0b0334 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:06.201979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 157/327] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:37:06 2022] GET /identity/v3/users/150c219550c245d7ad8f1b4f559cc446 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:06.204278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f72a6-9345-428f-ae54-99e60297fede None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:06.307150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114f72a6-9345-428f-ae54-99e60297fede None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:06.341476 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90a630-e0a7-4e0c-99f4-2bbf96ce1447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:06.342349 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90a630-e0a7-4e0c-99f4-2bbf96ce1447 None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:06.342650 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90a630-e0a7-4e0c-99f4-2bbf96ce1447 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:06.342928 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90a630-e0a7-4e0c-99f4-2bbf96ce1447 None admin] PATH_INFO: `/v3/system/users/150c219550c245d7ad8f1b4f559cc446/roles/0c5e1f6e454b40159cc24d34e2c3fa9f` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:06.344484 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90a630-e0a7-4e0c-99f4-2bbf96ce1447 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=150c219550c245d7ad8f1b4f559cc446, role_id=0c5e1f6e454b40159cc24d34e2c3fa9f)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:06.345871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90a630-e0a7-4e0c-99f4-2bbf96ce1447 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:06.358608 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf39c80-3728-495d-80b0-e7bdc8866243 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:06.359103 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf39c80-3728-495d-80b0-e7bdc8866243 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:06.359304 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf39c80-3728-495d-80b0-e7bdc8866243 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:06.359465 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 171/328] 10.222.0.73 () {58 vars in 1334 bytes} [Mon Apr 11 16:37:06 2022] PUT /identity/v3/system/users/150c219550c245d7ad8f1b4f559cc446/roles/0c5e1f6e454b40159cc24d34e2c3fa9f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:37:06.368798 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 158/329] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:06 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:06.374189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2752011-cc52-4b8f-91a9-6e72b5bdfb53 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:06.374472 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2752011-cc52-4b8f-91a9-6e72b5bdfb53 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:06.374773 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2752011-cc52-4b8f-91a9-6e72b5bdfb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:06.400444 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-d2752011-cc52-4b8f-91a9-6e72b5bdfb53 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:06.402216 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d2752011-cc52-4b8f-91a9-6e72b5bdfb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:06.480756 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 172/330] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:06.508631 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf39c80-3728-495d-80b0-e7bdc8866243 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:06.630122 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf39c80-3728-495d-80b0-e7bdc8866243 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:06.666104 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a93873-6d62-4c9c-8eb8-7344209f6195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:06.667063 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a93873-6d62-4c9c-8eb8-7344209f6195 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:06.667348 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a93873-6d62-4c9c-8eb8-7344209f6195 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:06.667619 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a93873-6d62-4c9c-8eb8-7344209f6195 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:06.678874 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a93873-6d62-4c9c-8eb8-7344209f6195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:06.686488 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-50a93873-6d62-4c9c-8eb8-7344209f6195 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:37:06.688082 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 159/331] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:06.693381 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2752011-cc52-4b8f-91a9-6e72b5bdfb53 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:06.805111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2752011-cc52-4b8f-91a9-6e72b5bdfb53 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:06.846381 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4a1aa-2e50-4dd8-af6b-abea6f902972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:06.847072 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4a1aa-2e50-4dd8-af6b-abea6f902972 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:06.847354 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4a1aa-2e50-4dd8-af6b-abea6f902972 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:06.847623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4a1aa-2e50-4dd8-af6b-abea6f902972 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:06.848368 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4a1aa-2e50-4dd8-af6b-abea6f902972 None admin] RBAC: Adding query filter params (name=member) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:06.848736 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4a1aa-2e50-4dd8-af6b-abea6f902972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:06.850156 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4a1aa-2e50-4dd8-af6b-abea6f902972 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:06.862262 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 173/332] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:37:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:06.867330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a93873-6d62-4c9c-8eb8-7344209f6195 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:07.022228 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a93873-6d62-4c9c-8eb8-7344209f6195 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:07.073292 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d147f2-e1e2-4cbb-a971-bda0146b0ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:07.074098 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d147f2-e1e2-4cbb-a971-bda0146b0ecb None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:07.074447 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d147f2-e1e2-4cbb-a971-bda0146b0ecb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:07.074749 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d147f2-e1e2-4cbb-a971-bda0146b0ecb None admin] PATH_INFO: `/v3/users/817766343b6f4d76b7aaf3602af46694` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:07.075937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d147f2-e1e2-4cbb-a971-bda0146b0ecb None admin] RBAC: Authorizing `identity:get_user(user_id=817766343b6f4d76b7aaf3602af46694)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:07.077368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d147f2-e1e2-4cbb-a971-bda0146b0ecb None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:07.079327 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 160/333] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:37:06 2022] GET /identity/v3/users/817766343b6f4d76b7aaf3602af46694 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:07.084652 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4a1aa-2e50-4dd8-af6b-abea6f902972 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:07.217362 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4a1aa-2e50-4dd8-af6b-abea6f902972 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:07.250281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7414053-7c41-4511-ab35-12e684e70503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:07.250970 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7414053-7c41-4511-ab35-12e684e70503 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:07.251248 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7414053-7c41-4511-ab35-12e684e70503 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:07.251521 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7414053-7c41-4511-ab35-12e684e70503 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:07.252339 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7414053-7c41-4511-ab35-12e684e70503 None admin] RBAC: Adding query filter params (role.id=7695974856564d4289ab64dbf6dcc119, user.id=817766343b6f4d76b7aaf3602af46694, scope.system=all) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:07.252643 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7414053-7c41-4511-ab35-12e684e70503 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:07.254064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7414053-7c41-4511-ab35-12e684e70503 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:07.266664 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 174/334] 10.222.0.73 () {56 vars in 1308 bytes} [Mon Apr 11 16:37:07 2022] GET /identity/v3/role_assignments?user.id=817766343b6f4d76b7aaf3602af46694&scope.system=all&role.id=7695974856564d4289ab64dbf6dcc119 => generated 510 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:08.477359 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7bb85-bc9b-4730-90b0-01c1df3e30d7 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:08.478436 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7bb85-bc9b-4730-90b0-01c1df3e30d7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:08.479514 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7bb85-bc9b-4730-90b0-01c1df3e30d7 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:08.481404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 161/335] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:08.487332 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036041d-de00-4505-8dac-48c7c04ba214 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:08.488195 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036041d-de00-4505-8dac-48c7c04ba214 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:08.488670 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036041d-de00-4505-8dac-48c7c04ba214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:08.515881 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-f036041d-de00-4505-8dac-48c7c04ba214 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:08.517407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f036041d-de00-4505-8dac-48c7c04ba214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:08.542316 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66084d19-92c2-4837-aac6-bdb7d36a3f1c None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:08.542956 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66084d19-92c2-4837-aac6-bdb7d36a3f1c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:08.543436 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66084d19-92c2-4837-aac6-bdb7d36a3f1c None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:08.545226 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 162/336] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:08.550644 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f6a86-cacb-43bb-a448-05cc4bba1f4a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:08.551244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f6a86-cacb-43bb-a448-05cc4bba1f4a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:08.551736 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f6a86-cacb-43bb-a448-05cc4bba1f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:08.578654 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-de8f6a86-cacb-43bb-a448-05cc4bba1f4a None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:08.582911 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-de8f6a86-cacb-43bb-a448-05cc4bba1f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:08.614106 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 175/337] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:37:08.679967 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 163/338] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:37:08.701432 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036041d-de00-4505-8dac-48c7c04ba214 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:08.773413 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f6a86-cacb-43bb-a448-05cc4bba1f4a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:08.826049 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036041d-de00-4505-8dac-48c7c04ba214 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:08.887403 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead1f6b-6adb-49f0-b790-80a9d6db60f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:08.888617 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead1f6b-6adb-49f0-b790-80a9d6db60f2 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:08.889399 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead1f6b-6adb-49f0-b790-80a9d6db60f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:08.889944 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead1f6b-6adb-49f0-b790-80a9d6db60f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:08.915664 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead1f6b-6adb-49f0-b790-80a9d6db60f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:08.925155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-dead1f6b-6adb-49f0-b790-80a9d6db60f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:37:08.931042 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 176/339] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:08.934060 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead1f6b-6adb-49f0-b790-80a9d6db60f2 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:08.980324 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f6a86-cacb-43bb-a448-05cc4bba1f4a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:09.051569 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee956fd-271c-4e22-a50e-ecedafc52ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:09.052720 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee956fd-271c-4e22-a50e-ecedafc52ab8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:09.053216 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee956fd-271c-4e22-a50e-ecedafc52ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:09.053692 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee956fd-271c-4e22-a50e-ecedafc52ab8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:09.067732 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee956fd-271c-4e22-a50e-ecedafc52ab8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:09.076018 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-0ee956fd-271c-4e22-a50e-ecedafc52ab8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:37:09.083061 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 164/340] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:37:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:09.089495 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee956fd-271c-4e22-a50e-ecedafc52ab8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:09.146151 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead1f6b-6adb-49f0-b790-80a9d6db60f2 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:09.212175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c297a-9949-401b-9059-bc5d634d4424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:09.213157 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c297a-9949-401b-9059-bc5d634d4424 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:09.214114 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c297a-9949-401b-9059-bc5d634d4424 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:09.214603 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c297a-9949-401b-9059-bc5d634d4424 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:09.215526 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c297a-9949-401b-9059-bc5d634d4424 None admin] RBAC: Adding query filter params (name=member) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:09.216050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c297a-9949-401b-9059-bc5d634d4424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:09.217640 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c297a-9949-401b-9059-bc5d634d4424 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:09.222681 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee956fd-271c-4e22-a50e-ecedafc52ab8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:09.237327 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 177/341] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:37:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:09.254605 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c297a-9949-401b-9059-bc5d634d4424 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:09.273844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f9b99-cf7e-4b53-9b14-1752abaa3ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:09.274522 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9b99-cf7e-4b53-9b14-1752abaa3ad9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:09.274829 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9b99-cf7e-4b53-9b14-1752abaa3ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:09.275102 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9b99-cf7e-4b53-9b14-1752abaa3ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:09.276432 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f9b99-cf7e-4b53-9b14-1752abaa3ad9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:09.276740 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f9b99-cf7e-4b53-9b14-1752abaa3ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:09.278114 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f9b99-cf7e-4b53-9b14-1752abaa3ad9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:09.300961 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 165/342] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:09.310763 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f9b99-cf7e-4b53-9b14-1752abaa3ad9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:09.445811 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c297a-9949-401b-9059-bc5d634d4424 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:09.511547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0587b7-c28f-47bf-b38b-6162f3bfacab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:09.512294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0587b7-c28f-47bf-b38b-6162f3bfacab None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:09.512482 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0587b7-c28f-47bf-b38b-6162f3bfacab None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:09.512758 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0587b7-c28f-47bf-b38b-6162f3bfacab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:09.575136 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f9b99-cf7e-4b53-9b14-1752abaa3ad9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:09.596116 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0587b7-c28f-47bf-b38b-6162f3bfacab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:09.598299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0587b7-c28f-47bf-b38b-6162f3bfacab None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:09.676369 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dbec3-86fe-4dc3-b1f0-e237c684e6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:09.677034 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dbec3-86fe-4dc3-b1f0-e237c684e6cd None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:09.677313 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dbec3-86fe-4dc3-b1f0-e237c684e6cd None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:09.677581 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dbec3-86fe-4dc3-b1f0-e237c684e6cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:09.711317 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 178/343] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 16:37:09.733270 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0587b7-c28f-47bf-b38b-6162f3bfacab None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:09.835714 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dbec3-86fe-4dc3-b1f0-e237c684e6cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:09.837102 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4dbec3-86fe-4dc3-b1f0-e237c684e6cd None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:09.859519 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0587b7-c28f-47bf-b38b-6162f3bfacab None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:09.899920 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44798d1-7dc7-4411-b5e8-571ef25b789b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:09.900833 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44798d1-7dc7-4411-b5e8-571ef25b789b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:09.901115 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44798d1-7dc7-4411-b5e8-571ef25b789b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:09.901818 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44798d1-7dc7-4411-b5e8-571ef25b789b None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:09.907167 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44798d1-7dc7-4411-b5e8-571ef25b789b None admin] RBAC: Authorizing `identity:get_project(project_id=83feba5a40fe4602b9b7b8109feffaf3)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:09.908633 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44798d1-7dc7-4411-b5e8-571ef25b789b None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:09.910766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 179/344] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:37:09 2022] GET /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:09.933329 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44798d1-7dc7-4411-b5e8-571ef25b789b None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:09.981962 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 166/345] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 672 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:09.988743 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff092ef-7bf6-4e57-a753-1703f65c544c None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:09.989037 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff092ef-7bf6-4e57-a753-1703f65c544c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:09.989313 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff092ef-7bf6-4e57-a753-1703f65c544c None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:09.990827 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 167/346] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:09.991528 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff092ef-7bf6-4e57-a753-1703f65c544c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:10.098375 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44798d1-7dc7-4411-b5e8-571ef25b789b None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:10.126261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff092ef-7bf6-4e57-a753-1703f65c544c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:10.163234 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60a351-99ba-4bc4-ad22-24224b7f1a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:10.164104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60a351-99ba-4bc4-ad22-24224b7f1a78 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:10.164381 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60a351-99ba-4bc4-ad22-24224b7f1a78 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:10.164645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60a351-99ba-4bc4-ad22-24224b7f1a78 None admin] PATH_INFO: `/v3/groups/2b9ae08430d4488499da48f1e7a24622` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:10.173592 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3aa31-0de1-41f6-a166-ffb8fbe48e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:10.174720 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3aa31-0de1-41f6-a166-ffb8fbe48e7f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:10.175131 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3aa31-0de1-41f6-a166-ffb8fbe48e7f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:10.175545 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3aa31-0de1-41f6-a166-ffb8fbe48e7f None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:10.176323 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60a351-99ba-4bc4-ad22-24224b7f1a78 None admin] RBAC: Authorizing `identity:get_group(group_id=2b9ae08430d4488499da48f1e7a24622)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:10.177328 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3aa31-0de1-41f6-a166-ffb8fbe48e7f None admin] RBAC: Authorizing `identity:get_project(project_id=83feba5a40fe4602b9b7b8109feffaf3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:10.178235 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60a351-99ba-4bc4-ad22-24224b7f1a78 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:10.178881 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3aa31-0de1-41f6-a166-ffb8fbe48e7f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:10.180471 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 180/347] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Apr 11 16:37:09 2022] GET /identity/v3/groups/2b9ae08430d4488499da48f1e7a24622 => generated 226 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:10.180632 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 168/348] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:37:09 2022] GET /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:10.182496 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6390a-69f3-498a-bb1d-ae1eceb50eb2 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:10.182711 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa18996-962a-4f5e-83d9-52ab5661e1ac None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:10.182956 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa18996-962a-4f5e-83d9-52ab5661e1ac None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:10.183228 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa18996-962a-4f5e-83d9-52ab5661e1ac None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:10.183594 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6390a-69f3-498a-bb1d-ae1eceb50eb2 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:10.184064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f6390a-69f3-498a-bb1d-ae1eceb50eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:10.184519 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 169/349] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:10.188209 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa18996-962a-4f5e-83d9-52ab5661e1ac None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:10.203498 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-31f6390a-69f3-498a-bb1d-ae1eceb50eb2 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:10.205008 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-31f6390a-69f3-498a-bb1d-ae1eceb50eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:10.273050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 181/350] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:10.274299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6390a-69f3-498a-bb1d-ae1eceb50eb2 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:10.294730 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa18996-962a-4f5e-83d9-52ab5661e1ac None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:10.330194 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce5ede-f053-4cef-a1f9-717cf9617277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:10.331383 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce5ede-f053-4cef-a1f9-717cf9617277 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:10.331913 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce5ede-f053-4cef-a1f9-717cf9617277 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:10.332503 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce5ede-f053-4cef-a1f9-717cf9617277 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:10.333947 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce5ede-f053-4cef-a1f9-717cf9617277 None admin] RBAC: Adding query filter params (group.id=2b9ae08430d4488499da48f1e7a24622, role.id=7695974856564d4289ab64dbf6dcc119, scope.project.id=83feba5a40fe4602b9b7b8109feffaf3) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:10.334506 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce5ede-f053-4cef-a1f9-717cf9617277 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:10.336726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce5ede-f053-4cef-a1f9-717cf9617277 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:10.344855 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 170/351] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Apr 11 16:37:10 2022] GET /identity/v3/role_assignments?group.id=2b9ae08430d4488499da48f1e7a24622&scope.project.id=83feba5a40fe4602b9b7b8109feffaf3&role.id=7695974856564d4289ab64dbf6dcc119 => generated 260 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:10.346612 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d643a70-f327-4d9c-9c65-6b657a420f19 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:10.347048 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d643a70-f327-4d9c-9c65-6b657a420f19 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:10.347463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d643a70-f327-4d9c-9c65-6b657a420f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:10.372704 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6d643a70-f327-4d9c-9c65-6b657a420f19 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:10.374052 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6d643a70-f327-4d9c-9c65-6b657a420f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:10.399364 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f6390a-69f3-498a-bb1d-ae1eceb50eb2 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:10.449349 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17d5ca-9237-4a63-8fb9-e90193f563e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:10.450926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17d5ca-9237-4a63-8fb9-e90193f563e9 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:10.451422 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17d5ca-9237-4a63-8fb9-e90193f563e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:10.451960 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17d5ca-9237-4a63-8fb9-e90193f563e9 None admin] PATH_INFO: `/v3/groups/2b9ae08430d4488499da48f1e7a24622` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:10.453505 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17d5ca-9237-4a63-8fb9-e90193f563e9 None admin] RBAC: Authorizing `identity:get_group(group_id=2b9ae08430d4488499da48f1e7a24622)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:10.455848 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17d5ca-9237-4a63-8fb9-e90193f563e9 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:10.458969 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 182/352] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Apr 11 16:37:10 2022] GET /identity/v3/groups/2b9ae08430d4488499da48f1e7a24622 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:10.460093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17d5ca-9237-4a63-8fb9-e90193f563e9 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:10.475970 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 171/353] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:10.476849 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d643a70-f327-4d9c-9c65-6b657a420f19 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:10.656397 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d643a70-f327-4d9c-9c65-6b657a420f19 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:10.670293 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17d5ca-9237-4a63-8fb9-e90193f563e9 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:10.694792 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90f34f-99bb-4e28-9ee3-612f71761974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:10.695832 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90f34f-99bb-4e28-9ee3-612f71761974 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:10.696321 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90f34f-99bb-4e28-9ee3-612f71761974 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:10.696788 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90f34f-99bb-4e28-9ee3-612f71761974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:10.697857 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90f34f-99bb-4e28-9ee3-612f71761974 None admin] RBAC: Adding query filter params (group.id=2b9ae08430d4488499da48f1e7a24622, role.id=807f93fb1a91497aba7762557ae039dd, scope.project.id=83feba5a40fe4602b9b7b8109feffaf3) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:10.698367 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90f34f-99bb-4e28-9ee3-612f71761974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:10.700035 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90f34f-99bb-4e28-9ee3-612f71761974 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:10.706229 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 172/354] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Apr 11 16:37:10 2022] GET /identity/v3/role_assignments?group.id=2b9ae08430d4488499da48f1e7a24622&scope.project.id=83feba5a40fe4602b9b7b8109feffaf3&role.id=807f93fb1a91497aba7762557ae039dd => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:10.707328 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90f34f-99bb-4e28-9ee3-612f71761974 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:10.751994 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22392e-da2e-4a55-92cc-8de00fca33f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:10.752817 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22392e-da2e-4a55-92cc-8de00fca33f5 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:10.753096 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22392e-da2e-4a55-92cc-8de00fca33f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:10.753365 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22392e-da2e-4a55-92cc-8de00fca33f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:10.783662 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22392e-da2e-4a55-92cc-8de00fca33f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:10.790963 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-0b22392e-da2e-4a55-92cc-8de00fca33f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:37:10.799231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 183/355] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:10.804631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22392e-da2e-4a55-92cc-8de00fca33f5 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:10.828337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90f34f-99bb-4e28-9ee3-612f71761974 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:10.868459 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0abdd-0768-4f69-9605-0d08097f9ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:10.870271 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0abdd-0768-4f69-9605-0d08097f9ae9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:10.870789 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0abdd-0768-4f69-9605-0d08097f9ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:10.871307 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c0abdd-0768-4f69-9605-0d08097f9ae9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:10.886126 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c0abdd-0768-4f69-9605-0d08097f9ae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:10.895104 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-d8c0abdd-0768-4f69-9605-0d08097f9ae9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 16:37:10.897345 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 173/356] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:10.903318 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0abdd-0768-4f69-9605-0d08097f9ae9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:11.018144 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c0abdd-0768-4f69-9605-0d08097f9ae9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:11.058493 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bef47-4957-4c25-a3c5-cf4b757a02ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:11.059203 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bef47-4957-4c25-a3c5-cf4b757a02ad None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:11.059482 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bef47-4957-4c25-a3c5-cf4b757a02ad None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:11.059756 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bef47-4957-4c25-a3c5-cf4b757a02ad None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:11.060511 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bef47-4957-4c25-a3c5-cf4b757a02ad None admin] RBAC: Adding query filter params (name=reader) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:11.060817 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bef47-4957-4c25-a3c5-cf4b757a02ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:11.062240 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bef47-4957-4c25-a3c5-cf4b757a02ad None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:11.071386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 174/357] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:37:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:11.075266 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22392e-da2e-4a55-92cc-8de00fca33f5 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:11.079992 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bef47-4957-4c25-a3c5-cf4b757a02ad None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:11.163781 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f80e3e3-37af-48e3-9390-5b900d7cb080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:11.164455 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80e3e3-37af-48e3-9390-5b900d7cb080 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:11.164735 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80e3e3-37af-48e3-9390-5b900d7cb080 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:11.165007 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80e3e3-37af-48e3-9390-5b900d7cb080 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:11.165753 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80e3e3-37af-48e3-9390-5b900d7cb080 None admin] RBAC: Adding query filter params (name=member) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:11.166060 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80e3e3-37af-48e3-9390-5b900d7cb080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:11.168080 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f80e3e3-37af-48e3-9390-5b900d7cb080 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:11.176797 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 184/358] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:37:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:11.178147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5ef7e-f3a3-4b0d-8917-dd116f877928 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:11.178436 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5ef7e-f3a3-4b0d-8917-dd116f877928 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:11.178823 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5ef7e-f3a3-4b0d-8917-dd116f877928 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:11.180364 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 185/359] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:11.184084 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5ef7e-f3a3-4b0d-8917-dd116f877928 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:11.202437 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bef47-4957-4c25-a3c5-cf4b757a02ad None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:11.259313 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8eade3-458e-4179-a0f8-934b01de5809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:11.260245 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eade3-458e-4179-a0f8-934b01de5809 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:11.260528 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eade3-458e-4179-a0f8-934b01de5809 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:11.260803 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8eade3-458e-4179-a0f8-934b01de5809 None admin] PATH_INFO: `/v3/users/150c219550c245d7ad8f1b4f559cc446` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:11.262077 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8eade3-458e-4179-a0f8-934b01de5809 None admin] RBAC: Authorizing `identity:get_user(user_id=150c219550c245d7ad8f1b4f559cc446)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:11.263539 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8eade3-458e-4179-a0f8-934b01de5809 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:11.265751 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 175/360] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:37:11 2022] GET /identity/v3/users/150c219550c245d7ad8f1b4f559cc446 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:11.266984 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf1cad-5d9b-4091-ad60-459de42359a2 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:11.267266 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf1cad-5d9b-4091-ad60-459de42359a2 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:11.267544 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf1cad-5d9b-4091-ad60-459de42359a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:11.295865 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5ef7e-f3a3-4b0d-8917-dd116f877928 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:11.303234 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3daf1cad-5d9b-4091-ad60-459de42359a2 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:11.304427 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3daf1cad-5d9b-4091-ad60-459de42359a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:11.362537 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90806f57-8ba8-4086-b231-48212accfc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:11.363219 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90806f57-8ba8-4086-b231-48212accfc08 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:11.363498 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90806f57-8ba8-4086-b231-48212accfc08 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:11.363773 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90806f57-8ba8-4086-b231-48212accfc08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:11.438503 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 176/361] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:11.439408 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf1cad-5d9b-4091-ad60-459de42359a2 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:11.462451 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90806f57-8ba8-4086-b231-48212accfc08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:11.464409 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90806f57-8ba8-4086-b231-48212accfc08 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:11.571295 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf1cad-5d9b-4091-ad60-459de42359a2 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:11.574720 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 186/362] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:11.576150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecb9c7-0a2c-4031-824d-114c642e8d9c None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:11.576439 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecb9c7-0a2c-4031-824d-114c642e8d9c None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:11.576718 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecb9c7-0a2c-4031-824d-114c642e8d9c None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:11.578040 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 187/363] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:11.580033 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eecb9c7-0a2c-4031-824d-114c642e8d9c None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:11.611824 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda58bd-f911-4b03-9fb9-7776d3bad9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:11.613621 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda58bd-f911-4b03-9fb9-7776d3bad9d3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:11.614490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda58bd-f911-4b03-9fb9-7776d3bad9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:11.615009 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda58bd-f911-4b03-9fb9-7776d3bad9d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:11.617479 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda58bd-f911-4b03-9fb9-7776d3bad9d3 None admin] RBAC: Adding query filter params (role.id=0c5e1f6e454b40159cc24d34e2c3fa9f, user.id=150c219550c245d7ad8f1b4f559cc446, scope.system=all) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:11.618217 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda58bd-f911-4b03-9fb9-7776d3bad9d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:11.621149 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda58bd-f911-4b03-9fb9-7776d3bad9d3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:11.640913 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 177/364] 10.222.0.73 () {56 vars in 1308 bytes} [Mon Apr 11 16:37:11 2022] GET /identity/v3/role_assignments?user.id=150c219550c245d7ad8f1b4f559cc446&scope.system=all&role.id=0c5e1f6e454b40159cc24d34e2c3fa9f => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:11.642198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a92dd-05fe-43a5-88f1-08d4938e546f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:11.642482 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a92dd-05fe-43a5-88f1-08d4938e546f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:11.642783 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a92dd-05fe-43a5-88f1-08d4938e546f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:11.665810 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-516a92dd-05fe-43a5-88f1-08d4938e546f None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:11.667584 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-516a92dd-05fe-43a5-88f1-08d4938e546f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:11.702981 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eecb9c7-0a2c-4031-824d-114c642e8d9c None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:11.742645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142e2ae-6180-48d9-8919-3b254e18ffae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:11.743452 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142e2ae-6180-48d9-8919-3b254e18ffae None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:11.743947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142e2ae-6180-48d9-8919-3b254e18ffae None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:11.744764 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142e2ae-6180-48d9-8919-3b254e18ffae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:11.755229 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 178/365] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:11.756130 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a92dd-05fe-43a5-88f1-08d4938e546f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:11.761406 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142e2ae-6180-48d9-8919-3b254e18ffae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:11.769167 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-b142e2ae-6180-48d9-8919-3b254e18ffae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:37:11.770476 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 188/366] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:37:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:11.792155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142e2ae-6180-48d9-8919-3b254e18ffae None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:11.867811 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a92dd-05fe-43a5-88f1-08d4938e546f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:11.901872 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142e2ae-6180-48d9-8919-3b254e18ffae None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:11.905331 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5fc62-dc2b-4a68-bbe4-099fe4be0ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:11.905331 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5fc62-dc2b-4a68-bbe4-099fe4be0ab8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:11.905331 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5fc62-dc2b-4a68-bbe4-099fe4be0ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:11.905331 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a5fc62-dc2b-4a68-bbe4-099fe4be0ab8 None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:11.908182 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5fc62-dc2b-4a68-bbe4-099fe4be0ab8 None admin] RBAC: Authorizing `identity:get_project(project_id=e9fda6800be44b51ba84452d77f4ad81)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:11.909639 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a5fc62-dc2b-4a68-bbe4-099fe4be0ab8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:11.911430 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 179/367] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:37:11 2022] GET /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:11.912203 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5fc62-dc2b-4a68-bbe4-099fe4be0ab8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:11.942950 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ead1b-6361-4e55-b5bb-a8bf9a029b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:11.943622 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ead1b-6361-4e55-b5bb-a8bf9a029b3b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:11.943905 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ead1b-6361-4e55-b5bb-a8bf9a029b3b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:11.944691 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1ead1b-6361-4e55-b5bb-a8bf9a029b3b None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:11.948755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ead1b-6361-4e55-b5bb-a8bf9a029b3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:11.948755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ead1b-6361-4e55-b5bb-a8bf9a029b3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:11.948755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1ead1b-6361-4e55-b5bb-a8bf9a029b3b None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:11.957342 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 189/368] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:11.958287 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ead1b-6361-4e55-b5bb-a8bf9a029b3b None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:12.029430 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a5fc62-dc2b-4a68-bbe4-099fe4be0ab8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:12.062491 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1ead1b-6361-4e55-b5bb-a8bf9a029b3b None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:12.064558 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6551c6-21a2-4ccf-9aed-cad7ba881000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:12.065382 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6551c6-21a2-4ccf-9aed-cad7ba881000 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:12.065663 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6551c6-21a2-4ccf-9aed-cad7ba881000 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:12.065936 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6551c6-21a2-4ccf-9aed-cad7ba881000 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:12.091701 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6551c6-21a2-4ccf-9aed-cad7ba881000 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:12.099593 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-4b6551c6-21a2-4ccf-9aed-cad7ba881000 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:37:12.100677 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 180/369] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:37:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:12.102091 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6551c6-21a2-4ccf-9aed-cad7ba881000 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:12.110617 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5db18-f01c-4d05-bc95-94ea9ba483dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:12.110617 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5db18-f01c-4d05-bc95-94ea9ba483dd None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:12.110617 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5db18-f01c-4d05-bc95-94ea9ba483dd None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:12.110617 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b5db18-f01c-4d05-bc95-94ea9ba483dd None admin] PATH_INFO: `/v3/groups/2b9ae08430d4488499da48f1e7a24622` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:12.110993 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5db18-f01c-4d05-bc95-94ea9ba483dd None admin] RBAC: Authorizing `identity:get_group(group_id=2b9ae08430d4488499da48f1e7a24622)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:12.111278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b5db18-f01c-4d05-bc95-94ea9ba483dd None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:12.112917 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 190/370] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Apr 11 16:37:11 2022] GET /identity/v3/groups/2b9ae08430d4488499da48f1e7a24622 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:12.113684 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5db18-f01c-4d05-bc95-94ea9ba483dd None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:12.224990 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6551c6-21a2-4ccf-9aed-cad7ba881000 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:12.244828 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b5db18-f01c-4d05-bc95-94ea9ba483dd None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:12.267134 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c3e26-ed95-4102-865b-e147d9b2331e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:12.268235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c3e26-ed95-4102-865b-e147d9b2331e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:12.268524 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c3e26-ed95-4102-865b-e147d9b2331e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:12.268802 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c3e26-ed95-4102-865b-e147d9b2331e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:12.283375 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bda536-e45b-4d29-be04-7d8a27822e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:12.283972 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bda536-e45b-4d29-be04-7d8a27822e0a None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:12.284253 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bda536-e45b-4d29-be04-7d8a27822e0a None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:12.284573 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bda536-e45b-4d29-be04-7d8a27822e0a None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:12.285315 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bda536-e45b-4d29-be04-7d8a27822e0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:12.285706 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bda536-e45b-4d29-be04-7d8a27822e0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:12.287168 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bda536-e45b-4d29-be04-7d8a27822e0a None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:12.295569 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 191/371] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:12.296448 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bda536-e45b-4d29-be04-7d8a27822e0a None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:12.348599 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c3e26-ed95-4102-865b-e147d9b2331e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:12.350059 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c3e26-ed95-4102-865b-e147d9b2331e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:12.418026 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bda536-e45b-4d29-be04-7d8a27822e0a None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:12.456078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 181/372] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:12.456937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c3e26-ed95-4102-865b-e147d9b2331e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:12.458268 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3f413-6ea6-42ea-b2c6-2b20ef5a8834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:12.458954 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3f413-6ea6-42ea-b2c6-2b20ef5a8834 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:12.459239 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3f413-6ea6-42ea-b2c6-2b20ef5a8834 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:12.459515 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3f413-6ea6-42ea-b2c6-2b20ef5a8834 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:12.460344 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3f413-6ea6-42ea-b2c6-2b20ef5a8834 None admin] RBAC: Adding query filter params (group.id=2b9ae08430d4488499da48f1e7a24622, role.id=7695974856564d4289ab64dbf6dcc119, scope.project.id=e9fda6800be44b51ba84452d77f4ad81) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:12.460993 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3f413-6ea6-42ea-b2c6-2b20ef5a8834 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:12.462437 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd3f413-6ea6-42ea-b2c6-2b20ef5a8834 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:12.468217 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 192/373] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Apr 11 16:37:12 2022] GET /identity/v3/role_assignments?group.id=2b9ae08430d4488499da48f1e7a24622&scope.project.id=e9fda6800be44b51ba84452d77f4ad81&role.id=7695974856564d4289ab64dbf6dcc119 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:12.475543 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3f413-6ea6-42ea-b2c6-2b20ef5a8834 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:12.565709 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c3e26-ed95-4102-865b-e147d9b2331e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:12.604805 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5b61a-093d-4174-87a6-bb7bf040e17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:12.605487 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5b61a-093d-4174-87a6-bb7bf040e17f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:12.605759 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5b61a-093d-4174-87a6-bb7bf040e17f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:12.606099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5b61a-093d-4174-87a6-bb7bf040e17f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:12.664742 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3f413-6ea6-42ea-b2c6-2b20ef5a8834 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:12.681441 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5b61a-093d-4174-87a6-bb7bf040e17f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:12.683482 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5b61a-093d-4174-87a6-bb7bf040e17f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:12.702511 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa272d-bf30-4285-a4a9-41b51ef6226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:12.703421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa272d-bf30-4285-a4a9-41b51ef6226d None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:12.703939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa272d-bf30-4285-a4a9-41b51ef6226d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:12.703939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa272d-bf30-4285-a4a9-41b51ef6226d None admin] PATH_INFO: `/v3/projects/f8c9bf4c662c47e3808d264d2ea01d67` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:12.705159 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa272d-bf30-4285-a4a9-41b51ef6226d None admin] RBAC: Authorizing `identity:get_project(project_id=f8c9bf4c662c47e3808d264d2ea01d67)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:12.706657 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa272d-bf30-4285-a4a9-41b51ef6226d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:12.708746 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 193/374] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:37:12 2022] GET /identity/v3/projects/f8c9bf4c662c47e3808d264d2ea01d67 => generated 344 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:12.714111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa272d-bf30-4285-a4a9-41b51ef6226d None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:12.787988 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 182/375] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:12.797839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5b61a-093d-4174-87a6-bb7bf040e17f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:12.821217 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa272d-bf30-4285-a4a9-41b51ef6226d None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:12.855984 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ebcbb-734f-414b-aa88-40e22254f68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:12.857202 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ebcbb-734f-414b-aa88-40e22254f68b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:12.857677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ebcbb-734f-414b-aa88-40e22254f68b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:12.858143 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138ebcbb-734f-414b-aa88-40e22254f68b None admin] PATH_INFO: `/v3/groups/014af3157a624ee3be4e51d6d4f9f974` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:12.863923 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ebcbb-734f-414b-aa88-40e22254f68b None admin] RBAC: Authorizing `identity:get_group(group_id=014af3157a624ee3be4e51d6d4f9f974)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:12.865741 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138ebcbb-734f-414b-aa88-40e22254f68b None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:12.868030 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 194/376] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Apr 11 16:37:12 2022] GET /identity/v3/groups/014af3157a624ee3be4e51d6d4f9f974 => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:12.874885 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ebcbb-734f-414b-aa88-40e22254f68b None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:12.901497 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5b61a-093d-4174-87a6-bb7bf040e17f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:12.938867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0749ce-5d70-454b-b2c0-89b47e44a695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:12.939836 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0749ce-5d70-454b-b2c0-89b47e44a695 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:12.940121 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0749ce-5d70-454b-b2c0-89b47e44a695 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:12.940340 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0749ce-5d70-454b-b2c0-89b47e44a695 None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:12.941579 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0749ce-5d70-454b-b2c0-89b47e44a695 None admin] RBAC: Authorizing `identity:get_project(project_id=e9fda6800be44b51ba84452d77f4ad81)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:12.943130 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0749ce-5d70-454b-b2c0-89b47e44a695 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:12.945200 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 183/377] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:37:12 2022] GET /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:12.953071 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0749ce-5d70-454b-b2c0-89b47e44a695 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:13.005457 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138ebcbb-734f-414b-aa88-40e22254f68b None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:13.044815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78668b60-83c2-40c9-8d84-6e3eb6f675e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:13.045603 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78668b60-83c2-40c9-8d84-6e3eb6f675e6 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:13.046115 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78668b60-83c2-40c9-8d84-6e3eb6f675e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:13.046577 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78668b60-83c2-40c9-8d84-6e3eb6f675e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:13.047616 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78668b60-83c2-40c9-8d84-6e3eb6f675e6 None admin] RBAC: Adding query filter params (group.id=014af3157a624ee3be4e51d6d4f9f974, role.id=13de1ce875d44fcc988cc31b3a0639be, scope.project.id=f8c9bf4c662c47e3808d264d2ea01d67) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:13.048117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78668b60-83c2-40c9-8d84-6e3eb6f675e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:13.050100 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78668b60-83c2-40c9-8d84-6e3eb6f675e6 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:13.059926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 195/378] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Apr 11 16:37:12 2022] GET /identity/v3/role_assignments?group.id=014af3157a624ee3be4e51d6d4f9f974&scope.project.id=f8c9bf4c662c47e3808d264d2ea01d67&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:13.097057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0749ce-5d70-454b-b2c0-89b47e44a695 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:13.150158 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c86c9d-96da-45ae-aa62-0fe3517882c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:13.151098 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c86c9d-96da-45ae-aa62-0fe3517882c6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:13.151370 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c86c9d-96da-45ae-aa62-0fe3517882c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:13.151641 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c86c9d-96da-45ae-aa62-0fe3517882c6 None admin] PATH_INFO: `/v3/groups/2b9ae08430d4488499da48f1e7a24622` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:13.155267 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c86c9d-96da-45ae-aa62-0fe3517882c6 None admin] RBAC: Authorizing `identity:get_group(group_id=2b9ae08430d4488499da48f1e7a24622)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:13.156696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c86c9d-96da-45ae-aa62-0fe3517882c6 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:13.158641 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 184/379] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Apr 11 16:37:12 2022] GET /identity/v3/groups/2b9ae08430d4488499da48f1e7a24622 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:13.164360 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78668b60-83c2-40c9-8d84-6e3eb6f675e6 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:13.290639 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78668b60-83c2-40c9-8d84-6e3eb6f675e6 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:13.330266 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c420610-7d42-4dd4-a3ed-816a5399be1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:13.331346 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c420610-7d42-4dd4-a3ed-816a5399be1f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:13.331842 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c420610-7d42-4dd4-a3ed-816a5399be1f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:13.332316 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c420610-7d42-4dd4-a3ed-816a5399be1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:13.333335 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c420610-7d42-4dd4-a3ed-816a5399be1f None admin] RBAC: Adding query filter params (group.id=2b9ae08430d4488499da48f1e7a24622, role.id=807f93fb1a91497aba7762557ae039dd, scope.project.id=e9fda6800be44b51ba84452d77f4ad81) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:13.333835 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c420610-7d42-4dd4-a3ed-816a5399be1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:13.335541 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c420610-7d42-4dd4-a3ed-816a5399be1f None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:13.343017 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 196/380] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Apr 11 16:37:13 2022] GET /identity/v3/role_assignments?group.id=2b9ae08430d4488499da48f1e7a24622&scope.project.id=e9fda6800be44b51ba84452d77f4ad81&role.id=807f93fb1a91497aba7762557ae039dd => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:13.398149 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759490c0-33e7-42a7-ad77-53676650bdc5 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:13.398431 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759490c0-33e7-42a7-ad77-53676650bdc5 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:13.398959 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759490c0-33e7-42a7-ad77-53676650bdc5 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:13.401348 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 185/381] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:13.407397 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e390ad-1633-4a15-828b-fc41c05bb775 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:13.407883 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e390ad-1633-4a15-828b-fc41c05bb775 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:13.408320 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e390ad-1633-4a15-828b-fc41c05bb775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:13.428118 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-a8e390ad-1633-4a15-828b-fc41c05bb775 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:13.429555 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a8e390ad-1633-4a15-828b-fc41c05bb775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:13.517317 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 197/382] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:13.552626 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759490c0-33e7-42a7-ad77-53676650bdc5 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:13.686462 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759490c0-33e7-42a7-ad77-53676650bdc5 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:13.720932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242fdd8-0eee-4ef9-842b-f039ed8ac070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:13.721724 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242fdd8-0eee-4ef9-842b-f039ed8ac070 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:13.721999 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242fdd8-0eee-4ef9-842b-f039ed8ac070 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:13.722267 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242fdd8-0eee-4ef9-842b-f039ed8ac070 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:13.733790 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242fdd8-0eee-4ef9-842b-f039ed8ac070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:13.740781 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-0242fdd8-0eee-4ef9-842b-f039ed8ac070 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:37:13.742172 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 186/383] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:13.747798 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e390ad-1633-4a15-828b-fc41c05bb775 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:13.857647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e390ad-1633-4a15-828b-fc41c05bb775 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:13.893958 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5675a2-6c51-4030-ae5f-42d57a25741b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:13.894658 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5675a2-6c51-4030-ae5f-42d57a25741b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:13.894947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5675a2-6c51-4030-ae5f-42d57a25741b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:13.895222 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5675a2-6c51-4030-ae5f-42d57a25741b None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:13.895966 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5675a2-6c51-4030-ae5f-42d57a25741b None admin] RBAC: Adding query filter params (name=member) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:13.896272 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5675a2-6c51-4030-ae5f-42d57a25741b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:13.897645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5675a2-6c51-4030-ae5f-42d57a25741b None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:13.909188 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 198/384] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:37:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:13.916168 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242fdd8-0eee-4ef9-842b-f039ed8ac070 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:14.062366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242fdd8-0eee-4ef9-842b-f039ed8ac070 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:14.098756 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe496a51-1c13-4720-a59d-cf4de89d802a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:14.099617 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe496a51-1c13-4720-a59d-cf4de89d802a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:14.099893 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe496a51-1c13-4720-a59d-cf4de89d802a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:14.100162 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe496a51-1c13-4720-a59d-cf4de89d802a None admin] PATH_INFO: `/v3/groups/2b9ae08430d4488499da48f1e7a24622` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:14.107390 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe496a51-1c13-4720-a59d-cf4de89d802a None admin] RBAC: Authorizing `identity:get_group(group_id=2b9ae08430d4488499da48f1e7a24622)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:14.108845 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe496a51-1c13-4720-a59d-cf4de89d802a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:14.110858 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 187/385] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Apr 11 16:37:13 2022] GET /identity/v3/groups/2b9ae08430d4488499da48f1e7a24622 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:14.116220 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5675a2-6c51-4030-ae5f-42d57a25741b None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:14.120539 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1ce80-af4c-43a4-8859-459014c7de88 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:14.120822 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1ce80-af4c-43a4-8859-459014c7de88 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:14.121099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c1ce80-af4c-43a4-8859-459014c7de88 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:14.122406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 188/386] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:37:14.132978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d59b2-0581-4a08-b35d-2cdce3c1b38b None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:14.133251 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d59b2-0581-4a08-b35d-2cdce3c1b38b None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:14.133529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d59b2-0581-4a08-b35d-2cdce3c1b38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:14.163077 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-d78d59b2-0581-4a08-b35d-2cdce3c1b38b None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:14.164243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d78d59b2-0581-4a08-b35d-2cdce3c1b38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:14.288793 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 189/387] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:14.293604 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5675a2-6c51-4030-ae5f-42d57a25741b None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:14.328376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93402ff2-cc6c-453a-9a18-315bcc898de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:14.329289 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93402ff2-cc6c-453a-9a18-315bcc898de2 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:14.329567 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93402ff2-cc6c-453a-9a18-315bcc898de2 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:14.329833 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93402ff2-cc6c-453a-9a18-315bcc898de2 None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:14.331190 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d59b2-0581-4a08-b35d-2cdce3c1b38b None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:14.339424 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93402ff2-cc6c-453a-9a18-315bcc898de2 None admin] RBAC: Authorizing `identity:get_project(project_id=83feba5a40fe4602b9b7b8109feffaf3)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:14.340761 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93402ff2-cc6c-453a-9a18-315bcc898de2 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:14.344286 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 199/388] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:37:14 2022] GET /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:14.349482 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93402ff2-cc6c-453a-9a18-315bcc898de2 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:14.493219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d59b2-0581-4a08-b35d-2cdce3c1b38b None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:14.526880 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93402ff2-cc6c-453a-9a18-315bcc898de2 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:14.550140 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6964d59-81d8-45ad-bbd2-52b67bc29f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:14.550908 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6964d59-81d8-45ad-bbd2-52b67bc29f42 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:14.551194 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6964d59-81d8-45ad-bbd2-52b67bc29f42 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:14.551467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6964d59-81d8-45ad-bbd2-52b67bc29f42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:14.570511 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6964d59-81d8-45ad-bbd2-52b67bc29f42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:14.578007 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-b6964d59-81d8-45ad-bbd2-52b67bc29f42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:37:14.583740 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 190/389] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:37:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:14.594464 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6964d59-81d8-45ad-bbd2-52b67bc29f42 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:14.599053 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350008ff-bcbc-4c6d-a9c4-3fc5d01236d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:14.601001 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350008ff-bcbc-4c6d-a9c4-3fc5d01236d4 None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:14.601472 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350008ff-bcbc-4c6d-a9c4-3fc5d01236d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:14.601926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350008ff-bcbc-4c6d-a9c4-3fc5d01236d4 None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3/groups/2b9ae08430d4488499da48f1e7a24622/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:14.607220 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350008ff-bcbc-4c6d-a9c4-3fc5d01236d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=83feba5a40fe4602b9b7b8109feffaf3, group_id=2b9ae08430d4488499da48f1e7a24622, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:14.609223 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350008ff-bcbc-4c6d-a9c4-3fc5d01236d4 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:14.629731 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 200/390] 10.222.0.73 () {58 vars in 1442 bytes} [Mon Apr 11 16:37:14 2022] PUT /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3/groups/2b9ae08430d4488499da48f1e7a24622/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:37:14.734811 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6964d59-81d8-45ad-bbd2-52b67bc29f42 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:14.781207 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a4f99-625e-481f-bd7e-171061678221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:14.782231 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a4f99-625e-481f-bd7e-171061678221 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:14.782726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a4f99-625e-481f-bd7e-171061678221 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:14.783184 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a4f99-625e-481f-bd7e-171061678221 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:14.784126 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a4f99-625e-481f-bd7e-171061678221 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:14.784615 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a4f99-625e-481f-bd7e-171061678221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:14.786215 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a4f99-625e-481f-bd7e-171061678221 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:14.798865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 191/391] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:14.807804 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350008ff-bcbc-4c6d-a9c4-3fc5d01236d4 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:14.929019 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350008ff-bcbc-4c6d-a9c4-3fc5d01236d4 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:14.963938 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca76db-498e-49ed-953f-f6ffeeccee59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:14.964793 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca76db-498e-49ed-953f-f6ffeeccee59 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:14.965070 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca76db-498e-49ed-953f-f6ffeeccee59 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:14.965337 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca76db-498e-49ed-953f-f6ffeeccee59 None admin] PATH_INFO: `/v3/groups/2b9ae08430d4488499da48f1e7a24622` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:14.966473 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca76db-498e-49ed-953f-f6ffeeccee59 None admin] RBAC: Authorizing `identity:get_group(group_id=2b9ae08430d4488499da48f1e7a24622)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:14.968289 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ca76db-498e-49ed-953f-f6ffeeccee59 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:14.970251 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 201/392] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Apr 11 16:37:14 2022] GET /identity/v3/groups/2b9ae08430d4488499da48f1e7a24622 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:14.976400 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a4f99-625e-481f-bd7e-171061678221 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:15.099238 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a4f99-625e-481f-bd7e-171061678221 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:15.135384 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c9472-ab94-4e0e-b901-1683c025b938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:15.136248 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c9472-ab94-4e0e-b901-1683c025b938 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:15.136526 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c9472-ab94-4e0e-b901-1683c025b938 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:15.136797 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c9472-ab94-4e0e-b901-1683c025b938 None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:15.137978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c9472-ab94-4e0e-b901-1683c025b938 None admin] RBAC: Authorizing `identity:get_project(project_id=83feba5a40fe4602b9b7b8109feffaf3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:15.139432 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c9472-ab94-4e0e-b901-1683c025b938 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:15.141693 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 192/393] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:37:14 2022] GET /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:15.147271 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca76db-498e-49ed-953f-f6ffeeccee59 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:15.252264 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca76db-498e-49ed-953f-f6ffeeccee59 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:15.287979 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f1a2a-7c68-409e-854e-d0083dff04ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:15.288858 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f1a2a-7c68-409e-854e-d0083dff04ba None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:15.289136 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f1a2a-7c68-409e-854e-d0083dff04ba None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:15.289408 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f1a2a-7c68-409e-854e-d0083dff04ba None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3/groups/2b9ae08430d4488499da48f1e7a24622/roles/807f93fb1a91497aba7762557ae039dd` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:15.292277 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f1a2a-7c68-409e-854e-d0083dff04ba None admin] RBAC: Authorizing `identity:create_grant(project_id=83feba5a40fe4602b9b7b8109feffaf3, group_id=2b9ae08430d4488499da48f1e7a24622, role_id=807f93fb1a91497aba7762557ae039dd)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:15.293708 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f1a2a-7c68-409e-854e-d0083dff04ba None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:15.317576 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 202/394] 10.222.0.73 () {58 vars in 1442 bytes} [Mon Apr 11 16:37:15 2022] PUT /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3/groups/2b9ae08430d4488499da48f1e7a24622/roles/807f93fb1a91497aba7762557ae039dd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:37:15.741359 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e1a19-633e-4aba-9d5c-91b6f93b9b16 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:15.742621 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e1a19-633e-4aba-9d5c-91b6f93b9b16 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:15.742842 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e1a19-633e-4aba-9d5c-91b6f93b9b16 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:15.744637 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 193/395] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:15.751312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea81a4-b28d-4fb9-a05d-93b01258f903 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:15.751848 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea81a4-b28d-4fb9-a05d-93b01258f903 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:15.752314 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea81a4-b28d-4fb9-a05d-93b01258f903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:15.770193 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-cfea81a4-b28d-4fb9-a05d-93b01258f903 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:15.771708 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-cfea81a4-b28d-4fb9-a05d-93b01258f903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:15.849390 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 203/396] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:37:15.884334 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e1a19-633e-4aba-9d5c-91b6f93b9b16 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:16.032680 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e1a19-633e-4aba-9d5c-91b6f93b9b16 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:16.075984 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0827593-ea89-4a6e-a9bb-44816a550fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:16.076788 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0827593-ea89-4a6e-a9bb-44816a550fb1 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:16.077065 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0827593-ea89-4a6e-a9bb-44816a550fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:16.077337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0827593-ea89-4a6e-a9bb-44816a550fb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:16.099074 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0827593-ea89-4a6e-a9bb-44816a550fb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:16.106659 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-a0827593-ea89-4a6e-a9bb-44816a550fb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:37:16.108665 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 194/397] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:16.114818 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea81a4-b28d-4fb9-a05d-93b01258f903 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:16.226043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea81a4-b28d-4fb9-a05d-93b01258f903 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:16.268593 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c646a13-5cda-417c-89d5-076f091d3895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:16.269267 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c646a13-5cda-417c-89d5-076f091d3895 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:16.269547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c646a13-5cda-417c-89d5-076f091d3895 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:16.269817 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c646a13-5cda-417c-89d5-076f091d3895 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:16.270554 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c646a13-5cda-417c-89d5-076f091d3895 None admin] RBAC: Adding query filter params (name=member) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:16.270944 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c646a13-5cda-417c-89d5-076f091d3895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:16.272302 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c646a13-5cda-417c-89d5-076f091d3895 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:16.287185 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 204/398] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:37:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:16.288207 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0827593-ea89-4a6e-a9bb-44816a550fb1 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:16.434994 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0827593-ea89-4a6e-a9bb-44816a550fb1 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:16.443241 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ad199-f794-462e-aa95-1e28c62ea031 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:16.443817 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ad199-f794-462e-aa95-1e28c62ea031 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:16.444288 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ad199-f794-462e-aa95-1e28c62ea031 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:16.446114 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 205/399] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:16.451722 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f26aee-5780-4ca7-a811-c82c3461c576 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:16.452249 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f26aee-5780-4ca7-a811-c82c3461c576 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:16.452614 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f26aee-5780-4ca7-a811-c82c3461c576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:16.471043 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3848b9-1819-46ab-9856-3604fa59f4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:16.472031 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3848b9-1819-46ab-9856-3604fa59f4d8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:16.472309 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3848b9-1819-46ab-9856-3604fa59f4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:16.472581 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3848b9-1819-46ab-9856-3604fa59f4d8 None admin] PATH_INFO: `/v3/groups/2b9ae08430d4488499da48f1e7a24622` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:16.478041 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3848b9-1819-46ab-9856-3604fa59f4d8 None admin] RBAC: Authorizing `identity:get_group(group_id=2b9ae08430d4488499da48f1e7a24622)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:16.478041 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3848b9-1819-46ab-9856-3604fa59f4d8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:16.478041 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 195/400] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Apr 11 16:37:16 2022] GET /identity/v3/groups/2b9ae08430d4488499da48f1e7a24622 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:16.482566 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3848b9-1819-46ab-9856-3604fa59f4d8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:16.483641 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-21f26aee-5780-4ca7-a811-c82c3461c576 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:16.485204 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-21f26aee-5780-4ca7-a811-c82c3461c576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:16.612886 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3848b9-1819-46ab-9856-3604fa59f4d8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:16.613377 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 206/401] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:16.614726 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ca031-dcd5-4f56-b3f4-807fbd8cd2cc None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:16.615216 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ca031-dcd5-4f56-b3f4-807fbd8cd2cc None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:16.615677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ca031-dcd5-4f56-b3f4-807fbd8cd2cc None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:16.617189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 207/402] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:16.623629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01936bfb-b71d-4aed-b95b-a528af8d4716 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:16.624199 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01936bfb-b71d-4aed-b95b-a528af8d4716 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:16.624467 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01936bfb-b71d-4aed-b95b-a528af8d4716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:16.651112 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01e56f-e9d6-43a6-9146-9767aa3cc2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:16.652267 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01e56f-e9d6-43a6-9146-9767aa3cc2d2 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:16.652743 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01e56f-e9d6-43a6-9146-9767aa3cc2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:16.653186 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd01e56f-e9d6-43a6-9146-9767aa3cc2d2 None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:16.656472 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01e56f-e9d6-43a6-9146-9767aa3cc2d2 None admin] RBAC: Authorizing `identity:get_project(project_id=e9fda6800be44b51ba84452d77f4ad81)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:16.657773 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-01936bfb-b71d-4aed-b95b-a528af8d4716 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:16.658404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd01e56f-e9d6-43a6-9146-9767aa3cc2d2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:16.658988 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-01936bfb-b71d-4aed-b95b-a528af8d4716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:16.660667 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 196/403] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:37:16 2022] GET /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:16.666826 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01e56f-e9d6-43a6-9146-9767aa3cc2d2 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:16.748326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 208/404] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:16.749564 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01936bfb-b71d-4aed-b95b-a528af8d4716 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:16.779908 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd01e56f-e9d6-43a6-9146-9767aa3cc2d2 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:16.817339 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae47d32-5224-42ff-bb35-a575b9e7e7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:16.818137 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae47d32-5224-42ff-bb35-a575b9e7e7bc None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:16.818422 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae47d32-5224-42ff-bb35-a575b9e7e7bc None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:16.818731 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae47d32-5224-42ff-bb35-a575b9e7e7bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:16.829510 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae47d32-5224-42ff-bb35-a575b9e7e7bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:16.838614 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-aae47d32-5224-42ff-bb35-a575b9e7e7bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:37:16.840213 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 197/405] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:37:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:16.841006 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae47d32-5224-42ff-bb35-a575b9e7e7bc None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:16.874891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01936bfb-b71d-4aed-b95b-a528af8d4716 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:16.916960 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12ae9f-2000-4258-bd06-0309dbde990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:16.918476 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12ae9f-2000-4258-bd06-0309dbde990a None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:16.918795 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12ae9f-2000-4258-bd06-0309dbde990a None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:16.919202 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12ae9f-2000-4258-bd06-0309dbde990a None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81/groups/2b9ae08430d4488499da48f1e7a24622/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:16.923731 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12ae9f-2000-4258-bd06-0309dbde990a None admin] RBAC: Authorizing `identity:create_grant(project_id=e9fda6800be44b51ba84452d77f4ad81, group_id=2b9ae08430d4488499da48f1e7a24622, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:16.925178 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d12ae9f-2000-4258-bd06-0309dbde990a None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:16.953466 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 209/406] 10.222.0.73 () {58 vars in 1442 bytes} [Mon Apr 11 16:37:16 2022] PUT /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81/groups/2b9ae08430d4488499da48f1e7a24622/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:37:16.954671 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12ae9f-2000-4258-bd06-0309dbde990a None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:16.965532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae47d32-5224-42ff-bb35-a575b9e7e7bc None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:17.004145 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d1623-f20a-434d-9ffd-66b21fcbb31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:17.004889 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d1623-f20a-434d-9ffd-66b21fcbb31d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:17.005271 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d1623-f20a-434d-9ffd-66b21fcbb31d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:17.005612 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d1623-f20a-434d-9ffd-66b21fcbb31d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:17.017976 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d1623-f20a-434d-9ffd-66b21fcbb31d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:17.026435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-c37d1623-f20a-434d-9ffd-66b21fcbb31d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:37:17.028221 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 198/407] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:37:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:17.035675 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d1623-f20a-434d-9ffd-66b21fcbb31d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:17.073317 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12ae9f-2000-4258-bd06-0309dbde990a None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:17.109761 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc4e2b-ba98-4b33-9d38-4d5c322b6d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:17.110829 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc4e2b-ba98-4b33-9d38-4d5c322b6d4a None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:17.111318 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc4e2b-ba98-4b33-9d38-4d5c322b6d4a None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:17.111794 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cc4e2b-ba98-4b33-9d38-4d5c322b6d4a None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:17.112774 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc4e2b-ba98-4b33-9d38-4d5c322b6d4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:17.113314 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc4e2b-ba98-4b33-9d38-4d5c322b6d4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:17.116101 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cc4e2b-ba98-4b33-9d38-4d5c322b6d4a None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:17.125602 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 210/408] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:17.132948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc4e2b-ba98-4b33-9d38-4d5c322b6d4a None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:17.156368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d1623-f20a-434d-9ffd-66b21fcbb31d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:17.203507 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c2bca-a117-4ec0-b4b8-e0fc4cb672cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:17.204194 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2bca-a117-4ec0-b4b8-e0fc4cb672cb None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:17.204474 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2bca-a117-4ec0-b4b8-e0fc4cb672cb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:17.204745 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c2bca-a117-4ec0-b4b8-e0fc4cb672cb None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:17.205506 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c2bca-a117-4ec0-b4b8-e0fc4cb672cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:17.205809 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c2bca-a117-4ec0-b4b8-e0fc4cb672cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:17.207235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c2bca-a117-4ec0-b4b8-e0fc4cb672cb None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:17.230858 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 199/409] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:17.237709 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c2bca-a117-4ec0-b4b8-e0fc4cb672cb None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:17.247870 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cc4e2b-ba98-4b33-9d38-4d5c322b6d4a None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:17.293369 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b15d1-dbc0-4e70-9dad-350759df3654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:17.294631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b15d1-dbc0-4e70-9dad-350759df3654 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:17.295123 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b15d1-dbc0-4e70-9dad-350759df3654 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:17.295594 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6b15d1-dbc0-4e70-9dad-350759df3654 None admin] PATH_INFO: `/v3/groups/014af3157a624ee3be4e51d6d4f9f974` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:17.296993 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b15d1-dbc0-4e70-9dad-350759df3654 None admin] RBAC: Authorizing `identity:get_group(group_id=014af3157a624ee3be4e51d6d4f9f974)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:17.298702 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6b15d1-dbc0-4e70-9dad-350759df3654 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:17.300566 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 211/410] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Apr 11 16:37:17 2022] GET /identity/v3/groups/014af3157a624ee3be4e51d6d4f9f974 => generated 229 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:17.309760 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b15d1-dbc0-4e70-9dad-350759df3654 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:17.383139 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c2bca-a117-4ec0-b4b8-e0fc4cb672cb None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:17.418232 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83167fb3-b438-467e-8305-8fd548f060ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:17.419123 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83167fb3-b438-467e-8305-8fd548f060ee None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:17.419407 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83167fb3-b438-467e-8305-8fd548f060ee None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:17.419682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83167fb3-b438-467e-8305-8fd548f060ee None admin] PATH_INFO: `/v3/groups/2b9ae08430d4488499da48f1e7a24622` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:17.420166 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6b15d1-dbc0-4e70-9dad-350759df3654 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:17.420942 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83167fb3-b438-467e-8305-8fd548f060ee None admin] RBAC: Authorizing `identity:get_group(group_id=2b9ae08430d4488499da48f1e7a24622)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:17.422481 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83167fb3-b438-467e-8305-8fd548f060ee None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:17.425525 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 200/411] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Apr 11 16:37:17 2022] GET /identity/v3/groups/2b9ae08430d4488499da48f1e7a24622 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:17.430171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83167fb3-b438-467e-8305-8fd548f060ee None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:17.456252 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee2737-cdf6-4d10-86ef-cbcbb4490cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:17.457351 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee2737-cdf6-4d10-86ef-cbcbb4490cd5 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:17.457800 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee2737-cdf6-4d10-86ef-cbcbb4490cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:17.458218 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbee2737-cdf6-4d10-86ef-cbcbb4490cd5 None admin] PATH_INFO: `/v3/projects/f8c9bf4c662c47e3808d264d2ea01d67` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:17.459568 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee2737-cdf6-4d10-86ef-cbcbb4490cd5 None admin] RBAC: Authorizing `identity:get_project(project_id=f8c9bf4c662c47e3808d264d2ea01d67)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:17.461210 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbee2737-cdf6-4d10-86ef-cbcbb4490cd5 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:17.463720 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 212/412] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:37:17 2022] GET /identity/v3/projects/f8c9bf4c662c47e3808d264d2ea01d67 => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:17.469694 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee2737-cdf6-4d10-86ef-cbcbb4490cd5 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:17.543343 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83167fb3-b438-467e-8305-8fd548f060ee None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:17.602488 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbee2737-cdf6-4d10-86ef-cbcbb4490cd5 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:17.605952 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c4b4e-7668-4149-9a52-c79f9e8f5adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:17.606833 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c4b4e-7668-4149-9a52-c79f9e8f5adc None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:17.607109 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c4b4e-7668-4149-9a52-c79f9e8f5adc None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:17.607377 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c4b4e-7668-4149-9a52-c79f9e8f5adc None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:17.612624 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c4b4e-7668-4149-9a52-c79f9e8f5adc None admin] RBAC: Authorizing `identity:get_project(project_id=e9fda6800be44b51ba84452d77f4ad81)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:17.614062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c4b4e-7668-4149-9a52-c79f9e8f5adc None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:17.616108 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 201/413] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:37:17 2022] GET /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:17.623708 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c4b4e-7668-4149-9a52-c79f9e8f5adc None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:17.671479 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf7ad7f-6db5-4afb-9525-d2807f21f4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:17.672292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7ad7f-6db5-4afb-9525-d2807f21f4ad None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:17.672633 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7ad7f-6db5-4afb-9525-d2807f21f4ad None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:17.673047 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf7ad7f-6db5-4afb-9525-d2807f21f4ad None admin] PATH_INFO: `/v3/projects/f8c9bf4c662c47e3808d264d2ea01d67/groups/014af3157a624ee3be4e51d6d4f9f974/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:17.675686 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7ad7f-6db5-4afb-9525-d2807f21f4ad None admin] RBAC: Authorizing `identity:create_grant(project_id=f8c9bf4c662c47e3808d264d2ea01d67, group_id=014af3157a624ee3be4e51d6d4f9f974, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:17.677654 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf7ad7f-6db5-4afb-9525-d2807f21f4ad None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:17.696259 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 213/414] 10.222.0.73 () {58 vars in 1442 bytes} [Mon Apr 11 16:37:17 2022] PUT /identity/v3/projects/f8c9bf4c662c47e3808d264d2ea01d67/groups/014af3157a624ee3be4e51d6d4f9f974/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:37:17.698661 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c1ec5-34d9-43e2-b77c-0fb8736e35e4 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:17.699006 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c1ec5-34d9-43e2-b77c-0fb8736e35e4 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:17.699293 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3c1ec5-34d9-43e2-b77c-0fb8736e35e4 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:17.701056 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 214/415] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:17.721296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d329f5c-0917-4bb0-973a-787dbb15b177 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:17.721794 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d329f5c-0917-4bb0-973a-787dbb15b177 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:17.722136 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d329f5c-0917-4bb0-973a-787dbb15b177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:17.754741 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-7d329f5c-0917-4bb0-973a-787dbb15b177 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:17.756062 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-7d329f5c-0917-4bb0-973a-787dbb15b177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:17.831176 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c4b4e-7668-4149-9a52-c79f9e8f5adc None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:17.848629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 215/416] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:17.874048 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802060c-65eb-440b-a17c-0576b4e26a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:17.874972 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802060c-65eb-440b-a17c-0576b4e26a46 None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:17.875253 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802060c-65eb-440b-a17c-0576b4e26a46 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:17.875529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d802060c-65eb-440b-a17c-0576b4e26a46 None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81/groups/2b9ae08430d4488499da48f1e7a24622/roles/807f93fb1a91497aba7762557ae039dd` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:17.877888 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802060c-65eb-440b-a17c-0576b4e26a46 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9fda6800be44b51ba84452d77f4ad81, group_id=2b9ae08430d4488499da48f1e7a24622, role_id=807f93fb1a91497aba7762557ae039dd)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:17.879505 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d802060c-65eb-440b-a17c-0576b4e26a46 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:17.888584 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d329f5c-0917-4bb0-973a-787dbb15b177 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:17.911733 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 202/417] 10.222.0.73 () {58 vars in 1442 bytes} [Mon Apr 11 16:37:17 2022] PUT /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81/groups/2b9ae08430d4488499da48f1e7a24622/roles/807f93fb1a91497aba7762557ae039dd => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:37:18.013909 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d329f5c-0917-4bb0-973a-787dbb15b177 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:18.052443 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487c768-d510-4e48-8bd0-b8ba40928e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:18.053310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487c768-d510-4e48-8bd0-b8ba40928e41 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:18.053588 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487c768-d510-4e48-8bd0-b8ba40928e41 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:18.053860 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487c768-d510-4e48-8bd0-b8ba40928e41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:18.067270 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487c768-d510-4e48-8bd0-b8ba40928e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:18.075084 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-1487c768-d510-4e48-8bd0-b8ba40928e41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:37:18.076723 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 216/418] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:18.082541 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802060c-65eb-440b-a17c-0576b4e26a46 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:18.196543 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d802060c-65eb-440b-a17c-0576b4e26a46 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:18.233721 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49020d4-a380-4e76-bd4c-0cbac6b73203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:18.234784 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49020d4-a380-4e76-bd4c-0cbac6b73203 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:18.235275 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49020d4-a380-4e76-bd4c-0cbac6b73203 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:18.235750 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49020d4-a380-4e76-bd4c-0cbac6b73203 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:18.236749 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49020d4-a380-4e76-bd4c-0cbac6b73203 None admin] RBAC: Adding query filter params (name=member) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:18.237255 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49020d4-a380-4e76-bd4c-0cbac6b73203 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:18.238902 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49020d4-a380-4e76-bd4c-0cbac6b73203 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:18.248188 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 203/419] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:37:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:18.254043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487c768-d510-4e48-8bd0-b8ba40928e41 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:18.370050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487c768-d510-4e48-8bd0-b8ba40928e41 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:18.404700 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08780f22-3c6c-4242-b369-140d305d2fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:18.405347 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08780f22-3c6c-4242-b369-140d305d2fd1 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:18.405623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08780f22-3c6c-4242-b369-140d305d2fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:18.405895 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08780f22-3c6c-4242-b369-140d305d2fd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:18.474372 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08780f22-3c6c-4242-b369-140d305d2fd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:18.475763 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08780f22-3c6c-4242-b369-140d305d2fd1 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:18.578958 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 217/420] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:18.580574 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49020d4-a380-4e76-bd4c-0cbac6b73203 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:18.587174 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d848b-8f95-4b33-9a31-2823333ffb56 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:18.587455 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d848b-8f95-4b33-9a31-2823333ffb56 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:18.587774 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d848b-8f95-4b33-9a31-2823333ffb56 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:18.589340 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 218/421] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:37:18.595567 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39349223-e43a-4fea-bccb-cc26f40e3445 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:18.595850 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39349223-e43a-4fea-bccb-cc26f40e3445 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:18.596124 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39349223-e43a-4fea-bccb-cc26f40e3445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:18.619408 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-39349223-e43a-4fea-bccb-cc26f40e3445 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:18.620647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-39349223-e43a-4fea-bccb-cc26f40e3445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:18.715503 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49020d4-a380-4e76-bd4c-0cbac6b73203 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:18.754010 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 219/422] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:18.763883 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb5cce-c584-4efd-bf7e-7a52b8f8c61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:18.765000 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb5cce-c584-4efd-bf7e-7a52b8f8c61d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:18.765760 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb5cce-c584-4efd-bf7e-7a52b8f8c61d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:18.766233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb5cce-c584-4efd-bf7e-7a52b8f8c61d None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:18.767677 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb5cce-c584-4efd-bf7e-7a52b8f8c61d None admin] RBAC: Authorizing `identity:get_project(project_id=83feba5a40fe4602b9b7b8109feffaf3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:18.769326 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb5cce-c584-4efd-bf7e-7a52b8f8c61d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:18.771282 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 204/423] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:37:18 2022] GET /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:18.776868 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39349223-e43a-4fea-bccb-cc26f40e3445 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:18.790028 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb5cce-c584-4efd-bf7e-7a52b8f8c61d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:18.919651 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb5cce-c584-4efd-bf7e-7a52b8f8c61d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:18.920259 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39349223-e43a-4fea-bccb-cc26f40e3445 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:18.970949 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70cc33-75ea-49d5-8ebf-a35dd08d52cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:18.971801 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70cc33-75ea-49d5-8ebf-a35dd08d52cb None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:18.972249 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70cc33-75ea-49d5-8ebf-a35dd08d52cb None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:18.972668 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70cc33-75ea-49d5-8ebf-a35dd08d52cb None admin] PATH_INFO: `/v3/groups/2b9ae08430d4488499da48f1e7a24622` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:18.973603 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83bedd-52c8-429c-8cf7-74782d8bd64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:18.974171 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70cc33-75ea-49d5-8ebf-a35dd08d52cb None admin] RBAC: Authorizing `identity:get_group(group_id=2b9ae08430d4488499da48f1e7a24622)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:18.974402 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83bedd-52c8-429c-8cf7-74782d8bd64a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:18.974763 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83bedd-52c8-429c-8cf7-74782d8bd64a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:18.975076 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83bedd-52c8-429c-8cf7-74782d8bd64a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:18.976235 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70cc33-75ea-49d5-8ebf-a35dd08d52cb None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:18.979101 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 220/424] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Apr 11 16:37:18 2022] GET /identity/v3/groups/2b9ae08430d4488499da48f1e7a24622 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:18.984899 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70cc33-75ea-49d5-8ebf-a35dd08d52cb None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:18.993228 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a83bedd-52c8-429c-8cf7-74782d8bd64a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:19.008633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-2a83bedd-52c8-429c-8cf7-74782d8bd64a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:37:19.010744 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 205/425] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:37:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:19.016935 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83bedd-52c8-429c-8cf7-74782d8bd64a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:19.123784 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70cc33-75ea-49d5-8ebf-a35dd08d52cb None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:19.160395 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26ebd9-59ff-4aa3-b53e-0bdb33f8fda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:19.161443 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26ebd9-59ff-4aa3-b53e-0bdb33f8fda1 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:19.161926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26ebd9-59ff-4aa3-b53e-0bdb33f8fda1 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:19.162368 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26ebd9-59ff-4aa3-b53e-0bdb33f8fda1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:19.163417 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26ebd9-59ff-4aa3-b53e-0bdb33f8fda1 None admin] RBAC: Adding query filter params (group.id=2b9ae08430d4488499da48f1e7a24622, role.id=7695974856564d4289ab64dbf6dcc119, scope.project.id=83feba5a40fe4602b9b7b8109feffaf3) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:19.164652 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26ebd9-59ff-4aa3-b53e-0bdb33f8fda1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:19.166806 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26ebd9-59ff-4aa3-b53e-0bdb33f8fda1 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:19.179275 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 221/426] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Apr 11 16:37:18 2022] GET /identity/v3/role_assignments?group.id=2b9ae08430d4488499da48f1e7a24622&scope.project.id=83feba5a40fe4602b9b7b8109feffaf3&role.id=7695974856564d4289ab64dbf6dcc119 => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:19.231316 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a83bedd-52c8-429c-8cf7-74782d8bd64a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:19.279070 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f9845-50a9-4e24-a49c-46ce213c3644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:19.279656 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f9845-50a9-4e24-a49c-46ce213c3644 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:19.279935 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f9845-50a9-4e24-a49c-46ce213c3644 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:19.280208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f9845-50a9-4e24-a49c-46ce213c3644 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:19.280949 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f9845-50a9-4e24-a49c-46ce213c3644 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:19.281249 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f9845-50a9-4e24-a49c-46ce213c3644 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:19.282615 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1f9845-50a9-4e24-a49c-46ce213c3644 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:19.295062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 206/427] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:19.300533 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26ebd9-59ff-4aa3-b53e-0bdb33f8fda1 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:19.431022 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26ebd9-59ff-4aa3-b53e-0bdb33f8fda1 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:19.468276 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a1982-838b-48a9-bc5c-7fd9ffd53a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:19.469191 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a1982-838b-48a9-bc5c-7fd9ffd53a1c None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:19.469643 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a1982-838b-48a9-bc5c-7fd9ffd53a1c None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:19.470076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a1982-838b-48a9-bc5c-7fd9ffd53a1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:19.540196 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a1982-838b-48a9-bc5c-7fd9ffd53a1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:19.541968 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a1982-838b-48a9-bc5c-7fd9ffd53a1c None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:19.645676 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 222/428] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:19.651519 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f9845-50a9-4e24-a49c-46ce213c3644 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:19.782090 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f9845-50a9-4e24-a49c-46ce213c3644 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:19.821173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2291b3e-3b5e-411c-bd2c-d0e8b18ca7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:19.822048 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2291b3e-3b5e-411c-bd2c-d0e8b18ca7b0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:19.822335 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2291b3e-3b5e-411c-bd2c-d0e8b18ca7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:19.822698 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2291b3e-3b5e-411c-bd2c-d0e8b18ca7b0 None admin] PATH_INFO: `/v3/projects/83feba5a40fe4602b9b7b8109feffaf3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:19.823910 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2291b3e-3b5e-411c-bd2c-d0e8b18ca7b0 None admin] RBAC: Authorizing `identity:get_project(project_id=83feba5a40fe4602b9b7b8109feffaf3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:19.825328 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2291b3e-3b5e-411c-bd2c-d0e8b18ca7b0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:19.827415 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 207/429] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:37:19 2022] GET /identity/v3/projects/83feba5a40fe4602b9b7b8109feffaf3 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:19.835373 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a1982-838b-48a9-bc5c-7fd9ffd53a1c None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:19.941668 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a1982-838b-48a9-bc5c-7fd9ffd53a1c None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:19.983334 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804986f-b775-42c2-9cfa-e66e7b22c73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:19.984569 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804986f-b775-42c2-9cfa-e66e7b22c73c None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:19.985064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804986f-b775-42c2-9cfa-e66e7b22c73c None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:19.985536 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804986f-b775-42c2-9cfa-e66e7b22c73c None admin] PATH_INFO: `/v3/groups/2b9ae08430d4488499da48f1e7a24622` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:19.987006 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804986f-b775-42c2-9cfa-e66e7b22c73c None admin] RBAC: Authorizing `identity:get_group(group_id=2b9ae08430d4488499da48f1e7a24622)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:19.988704 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804986f-b775-42c2-9cfa-e66e7b22c73c None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:19.990898 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 223/430] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Apr 11 16:37:19 2022] GET /identity/v3/groups/2b9ae08430d4488499da48f1e7a24622 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:19.999699 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2291b3e-3b5e-411c-bd2c-d0e8b18ca7b0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:20.112480 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2291b3e-3b5e-411c-bd2c-d0e8b18ca7b0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:20.149527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e131952-5b17-4f8e-896c-6cca66481eda None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:20.150325 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e131952-5b17-4f8e-896c-6cca66481eda None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:20.150968 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e131952-5b17-4f8e-896c-6cca66481eda None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:20.151429 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a2a6f-711c-456d-9abe-c8d933ad69cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:20.152092 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a2a6f-711c-456d-9abe-c8d933ad69cf None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:20.152373 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a2a6f-711c-456d-9abe-c8d933ad69cf None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:20.152649 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a2a6f-711c-456d-9abe-c8d933ad69cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:20.153641 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a2a6f-711c-456d-9abe-c8d933ad69cf None admin] RBAC: Adding query filter params (group.id=2b9ae08430d4488499da48f1e7a24622, role.id=807f93fb1a91497aba7762557ae039dd, scope.project.id=83feba5a40fe4602b9b7b8109feffaf3) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:20.153882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 224/431] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:37:20.153985 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a2a6f-711c-456d-9abe-c8d933ad69cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:20.157913 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a2a6f-711c-456d-9abe-c8d933ad69cf None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:20.159467 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2febab1-0722-41af-97c3-6f5dbe3ea7fc None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:20.159976 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2febab1-0722-41af-97c3-6f5dbe3ea7fc None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:20.160458 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2febab1-0722-41af-97c3-6f5dbe3ea7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:20.164063 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 208/432] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Apr 11 16:37:19 2022] GET /identity/v3/role_assignments?group.id=2b9ae08430d4488499da48f1e7a24622&scope.project.id=83feba5a40fe4602b9b7b8109feffaf3&role.id=807f93fb1a91497aba7762557ae039dd => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:20.182619 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-f2febab1-0722-41af-97c3-6f5dbe3ea7fc None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:20.186615 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f2febab1-0722-41af-97c3-6f5dbe3ea7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:20.262622 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 225/433] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:20.287162 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a2a6f-711c-456d-9abe-c8d933ad69cf None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:20.399395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a2a6f-711c-456d-9abe-c8d933ad69cf None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:20.439107 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dd61a-6c59-4e12-bbea-d9b56b65987c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:20.439898 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dd61a-6c59-4e12-bbea-d9b56b65987c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:20.440181 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dd61a-6c59-4e12-bbea-d9b56b65987c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:20.440459 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8dd61a-6c59-4e12-bbea-d9b56b65987c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:20.451451 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8dd61a-6c59-4e12-bbea-d9b56b65987c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:20.458474 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-0b8dd61a-6c59-4e12-bbea-d9b56b65987c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 16:37:20.460714 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 209/434] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:20.467440 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2febab1-0722-41af-97c3-6f5dbe3ea7fc None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:20.571566 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2febab1-0722-41af-97c3-6f5dbe3ea7fc None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:20.607834 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ca93f-e176-481c-b56c-8d70bf08866f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:20.608832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ca93f-e176-481c-b56c-8d70bf08866f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:20.609302 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ca93f-e176-481c-b56c-8d70bf08866f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:20.609766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ca93f-e176-481c-b56c-8d70bf08866f None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:20.610736 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ca93f-e176-481c-b56c-8d70bf08866f None admin] RBAC: Adding query filter params (name=member) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:20.611232 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ca93f-e176-481c-b56c-8d70bf08866f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:20.612863 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ca93f-e176-481c-b56c-8d70bf08866f None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:20.625060 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 226/435] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:37:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:20.628406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dd61a-6c59-4e12-bbea-d9b56b65987c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:20.649707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e3cb3-985e-4480-b756-402264333bc9 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:20.650884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e3cb3-985e-4480-b756-402264333bc9 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:20.651396 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e3cb3-985e-4480-b756-402264333bc9 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:20.653237 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 227/436] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:20.658143 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442082f-8a0c-4b94-8293-dc4aae728780 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:20.658647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442082f-8a0c-4b94-8293-dc4aae728780 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:20.659072 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442082f-8a0c-4b94-8293-dc4aae728780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:20.675606 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-7442082f-8a0c-4b94-8293-dc4aae728780 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:20.676755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-7442082f-8a0c-4b94-8293-dc4aae728780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:20.738725 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8dd61a-6c59-4e12-bbea-d9b56b65987c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:20.742519 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 228/437] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:37:20.744503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cd2ce-cf20-4d4e-bdc7-7abc05d30fbd None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:20.744789 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cd2ce-cf20-4d4e-bdc7-7abc05d30fbd None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:20.745064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053cd2ce-cf20-4d4e-bdc7-7abc05d30fbd None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:20.746439 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 229/438] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:20.751515 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440c1fc-116b-4c17-bf1d-a451b5010c75 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:20.751801 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440c1fc-116b-4c17-bf1d-a451b5010c75 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:20.752073 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1440c1fc-116b-4c17-bf1d-a451b5010c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:20.768726 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-1440c1fc-116b-4c17-bf1d-a451b5010c75 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:20.769899 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-1440c1fc-116b-4c17-bf1d-a451b5010c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:20.772475 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6959d-c719-4181-8504-ee66bb76e08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:20.773119 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6959d-c719-4181-8504-ee66bb76e08b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:20.773403 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6959d-c719-4181-8504-ee66bb76e08b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:20.773686 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6959d-c719-4181-8504-ee66bb76e08b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:20.832340 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 230/439] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:37:20.833495 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440c1fc-116b-4c17-bf1d-a451b5010c75 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:20.838068 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6959d-c719-4181-8504-ee66bb76e08b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:20.839540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6959d-c719-4181-8504-ee66bb76e08b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:20.926575 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1440c1fc-116b-4c17-bf1d-a451b5010c75 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:20.933407 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 210/440] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:20.934239 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6959d-c719-4181-8504-ee66bb76e08b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:20.959677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fe658-e34c-497c-b438-1b5e2f497ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:20.960462 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fe658-e34c-497c-b438-1b5e2f497ce7 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:20.960741 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fe658-e34c-497c-b438-1b5e2f497ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:20.961012 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fe658-e34c-497c-b438-1b5e2f497ce7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:20.970474 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fe658-e34c-497c-b438-1b5e2f497ce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:20.977294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-165fe658-e34c-497c-b438-1b5e2f497ce7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:37:20.978503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 231/441] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:37:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:20.979286 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fe658-e34c-497c-b438-1b5e2f497ce7 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:21.026052 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6959d-c719-4181-8504-ee66bb76e08b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:21.057319 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198788dd-1a14-4d15-ae28-67cd6f0a12fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:21.058123 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198788dd-1a14-4d15-ae28-67cd6f0a12fd None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:21.058404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198788dd-1a14-4d15-ae28-67cd6f0a12fd None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:21.058707 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198788dd-1a14-4d15-ae28-67cd6f0a12fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:21.068234 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198788dd-1a14-4d15-ae28-67cd6f0a12fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:21.072740 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fe658-e34c-497c-b438-1b5e2f497ce7 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:21.076442 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-198788dd-1a14-4d15-ae28-67cd6f0a12fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:37:21.077619 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 211/442] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:37:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:21.078388 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198788dd-1a14-4d15-ae28-67cd6f0a12fd None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:21.104680 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75497817-f6a1-437b-9137-e8cece5a4161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:21.105535 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75497817-f6a1-437b-9137-e8cece5a4161 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:21.105816 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75497817-f6a1-437b-9137-e8cece5a4161 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:21.106090 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75497817-f6a1-437b-9137-e8cece5a4161 None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:21.107268 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75497817-f6a1-437b-9137-e8cece5a4161 None admin] RBAC: Authorizing `identity:get_project(project_id=e9fda6800be44b51ba84452d77f4ad81)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:21.108716 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75497817-f6a1-437b-9137-e8cece5a4161 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:21.110380 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 232/443] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:37:20 2022] GET /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81 => generated 302 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:21.111236 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75497817-f6a1-437b-9137-e8cece5a4161 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:21.171505 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198788dd-1a14-4d15-ae28-67cd6f0a12fd None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:21.202786 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf94ec-6ce6-4819-a5f9-cc4e5de14850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:21.203376 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf94ec-6ce6-4819-a5f9-cc4e5de14850 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:21.203654 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf94ec-6ce6-4819-a5f9-cc4e5de14850 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:21.203926 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf94ec-6ce6-4819-a5f9-cc4e5de14850 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:21.204389 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75497817-f6a1-437b-9137-e8cece5a4161 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:21.204661 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf94ec-6ce6-4819-a5f9-cc4e5de14850 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:21.204987 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf94ec-6ce6-4819-a5f9-cc4e5de14850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:21.206317 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdf94ec-6ce6-4819-a5f9-cc4e5de14850 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:21.214031 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 212/444] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:21.214831 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf94ec-6ce6-4819-a5f9-cc4e5de14850 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:21.240775 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614da43f-0ba5-466e-aed3-2baa4e1772e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:21.241430 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614da43f-0ba5-466e-aed3-2baa4e1772e7 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:21.241709 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614da43f-0ba5-466e-aed3-2baa4e1772e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:21.241983 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614da43f-0ba5-466e-aed3-2baa4e1772e7 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:21.242748 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614da43f-0ba5-466e-aed3-2baa4e1772e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:21.243051 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614da43f-0ba5-466e-aed3-2baa4e1772e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:21.244962 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614da43f-0ba5-466e-aed3-2baa4e1772e7 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:21.252388 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 233/445] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:21.253158 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614da43f-0ba5-466e-aed3-2baa4e1772e7 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:21.308828 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdf94ec-6ce6-4819-a5f9-cc4e5de14850 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:21.339450 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95cd84-6f2f-41d0-8a43-0dd7ee9f652a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:21.340294 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95cd84-6f2f-41d0-8a43-0dd7ee9f652a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:21.340580 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95cd84-6f2f-41d0-8a43-0dd7ee9f652a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:21.340858 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95cd84-6f2f-41d0-8a43-0dd7ee9f652a None admin] PATH_INFO: `/v3/groups/2b9ae08430d4488499da48f1e7a24622` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:21.342024 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95cd84-6f2f-41d0-8a43-0dd7ee9f652a None admin] RBAC: Authorizing `identity:get_group(group_id=2b9ae08430d4488499da48f1e7a24622)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:21.343477 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95cd84-6f2f-41d0-8a43-0dd7ee9f652a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:21.343843 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614da43f-0ba5-466e-aed3-2baa4e1772e7 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:21.345087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 213/446] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Apr 11 16:37:21 2022] GET /identity/v3/groups/2b9ae08430d4488499da48f1e7a24622 => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:21.345932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95cd84-6f2f-41d0-8a43-0dd7ee9f652a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:21.377166 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57054630-fec6-43bf-9278-925de0c5a542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:21.377801 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57054630-fec6-43bf-9278-925de0c5a542 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:21.378083 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57054630-fec6-43bf-9278-925de0c5a542 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:21.378365 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57054630-fec6-43bf-9278-925de0c5a542 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:21.439144 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95cd84-6f2f-41d0-8a43-0dd7ee9f652a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:21.440963 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57054630-fec6-43bf-9278-925de0c5a542 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:21.442405 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57054630-fec6-43bf-9278-925de0c5a542 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:21.470457 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ef9e1-9a90-42b5-990f-bdb0ff81a8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:21.471057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ef9e1-9a90-42b5-990f-bdb0ff81a8ea None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:21.471342 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ef9e1-9a90-42b5-990f-bdb0ff81a8ea None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:21.471619 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ef9e1-9a90-42b5-990f-bdb0ff81a8ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:21.532907 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 234/447] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:21.533720 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57054630-fec6-43bf-9278-925de0c5a542 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:21.535371 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ef9e1-9a90-42b5-990f-bdb0ff81a8ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:21.536819 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ef9e1-9a90-42b5-990f-bdb0ff81a8ea None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:21.629135 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 214/448] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:21.629974 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ef9e1-9a90-42b5-990f-bdb0ff81a8ea None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:21.631031 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57054630-fec6-43bf-9278-925de0c5a542 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:21.663026 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdf365-6551-4f4c-89de-795aec1b8db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:21.663661 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdf365-6551-4f4c-89de-795aec1b8db8 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:21.663938 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdf365-6551-4f4c-89de-795aec1b8db8 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:21.664207 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbdf365-6551-4f4c-89de-795aec1b8db8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:21.665017 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdf365-6551-4f4c-89de-795aec1b8db8 None admin] RBAC: Adding query filter params (group.id=2b9ae08430d4488499da48f1e7a24622, role.id=7695974856564d4289ab64dbf6dcc119, scope.project.id=e9fda6800be44b51ba84452d77f4ad81) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:21.665319 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdf365-6551-4f4c-89de-795aec1b8db8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:21.667330 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbdf365-6551-4f4c-89de-795aec1b8db8 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:21.673099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 235/449] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Apr 11 16:37:21 2022] GET /identity/v3/role_assignments?group.id=2b9ae08430d4488499da48f1e7a24622&scope.project.id=e9fda6800be44b51ba84452d77f4ad81&role.id=7695974856564d4289ab64dbf6dcc119 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:21.673876 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdf365-6551-4f4c-89de-795aec1b8db8 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:21.732330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ef9e1-9a90-42b5-990f-bdb0ff81a8ea None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:21.768116 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f15305-25d1-492e-b70a-beb57e32cb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:21.769016 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f15305-25d1-492e-b70a-beb57e32cb7a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:21.769296 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f15305-25d1-492e-b70a-beb57e32cb7a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:21.769566 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f15305-25d1-492e-b70a-beb57e32cb7a None admin] PATH_INFO: `/v3/projects/f8c9bf4c662c47e3808d264d2ea01d67` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:21.770854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f15305-25d1-492e-b70a-beb57e32cb7a None admin] RBAC: Authorizing `identity:get_project(project_id=f8c9bf4c662c47e3808d264d2ea01d67)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:21.772330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f15305-25d1-492e-b70a-beb57e32cb7a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:21.774279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 215/450] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:37:21 2022] GET /identity/v3/projects/f8c9bf4c662c47e3808d264d2ea01d67 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:21.780727 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f15305-25d1-492e-b70a-beb57e32cb7a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:21.803056 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbdf365-6551-4f4c-89de-795aec1b8db8 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:21.838254 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158dbc1-aec3-42b9-89d3-36bfb5833a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:21.839161 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158dbc1-aec3-42b9-89d3-36bfb5833a6c None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:21.839439 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158dbc1-aec3-42b9-89d3-36bfb5833a6c None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:21.839707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0158dbc1-aec3-42b9-89d3-36bfb5833a6c None admin] PATH_INFO: `/v3/projects/e9fda6800be44b51ba84452d77f4ad81` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:21.841077 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158dbc1-aec3-42b9-89d3-36bfb5833a6c None admin] RBAC: Authorizing `identity:get_project(project_id=e9fda6800be44b51ba84452d77f4ad81)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:21.842534 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0158dbc1-aec3-42b9-89d3-36bfb5833a6c None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:21.844247 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 236/451] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:37:21 2022] GET /identity/v3/projects/e9fda6800be44b51ba84452d77f4ad81 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:21.849823 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158dbc1-aec3-42b9-89d3-36bfb5833a6c None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:21.884029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f15305-25d1-492e-b70a-beb57e32cb7a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:21.923358 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4cc90-7de3-4375-9a47-f8bf9f71cd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:21.924566 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4cc90-7de3-4375-9a47-f8bf9f71cd66 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:21.924847 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4cc90-7de3-4375-9a47-f8bf9f71cd66 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:21.925183 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4cc90-7de3-4375-9a47-f8bf9f71cd66 None admin] PATH_INFO: `/v3/groups/014af3157a624ee3be4e51d6d4f9f974` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:21.926435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4cc90-7de3-4375-9a47-f8bf9f71cd66 None admin] RBAC: Authorizing `identity:get_group(group_id=014af3157a624ee3be4e51d6d4f9f974)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:21.927990 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c4cc90-7de3-4375-9a47-f8bf9f71cd66 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:21.929943 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 216/452] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Apr 11 16:37:21 2022] GET /identity/v3/groups/014af3157a624ee3be4e51d6d4f9f974 => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:21.935381 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4cc90-7de3-4375-9a47-f8bf9f71cd66 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:21.956394 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0158dbc1-aec3-42b9-89d3-36bfb5833a6c None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:21.992887 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e58759-fa76-45cf-b242-ab70953eb684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:21.993795 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e58759-fa76-45cf-b242-ab70953eb684 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:21.994129 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e58759-fa76-45cf-b242-ab70953eb684 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:21.994484 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e58759-fa76-45cf-b242-ab70953eb684 None admin] PATH_INFO: `/v3/groups/2b9ae08430d4488499da48f1e7a24622` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:21.995835 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e58759-fa76-45cf-b242-ab70953eb684 None admin] RBAC: Authorizing `identity:get_group(group_id=2b9ae08430d4488499da48f1e7a24622)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:21.997363 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e58759-fa76-45cf-b242-ab70953eb684 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:22.002658 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 237/453] 10.222.0.73 () {56 vars in 1180 bytes} [Mon Apr 11 16:37:21 2022] GET /identity/v3/groups/2b9ae08430d4488499da48f1e7a24622 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:22.004764 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e58759-fa76-45cf-b242-ab70953eb684 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:22.037381 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4cc90-7de3-4375-9a47-f8bf9f71cd66 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:22.077031 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86712522-7b67-4752-b33d-6b9d1ebb8f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:22.077774 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86712522-7b67-4752-b33d-6b9d1ebb8f8c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:22.078057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86712522-7b67-4752-b33d-6b9d1ebb8f8c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:22.078326 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86712522-7b67-4752-b33d-6b9d1ebb8f8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:22.079283 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86712522-7b67-4752-b33d-6b9d1ebb8f8c None admin] RBAC: Adding query filter params (group.id=014af3157a624ee3be4e51d6d4f9f974, role.id=13de1ce875d44fcc988cc31b3a0639be, scope.project.id=f8c9bf4c662c47e3808d264d2ea01d67) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:22.079587 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86712522-7b67-4752-b33d-6b9d1ebb8f8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:22.080999 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86712522-7b67-4752-b33d-6b9d1ebb8f8c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:22.086973 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 217/454] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Apr 11 16:37:21 2022] GET /identity/v3/role_assignments?group.id=014af3157a624ee3be4e51d6d4f9f974&scope.project.id=f8c9bf4c662c47e3808d264d2ea01d67&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:22.108362 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e58759-fa76-45cf-b242-ab70953eb684 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:22.143417 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e96308-3b84-4848-9208-b5fb270982b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:22.144087 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e96308-3b84-4848-9208-b5fb270982b8 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:22.144370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e96308-3b84-4848-9208-b5fb270982b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:22.144649 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e96308-3b84-4848-9208-b5fb270982b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:22.145495 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e96308-3b84-4848-9208-b5fb270982b8 None admin] RBAC: Adding query filter params (group.id=2b9ae08430d4488499da48f1e7a24622, role.id=807f93fb1a91497aba7762557ae039dd, scope.project.id=e9fda6800be44b51ba84452d77f4ad81) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:22.145810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e96308-3b84-4848-9208-b5fb270982b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:22.147328 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e96308-3b84-4848-9208-b5fb270982b8 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:22.153966 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 238/455] 10.222.0.73 () {56 vars in 1376 bytes} [Mon Apr 11 16:37:22 2022] GET /identity/v3/role_assignments?group.id=2b9ae08430d4488499da48f1e7a24622&scope.project.id=e9fda6800be44b51ba84452d77f4ad81&role.id=807f93fb1a91497aba7762557ae039dd => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:24.995469 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d0e6-223c-45a6-a992-ee655f32a227 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:24.996001 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d0e6-223c-45a6-a992-ee655f32a227 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:24.996001 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d0e6-223c-45a6-a992-ee655f32a227 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:24.997663 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 218/456] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:25.003269 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030267a-7c88-4b38-a564-2f846a471983 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:25.003721 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030267a-7c88-4b38-a564-2f846a471983 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:25.003812 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030267a-7c88-4b38-a564-2f846a471983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:25.031073 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-8030267a-7c88-4b38-a564-2f846a471983 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:25.032281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-8030267a-7c88-4b38-a564-2f846a471983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:25.102494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 239/457] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:25.128389 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876d0e6-223c-45a6-a992-ee655f32a227 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:25.235016 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876d0e6-223c-45a6-a992-ee655f32a227 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:25.270410 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b880d0-ba88-4c26-ac55-74ca1e8505bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:25.272812 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89453097-bcd2-41b4-b30b-82be796fcf2e None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:25.273092 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89453097-bcd2-41b4-b30b-82be796fcf2e None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:25.273288 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b880d0-ba88-4c26-ac55-74ca1e8505bf None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:25.273559 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b880d0-ba88-4c26-ac55-74ca1e8505bf None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:25.273848 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b880d0-ba88-4c26-ac55-74ca1e8505bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:25.274194 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89453097-bcd2-41b4-b30b-82be796fcf2e None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:25.278705 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 240/458] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:37:25.281969 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb62ce-f781-4f6e-ad36-5fde95584544 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:25.282490 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb62ce-f781-4f6e-ad36-5fde95584544 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:25.283006 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb62ce-f781-4f6e-ad36-5fde95584544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:25.288333 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b880d0-ba88-4c26-ac55-74ca1e8505bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:25.290479 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b880d0-ba88-4c26-ac55-74ca1e8505bf None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:25.313238 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-51b880d0-ba88-4c26-ac55-74ca1e8505bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:25.313238 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 219/459] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:25.315045 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-adcb62ce-f781-4f6e-ad36-5fde95584544 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:25.316889 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-adcb62ce-f781-4f6e-ad36-5fde95584544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:25.318541 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b880d0-ba88-4c26-ac55-74ca1e8505bf None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:25.445385 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 241/460] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:25.463960 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b880d0-ba88-4c26-ac55-74ca1e8505bf None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:25.488653 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb62ce-f781-4f6e-ad36-5fde95584544 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:25.499255 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd9808-7589-4a2b-a88b-72c5c1a11e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:25.500114 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd9808-7589-4a2b-a88b-72c5c1a11e76 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:25.500558 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd9808-7589-4a2b-a88b-72c5c1a11e76 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:25.500978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd9808-7589-4a2b-a88b-72c5c1a11e76 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:25.502043 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd9808-7589-4a2b-a88b-72c5c1a11e76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:25.502504 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd9808-7589-4a2b-a88b-72c5c1a11e76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:25.504036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd9808-7589-4a2b-a88b-72c5c1a11e76 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:25.516690 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 220/461] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:25.518135 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813badc8-76a6-4b4f-8318-2e58055be367 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:25.518567 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813badc8-76a6-4b4f-8318-2e58055be367 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:25.519032 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813badc8-76a6-4b4f-8318-2e58055be367 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:25.520621 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 221/462] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:25.525366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813badc8-76a6-4b4f-8318-2e58055be367 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:25.587777 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb62ce-f781-4f6e-ad36-5fde95584544 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:25.623383 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578b373c-3b98-4bb6-b253-760071537122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:25.624438 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b373c-3b98-4bb6-b253-760071537122 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:25.624817 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b373c-3b98-4bb6-b253-760071537122 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:25.625211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578b373c-3b98-4bb6-b253-760071537122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:25.635125 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813badc8-76a6-4b4f-8318-2e58055be367 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:25.637030 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b373c-3b98-4bb6-b253-760071537122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:25.639137 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578b373c-3b98-4bb6-b253-760071537122 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:25.656963 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-578b373c-3b98-4bb6-b253-760071537122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:25.658654 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 242/463] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:25.660003 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356d5d3-9027-4fab-bb18-fcdf7a1498dd None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:25.660381 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356d5d3-9027-4fab-bb18-fcdf7a1498dd None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:25.660801 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f356d5d3-9027-4fab-bb18-fcdf7a1498dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:25.676374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac834456-08f8-4145-8001-e72df5a68c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:25.677373 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac834456-08f8-4145-8001-e72df5a68c4f None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:25.677795 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac834456-08f8-4145-8001-e72df5a68c4f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:25.678250 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac834456-08f8-4145-8001-e72df5a68c4f None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:25.679070 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-f356d5d3-9027-4fab-bb18-fcdf7a1498dd None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:25.679288 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac834456-08f8-4145-8001-e72df5a68c4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:25.680410 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f356d5d3-9027-4fab-bb18-fcdf7a1498dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:25.682105 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac834456-08f8-4145-8001-e72df5a68c4f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:25.705754 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 222/464] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Apr 11 16:37:25 2022] POST /identity/v3/users => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:37:25.707031 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac834456-08f8-4145-8001-e72df5a68c4f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:25.765002 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 243/465] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:25.793296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356d5d3-9027-4fab-bb18-fcdf7a1498dd None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:25.826859 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac834456-08f8-4145-8001-e72df5a68c4f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:25.862841 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c037713-8965-4cbf-83cc-1d9bd53d2d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:25.863557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c037713-8965-4cbf-83cc-1d9bd53d2d90 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:25.863834 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c037713-8965-4cbf-83cc-1d9bd53d2d90 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:25.864106 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c037713-8965-4cbf-83cc-1d9bd53d2d90 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:25.864838 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c037713-8965-4cbf-83cc-1d9bd53d2d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:25.865139 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c037713-8965-4cbf-83cc-1d9bd53d2d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:25.866536 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c037713-8965-4cbf-83cc-1d9bd53d2d90 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:25.880332 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 223/466] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:25.887504 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c037713-8965-4cbf-83cc-1d9bd53d2d90 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:25.914611 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f356d5d3-9027-4fab-bb18-fcdf7a1498dd None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:25.956711 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a8bb8-60ce-49c9-97d4-895cf5e3eef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:25.958043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a8bb8-60ce-49c9-97d4-895cf5e3eef9 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:25.958859 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a8bb8-60ce-49c9-97d4-895cf5e3eef9 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:25.959598 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a8bb8-60ce-49c9-97d4-895cf5e3eef9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:25.974884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a8bb8-60ce-49c9-97d4-895cf5e3eef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:25.976365 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a8bb8-60ce-49c9-97d4-895cf5e3eef9 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:25.993387 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-827a8bb8-60ce-49c9-97d4-895cf5e3eef9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:25.995313 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 244/467] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:26.002974 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c037713-8965-4cbf-83cc-1d9bd53d2d90 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:26.004514 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a8bb8-60ce-49c9-97d4-895cf5e3eef9 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:26.042249 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02c1c0-4730-4c3f-ada0-09109908e78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:26.042903 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02c1c0-4730-4c3f-ada0-09109908e78d None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:26.043248 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02c1c0-4730-4c3f-ada0-09109908e78d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:26.043524 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02c1c0-4730-4c3f-ada0-09109908e78d None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:26.044235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02c1c0-4730-4c3f-ada0-09109908e78d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:26.045662 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02c1c0-4730-4c3f-ada0-09109908e78d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:26.067623 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 224/468] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Apr 11 16:37:25 2022] POST /identity/v3/users => generated 248 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:37:26.118929 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a8bb8-60ce-49c9-97d4-895cf5e3eef9 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:26.157821 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54ecb2-8871-44ee-a21a-7194be925f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:26.158982 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54ecb2-8871-44ee-a21a-7194be925f11 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:26.159500 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54ecb2-8871-44ee-a21a-7194be925f11 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:26.159971 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54ecb2-8871-44ee-a21a-7194be925f11 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:26.161070 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54ecb2-8871-44ee-a21a-7194be925f11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:26.161582 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54ecb2-8871-44ee-a21a-7194be925f11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:26.163228 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54ecb2-8871-44ee-a21a-7194be925f11 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:26.173705 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d1603-951e-4fff-b4f4-de75f818ed5a None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:26.174049 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d1603-951e-4fff-b4f4-de75f818ed5a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:26.174256 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075d1603-951e-4fff-b4f4-de75f818ed5a None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:26.175945 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 225/469] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:26.182235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f6bf8-861c-4614-be67-5fbaa1748149 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:26.182600 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f6bf8-861c-4614-be67-5fbaa1748149 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:26.182815 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f6bf8-861c-4614-be67-5fbaa1748149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:26.190953 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 245/470] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:26.192236 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54ecb2-8871-44ee-a21a-7194be925f11 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:26.208461 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f94f6bf8-861c-4614-be67-5fbaa1748149 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:26.209669 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f94f6bf8-861c-4614-be67-5fbaa1748149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:26.315712 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54ecb2-8871-44ee-a21a-7194be925f11 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:26.317640 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 226/471] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:37:26.344716 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f6bf8-861c-4614-be67-5fbaa1748149 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:26.354030 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c1f17-51e4-4958-b376-4806d90e4ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:26.355383 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c1f17-51e4-4958-b376-4806d90e4ace None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:26.355833 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c1f17-51e4-4958-b376-4806d90e4ace None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:26.356536 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c1f17-51e4-4958-b376-4806d90e4ace None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:26.357690 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c1f17-51e4-4958-b376-4806d90e4ace None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:26.359986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c1f17-51e4-4958-b376-4806d90e4ace None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:26.388718 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 246/472] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Apr 11 16:37:26 2022] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:37:26.473356 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f6bf8-861c-4614-be67-5fbaa1748149 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:26.513467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f21a1-750c-484c-add8-b16427ae2c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:26.514520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f21a1-750c-484c-add8-b16427ae2c4c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:26.514981 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f21a1-750c-484c-add8-b16427ae2c4c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:26.515664 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f21a1-750c-484c-add8-b16427ae2c4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:26.528137 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f21a1-750c-484c-add8-b16427ae2c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:26.529915 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f21a1-750c-484c-add8-b16427ae2c4c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:26.548852 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-682f21a1-750c-484c-add8-b16427ae2c4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:26.550792 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 227/473] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:26.559778 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c1f17-51e4-4958-b376-4806d90e4ace None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:26.664544 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c1f17-51e4-4958-b376-4806d90e4ace None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:26.698388 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa29b08-b07c-449d-9086-a8e6f44e4e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:26.699090 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa29b08-b07c-449d-9086-a8e6f44e4e6d None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:26.699366 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa29b08-b07c-449d-9086-a8e6f44e4e6d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:26.699635 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa29b08-b07c-449d-9086-a8e6f44e4e6d None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:26.700346 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa29b08-b07c-449d-9086-a8e6f44e4e6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:26.700644 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa29b08-b07c-449d-9086-a8e6f44e4e6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:26.702021 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa29b08-b07c-449d-9086-a8e6f44e4e6d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:26.705690 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632c829-d9f7-46d3-ac2c-350bd7d6442c None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:26.706221 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632c829-d9f7-46d3-ac2c-350bd7d6442c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:26.706769 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5632c829-d9f7-46d3-ac2c-350bd7d6442c None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:26.708593 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 228/474] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:26.713689 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a56c3-d53f-41ee-b5ac-4fdd2abe5dfc None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:26.714192 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a56c3-d53f-41ee-b5ac-4fdd2abe5dfc None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:26.714464 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a56c3-d53f-41ee-b5ac-4fdd2abe5dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:26.718204 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 247/475] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:26.725032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa29b08-b07c-449d-9086-a8e6f44e4e6d None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:26.740402 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-537a56c3-d53f-41ee-b5ac-4fdd2abe5dfc None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:26.741906 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-537a56c3-d53f-41ee-b5ac-4fdd2abe5dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:26.818664 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 229/476] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:37:26.831172 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa29b08-b07c-449d-9086-a8e6f44e4e6d None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:26.845408 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a56c3-d53f-41ee-b5ac-4fdd2abe5dfc None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:26.864765 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e696ea-d182-4411-8dff-53bb1db9571c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:26.865432 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e696ea-d182-4411-8dff-53bb1db9571c None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:26.865704 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e696ea-d182-4411-8dff-53bb1db9571c None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:26.865971 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e696ea-d182-4411-8dff-53bb1db9571c None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:26.866697 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e696ea-d182-4411-8dff-53bb1db9571c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:26.868124 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e696ea-d182-4411-8dff-53bb1db9571c None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:26.890149 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 248/477] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Apr 11 16:37:26 2022] POST /identity/v3/users => generated 249 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:37:26.970867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a56c3-d53f-41ee-b5ac-4fdd2abe5dfc None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:27.009623 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426ab16-1f9c-40a6-8f66-9538a38f999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:27.010366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426ab16-1f9c-40a6-8f66-9538a38f999a None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:27.010579 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426ab16-1f9c-40a6-8f66-9538a38f999a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:27.010892 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426ab16-1f9c-40a6-8f66-9538a38f999a None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:27.011729 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426ab16-1f9c-40a6-8f66-9538a38f999a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:27.013249 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426ab16-1f9c-40a6-8f66-9538a38f999a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:27.024007 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.sql.core [None req-d426ab16-1f9c-40a6-8f66-9538a38f999a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 11 16:37:27.024007 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 11 16:37:27.024007 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [parameters: {'id': 'f4cf9472f43349a29d1e31cdc879496d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 11 16:37:27.024007 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86345) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 11 16:37:27.044125 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-d426ab16-1f9c-40a6-8f66-9538a38f999a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 11 16:37:27.045815 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 230/478] 10.222.0.73 () {60 vars in 1131 bytes} [Mon Apr 11 16:37:26 2022] POST /identity/v3/roles => generated 144 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:27.051721 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e696ea-d182-4411-8dff-53bb1db9571c None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:27.187829 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e696ea-d182-4411-8dff-53bb1db9571c None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:27.221361 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee459f92-1cef-4a9f-b459-d57cb47dd82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:27.222528 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee459f92-1cef-4a9f-b459-d57cb47dd82d None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:27.223030 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee459f92-1cef-4a9f-b459-d57cb47dd82d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:27.223512 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee459f92-1cef-4a9f-b459-d57cb47dd82d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:27.235562 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee459f92-1cef-4a9f-b459-d57cb47dd82d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:27.243232 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-ee459f92-1cef-4a9f-b459-d57cb47dd82d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 16:37:27.245669 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 249/479] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:37:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:27.252772 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426ab16-1f9c-40a6-8f66-9538a38f999a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:27.366381 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426ab16-1f9c-40a6-8f66-9538a38f999a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:27.401936 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53cd564-9056-4b8b-8086-21b6b0978010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:27.402686 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cd564-9056-4b8b-8086-21b6b0978010 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:27.402968 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cd564-9056-4b8b-8086-21b6b0978010 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:27.403240 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53cd564-9056-4b8b-8086-21b6b0978010 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:27.403985 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cd564-9056-4b8b-8086-21b6b0978010 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:27.404290 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cd564-9056-4b8b-8086-21b6b0978010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:27.405732 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53cd564-9056-4b8b-8086-21b6b0978010 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:27.414620 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 231/480] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:28.729159 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0a3c5-e081-4676-9245-445d5260560b None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:28.730179 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0a3c5-e081-4676-9245-445d5260560b None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:28.730705 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e0a3c5-e081-4676-9245-445d5260560b None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:28.732246 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 250/481] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:28.737595 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d6a08-034a-41f0-8399-1aeafbd23cba None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:28.738402 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d6a08-034a-41f0-8399-1aeafbd23cba None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:28.738900 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d6a08-034a-41f0-8399-1aeafbd23cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:28.760206 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ed5d6a08-034a-41f0-8399-1aeafbd23cba None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:28.761399 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ed5d6a08-034a-41f0-8399-1aeafbd23cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:28.849928 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 232/482] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:28.887158 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0a3c5-e081-4676-9245-445d5260560b None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:29.008318 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e0a3c5-e081-4676-9245-445d5260560b None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:29.058714 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf40a3-5092-449d-b58d-dc7dbf00634a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:29.059533 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf40a3-5092-449d-b58d-dc7dbf00634a None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:29.059808 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf40a3-5092-449d-b58d-dc7dbf00634a None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:29.060080 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf40a3-5092-449d-b58d-dc7dbf00634a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:29.077077 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf40a3-5092-449d-b58d-dc7dbf00634a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:29.084195 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-1faf40a3-5092-449d-b58d-dc7dbf00634a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:37:29.085721 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 251/483] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:29.091718 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d6a08-034a-41f0-8399-1aeafbd23cba None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:29.201261 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e0c30-2e3d-49ae-be2f-2fe05bf454ec None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:29.201603 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e0c30-2e3d-49ae-be2f-2fe05bf454ec None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:29.201815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e0c30-2e3d-49ae-be2f-2fe05bf454ec None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:29.203331 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 252/484] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:37:29.208669 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d7bbf-0a60-4178-8641-7c418f2e8dba None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:29.208973 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d7bbf-0a60-4178-8641-7c418f2e8dba None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:29.209289 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5d7bbf-0a60-4178-8641-7c418f2e8dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:29.237566 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d6a08-034a-41f0-8399-1aeafbd23cba None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:29.244158 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-7b5d7bbf-0a60-4178-8641-7c418f2e8dba None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:29.245372 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-7b5d7bbf-0a60-4178-8641-7c418f2e8dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:29.281710 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf8e5b-79da-4377-a509-a31406431e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:29.282296 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf8e5b-79da-4377-a509-a31406431e9b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:29.282579 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf8e5b-79da-4377-a509-a31406431e9b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:29.282881 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf8e5b-79da-4377-a509-a31406431e9b None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:29.283622 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf8e5b-79da-4377-a509-a31406431e9b None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:29.283929 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf8e5b-79da-4377-a509-a31406431e9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:29.285400 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf8e5b-79da-4377-a509-a31406431e9b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:29.294139 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 233/485] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:37:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:29.303585 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf8e5b-79da-4377-a509-a31406431e9b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:29.330817 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 253/486] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:29.354888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d7bbf-0a60-4178-8641-7c418f2e8dba None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:29.426131 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf8e5b-79da-4377-a509-a31406431e9b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:29.471470 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8531b2bb-8286-4b85-a941-13846ed6767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:29.472687 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531b2bb-8286-4b85-a941-13846ed6767f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:29.473167 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531b2bb-8286-4b85-a941-13846ed6767f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:29.473635 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8531b2bb-8286-4b85-a941-13846ed6767f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:29.487910 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5d7bbf-0a60-4178-8641-7c418f2e8dba None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:29.494333 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531b2bb-8286-4b85-a941-13846ed6767f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:29.496077 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8531b2bb-8286-4b85-a941-13846ed6767f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:29.525267 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-8531b2bb-8286-4b85-a941-13846ed6767f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:29.526651 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 234/487] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:29.528620 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd367f06-64b8-41dc-a293-00fcc770a3dd None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:29.528620 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd367f06-64b8-41dc-a293-00fcc770a3dd None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:29.528620 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd367f06-64b8-41dc-a293-00fcc770a3dd None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:29.529732 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 235/488] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:29.530516 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd9dbe-5d7a-4f8f-a5aa-bcf4ac4a9e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:29.531607 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd9dbe-5d7a-4f8f-a5aa-bcf4ac4a9e92 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:29.532219 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd9dbe-5d7a-4f8f-a5aa-bcf4ac4a9e92 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:29.532778 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd9dbe-5d7a-4f8f-a5aa-bcf4ac4a9e92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:29.535884 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd367f06-64b8-41dc-a293-00fcc770a3dd None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:29.547473 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd9dbe-5d7a-4f8f-a5aa-bcf4ac4a9e92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:29.558343 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-83bd9dbe-5d7a-4f8f-a5aa-bcf4ac4a9e92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:37:29.560218 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 254/489] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:29.566834 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e26f7d-2c03-466b-9aa5-352edc6dbfef None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:29.567361 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e26f7d-2c03-466b-9aa5-352edc6dbfef None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:29.567997 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e26f7d-2c03-466b-9aa5-352edc6dbfef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:29.589677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-83e26f7d-2c03-466b-9aa5-352edc6dbfef None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:29.591586 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-83e26f7d-2c03-466b-9aa5-352edc6dbfef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:29.666932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd367f06-64b8-41dc-a293-00fcc770a3dd None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:29.680515 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 255/490] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:29.682183 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e26f7d-2c03-466b-9aa5-352edc6dbfef None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:29.718310 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18f50d-8540-4b3f-9b2a-44f4a49f0c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:29.719311 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18f50d-8540-4b3f-9b2a-44f4a49f0c87 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:29.719589 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18f50d-8540-4b3f-9b2a-44f4a49f0c87 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:29.720019 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18f50d-8540-4b3f-9b2a-44f4a49f0c87 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:29.721059 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18f50d-8540-4b3f-9b2a-44f4a49f0c87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:29.721364 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18f50d-8540-4b3f-9b2a-44f4a49f0c87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:29.723173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18f50d-8540-4b3f-9b2a-44f4a49f0c87 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:29.741840 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 236/491] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:29.742767 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18f50d-8540-4b3f-9b2a-44f4a49f0c87 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:29.805257 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e26f7d-2c03-466b-9aa5-352edc6dbfef None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:29.839523 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93d198-7291-4625-9650-86c1b1aa294f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:29.840240 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93d198-7291-4625-9650-86c1b1aa294f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:29.840525 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93d198-7291-4625-9650-86c1b1aa294f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:29.840795 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93d198-7291-4625-9650-86c1b1aa294f None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:29.841593 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93d198-7291-4625-9650-86c1b1aa294f None admin] RBAC: Adding query filter params (name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:29.841941 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93d198-7291-4625-9650-86c1b1aa294f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:29.843361 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93d198-7291-4625-9650-86c1b1aa294f None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:29.852213 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18f50d-8540-4b3f-9b2a-44f4a49f0c87 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:29.857308 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 256/492] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:37:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:29.858273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93d198-7291-4625-9650-86c1b1aa294f None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:29.887301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e24c5b-5e74-4c66-b3d5-78f95295f1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:29.888193 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e24c5b-5e74-4c66-b3d5-78f95295f1b3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:29.888375 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e24c5b-5e74-4c66-b3d5-78f95295f1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:29.888654 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e24c5b-5e74-4c66-b3d5-78f95295f1b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:29.900265 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e24c5b-5e74-4c66-b3d5-78f95295f1b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:29.907302 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-c2e24c5b-5e74-4c66-b3d5-78f95295f1b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:37:29.914642 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 237/493] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:29.914642 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e24c5b-5e74-4c66-b3d5-78f95295f1b3 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:29.967502 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93d198-7291-4625-9650-86c1b1aa294f None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:30.001081 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c96dd-2dd9-407e-86bf-bab5dfaa51e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:30.001863 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c96dd-2dd9-407e-86bf-bab5dfaa51e6 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.002145 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c96dd-2dd9-407e-86bf-bab5dfaa51e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.002411 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c96dd-2dd9-407e-86bf-bab5dfaa51e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.010437 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c96dd-2dd9-407e-86bf-bab5dfaa51e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:30.011914 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4c96dd-2dd9-407e-86bf-bab5dfaa51e6 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:30.017995 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e24c5b-5e74-4c66-b3d5-78f95295f1b3 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:30.025656 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-0e4c96dd-2dd9-407e-86bf-bab5dfaa51e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 16:37:30.026965 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 257/494] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Apr 11 16:37:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:30.027771 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c96dd-2dd9-407e-86bf-bab5dfaa51e6 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:30.058378 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e6e96-c55f-4123-9f5a-0f0cfa181299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:30.059520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e6e96-c55f-4123-9f5a-0f0cfa181299 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.059955 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e6e96-c55f-4123-9f5a-0f0cfa181299 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.060391 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e6e96-c55f-4123-9f5a-0f0cfa181299 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.072563 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e6e96-c55f-4123-9f5a-0f0cfa181299 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:30.074040 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e6e96-c55f-4123-9f5a-0f0cfa181299 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:30.091593 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-1a6e6e96-c55f-4123-9f5a-0f0cfa181299 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:30.101103 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 238/495] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:30.101103 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bb44d-69ae-4985-8416-c6faa39b79df None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.101103 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bb44d-69ae-4985-8416-c6faa39b79df None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.101103 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4bb44d-69ae-4985-8416-c6faa39b79df None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.101103 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 239/496] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:30.101103 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bb44d-69ae-4985-8416-c6faa39b79df None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:30.135556 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c96dd-2dd9-407e-86bf-bab5dfaa51e6 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:30.168357 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ef60f-ce80-45c0-88a2-a07a1adae87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:30.169052 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ef60f-ce80-45c0-88a2-a07a1adae87f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.169328 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ef60f-ce80-45c0-88a2-a07a1adae87f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.169602 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ef60f-ce80-45c0-88a2-a07a1adae87f None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.170338 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ef60f-ce80-45c0-88a2-a07a1adae87f None admin] RBAC: Adding query filter params (name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:30.170672 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ef60f-ce80-45c0-88a2-a07a1adae87f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:30.172055 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ef60f-ce80-45c0-88a2-a07a1adae87f None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:30.184954 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 258/497] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:37:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:30.184954 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ef60f-ce80-45c0-88a2-a07a1adae87f None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:30.206022 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4bb44d-69ae-4985-8416-c6faa39b79df None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:30.241214 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038b410-6700-41d8-8dad-d2da3909b4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:30.242150 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038b410-6700-41d8-8dad-d2da3909b4c4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.242687 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038b410-6700-41d8-8dad-d2da3909b4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.243138 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038b410-6700-41d8-8dad-d2da3909b4c4 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.244685 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038b410-6700-41d8-8dad-d2da3909b4c4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:30.244993 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038b410-6700-41d8-8dad-d2da3909b4c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:30.246432 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038b410-6700-41d8-8dad-d2da3909b4c4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:30.276750 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ef60f-ce80-45c0-88a2-a07a1adae87f None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:30.288730 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 240/498] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Apr 11 16:37:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:30.290623 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167af7d5-b875-4eb4-a265-7e0fb0355fe8 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.290909 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167af7d5-b875-4eb4-a265-7e0fb0355fe8 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.291180 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167af7d5-b875-4eb4-a265-7e0fb0355fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.309386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-167af7d5-b875-4eb4-a265-7e0fb0355fe8 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:30.310513 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-167af7d5-b875-4eb4-a265-7e0fb0355fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:30.314077 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddabb6-17ec-42d9-a8e3-0ed98492a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:30.314768 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddabb6-17ec-42d9-a8e3-0ed98492a416 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.315052 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddabb6-17ec-42d9-a8e3-0ed98492a416 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.315328 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddabb6-17ec-42d9-a8e3-0ed98492a416 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.316035 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddabb6-17ec-42d9-a8e3-0ed98492a416 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:30.316337 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddabb6-17ec-42d9-a8e3-0ed98492a416 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:30.317706 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddabb6-17ec-42d9-a8e3-0ed98492a416 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:30.330515 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 259/499] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:30.331453 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddabb6-17ec-42d9-a8e3-0ed98492a416 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:30.383554 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 241/500] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:30.384653 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167af7d5-b875-4eb4-a265-7e0fb0355fe8 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:30.438642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddabb6-17ec-42d9-a8e3-0ed98492a416 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:30.474803 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4c3a1-d9d7-4e1b-98c9-4c3f8c9df4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:30.475592 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4c3a1-d9d7-4e1b-98c9-4c3f8c9df4d5 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.475874 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4c3a1-d9d7-4e1b-98c9-4c3f8c9df4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.476148 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4c3a1-d9d7-4e1b-98c9-4c3f8c9df4d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.485792 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4c3a1-d9d7-4e1b-98c9-4c3f8c9df4d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:30.487791 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4c3a1-d9d7-4e1b-98c9-4c3f8c9df4d5 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:30.491399 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167af7d5-b875-4eb4-a265-7e0fb0355fe8 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:30.503978 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-b3b4c3a1-d9d7-4e1b-98c9-4c3f8c9df4d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:30.505175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 260/501] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:30.505937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4c3a1-d9d7-4e1b-98c9-4c3f8c9df4d5 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:30.523572 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ab963-15fc-47e4-882c-11e56094c0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:30.524207 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ab963-15fc-47e4-882c-11e56094c0d5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.525007 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ab963-15fc-47e4-882c-11e56094c0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.525280 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ab963-15fc-47e4-882c-11e56094c0d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.589170 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ab963-15fc-47e4-882c-11e56094c0d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:30.590549 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ab963-15fc-47e4-882c-11e56094c0d5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:30.600392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4c3a1-d9d7-4e1b-98c9-4c3f8c9df4d5 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:30.631951 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8c4e0-d99e-430c-a59e-25ffe27c6b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:30.632735 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8c4e0-d99e-430c-a59e-25ffe27c6b76 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.633018 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8c4e0-d99e-430c-a59e-25ffe27c6b76 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.633294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb8c4e0-d99e-430c-a59e-25ffe27c6b76 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.641000 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8c4e0-d99e-430c-a59e-25ffe27c6b76 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:30.642441 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb8c4e0-d99e-430c-a59e-25ffe27c6b76 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:30.655990 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-ffb8c4e0-d99e-430c-a59e-25ffe27c6b76 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 11 16:37:30.657176 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 261/502] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:30.657946 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8c4e0-d99e-430c-a59e-25ffe27c6b76 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:30.683146 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 242/503] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:30.684459 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aba37-efb5-4d4d-84db-ae675ebc1c83 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.684747 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aba37-efb5-4d4d-84db-ae675ebc1c83 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.685021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798aba37-efb5-4d4d-84db-ae675ebc1c83 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.686435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 243/504] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:30.686981 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798aba37-efb5-4d4d-84db-ae675ebc1c83 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:30.752887 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb8c4e0-d99e-430c-a59e-25ffe27c6b76 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:30.782859 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798aba37-efb5-4d4d-84db-ae675ebc1c83 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:30.784968 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab28567-6346-4d82-bca5-f91107289a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:30.785828 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab28567-6346-4d82-bca5-f91107289a3b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.786099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab28567-6346-4d82-bca5-f91107289a3b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.786370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab28567-6346-4d82-bca5-f91107289a3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.797642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab28567-6346-4d82-bca5-f91107289a3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:30.804638 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-eab28567-6346-4d82-bca5-f91107289a3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:37:30.805942 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 262/505] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:30.806766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab28567-6346-4d82-bca5-f91107289a3b None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:30.816028 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75bd52-9f4a-4450-90c6-157105f45f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:30.816682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75bd52-9f4a-4450-90c6-157105f45f49 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.816963 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75bd52-9f4a-4450-90c6-157105f45f49 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.817235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75bd52-9f4a-4450-90c6-157105f45f49 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.817951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75bd52-9f4a-4450-90c6-157105f45f49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:30.818257 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75bd52-9f4a-4450-90c6-157105f45f49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:30.819663 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75bd52-9f4a-4450-90c6-157105f45f49 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:30.831054 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 244/506] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:30.831850 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75bd52-9f4a-4450-90c6-157105f45f49 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:30.914258 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab28567-6346-4d82-bca5-f91107289a3b None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:30.928918 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75bd52-9f4a-4450-90c6-157105f45f49 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:30.947140 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26287e02-079d-4bfe-8f05-3119ac3ef4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:30.947802 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26287e02-079d-4bfe-8f05-3119ac3ef4ce None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.948088 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26287e02-079d-4bfe-8f05-3119ac3ef4ce None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.948365 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26287e02-079d-4bfe-8f05-3119ac3ef4ce None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.949178 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26287e02-079d-4bfe-8f05-3119ac3ef4ce None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:30.949485 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26287e02-079d-4bfe-8f05-3119ac3ef4ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:30.950940 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26287e02-079d-4bfe-8f05-3119ac3ef4ce None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:30.960987 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c9c54-8237-44eb-8a5f-359a5339539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:30.961770 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c9c54-8237-44eb-8a5f-359a5339539b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.962686 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c9c54-8237-44eb-8a5f-359a5339539b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.962970 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c9c54-8237-44eb-8a5f-359a5339539b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.974794 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c9c54-8237-44eb-8a5f-359a5339539b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:30.976233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c9c54-8237-44eb-8a5f-359a5339539b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:30.987715 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 263/507] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Apr 11 16:37:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:30.988989 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46b510-7250-4582-96ee-fa482ce63a34 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:30.989275 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46b510-7250-4582-96ee-fa482ce63a34 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:30.989549 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46b510-7250-4582-96ee-fa482ce63a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:30.994095 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-137c9c54-8237-44eb-8a5f-359a5339539b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:30.995350 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 245/508] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:30.996112 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c9c54-8237-44eb-8a5f-359a5339539b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:31.006128 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-9a46b510-7250-4582-96ee-fa482ce63a34 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:31.007370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9a46b510-7250-4582-96ee-fa482ce63a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:31.069658 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 264/509] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:31.070477 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46b510-7250-4582-96ee-fa482ce63a34 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:31.106235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c9c54-8237-44eb-8a5f-359a5339539b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:31.138080 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcb7a3-cb88-41eb-ab77-b813b07d37ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:31.138770 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcb7a3-cb88-41eb-ab77-b813b07d37ac None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:31.139058 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcb7a3-cb88-41eb-ab77-b813b07d37ac None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:31.139330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfcb7a3-cb88-41eb-ab77-b813b07d37ac None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:31.140064 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcb7a3-cb88-41eb-ab77-b813b07d37ac None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:31.140620 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcb7a3-cb88-41eb-ab77-b813b07d37ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:31.141971 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfcb7a3-cb88-41eb-ab77-b813b07d37ac None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:31.150062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 246/510] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:37:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:31.150953 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcb7a3-cb88-41eb-ab77-b813b07d37ac None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:31.168269 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46b510-7250-4582-96ee-fa482ce63a34 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:31.200402 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bffe8-6676-4b2b-bf9f-245cf5c9c961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:31.201196 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bffe8-6676-4b2b-bf9f-245cf5c9c961 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:31.201474 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bffe8-6676-4b2b-bf9f-245cf5c9c961 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:31.201748 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bffe8-6676-4b2b-bf9f-245cf5c9c961 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:31.208614 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bffe8-6676-4b2b-bf9f-245cf5c9c961 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:31.210065 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bffe8-6676-4b2b-bf9f-245cf5c9c961 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:31.223583 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-ff9bffe8-6676-4b2b-bf9f-245cf5c9c961 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 16:37:31.224758 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 265/511] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:31.225526 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bffe8-6676-4b2b-bf9f-245cf5c9c961 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:31.250313 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfcb7a3-cb88-41eb-ab77-b813b07d37ac None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:31.282109 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372904e-0b0e-4639-90e2-eae7a237d032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:31.282776 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372904e-0b0e-4639-90e2-eae7a237d032 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:31.283054 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372904e-0b0e-4639-90e2-eae7a237d032 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:31.283327 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372904e-0b0e-4639-90e2-eae7a237d032 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:31.320295 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bffe8-6676-4b2b-bf9f-245cf5c9c961 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:31.346824 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372904e-0b0e-4639-90e2-eae7a237d032 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:31.348301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372904e-0b0e-4639-90e2-eae7a237d032 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:31.352231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab0122-ebcf-4167-ac99-b79310373bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:31.352905 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab0122-ebcf-4167-ac99-b79310373bd8 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:31.353185 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab0122-ebcf-4167-ac99-b79310373bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:31.353475 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab0122-ebcf-4167-ac99-b79310373bd8 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:31.354167 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab0122-ebcf-4167-ac99-b79310373bd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:31.354470 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab0122-ebcf-4167-ac99-b79310373bd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:31.355883 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab0122-ebcf-4167-ac99-b79310373bd8 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:31.367164 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 266/512] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:31.367960 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab0122-ebcf-4167-ac99-b79310373bd8 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:31.442478 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 247/513] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:31.443282 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372904e-0b0e-4639-90e2-eae7a237d032 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:31.461350 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab0122-ebcf-4167-ac99-b79310373bd8 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:31.492589 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa4aed-32be-4fa1-b54f-b24c0579b8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:31.493905 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa4aed-32be-4fa1-b54f-b24c0579b8c4 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:31.494192 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa4aed-32be-4fa1-b54f-b24c0579b8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:31.494461 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa4aed-32be-4fa1-b54f-b24c0579b8c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:31.504521 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa4aed-32be-4fa1-b54f-b24c0579b8c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:31.505974 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa4aed-32be-4fa1-b54f-b24c0579b8c4 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:31.522795 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-16aa4aed-32be-4fa1-b54f-b24c0579b8c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:31.523981 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 267/514] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:31.524798 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa4aed-32be-4fa1-b54f-b24c0579b8c4 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:31.537595 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372904e-0b0e-4639-90e2-eae7a237d032 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:31.570361 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7f3f-4f3d-4641-bb90-955be2901fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:31.571166 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7f3f-4f3d-4641-bb90-955be2901fb3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:31.571988 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7f3f-4f3d-4641-bb90-955be2901fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:31.572262 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d7f3f-4f3d-4641-bb90-955be2901fb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:31.581775 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d7f3f-4f3d-4641-bb90-955be2901fb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:31.583253 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369d7f3f-4f3d-4641-bb90-955be2901fb3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:31.599546 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-369d7f3f-4f3d-4641-bb90-955be2901fb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:31.600740 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 248/515] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:31.601520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7f3f-4f3d-4641-bb90-955be2901fb3 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:31.620591 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa4aed-32be-4fa1-b54f-b24c0579b8c4 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:31.652327 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1551d17-be4e-482e-b09e-73a766fef326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:31.653368 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1551d17-be4e-482e-b09e-73a766fef326 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:31.653648 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1551d17-be4e-482e-b09e-73a766fef326 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:31.654042 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1551d17-be4e-482e-b09e-73a766fef326 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:31.654897 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1551d17-be4e-482e-b09e-73a766fef326 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:31.655204 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1551d17-be4e-482e-b09e-73a766fef326 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:31.656677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1551d17-be4e-482e-b09e-73a766fef326 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:31.673487 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 268/516] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Apr 11 16:37:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:31.674287 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1551d17-be4e-482e-b09e-73a766fef326 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:31.696066 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369d7f3f-4f3d-4641-bb90-955be2901fb3 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:31.726957 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396fcc9-3aec-477d-b952-68184c8893f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:31.728227 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396fcc9-3aec-477d-b952-68184c8893f8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:31.728503 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396fcc9-3aec-477d-b952-68184c8893f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:31.728772 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396fcc9-3aec-477d-b952-68184c8893f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:31.735069 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396fcc9-3aec-477d-b952-68184c8893f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:31.736600 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b396fcc9-3aec-477d-b952-68184c8893f8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:31.750019 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-b396fcc9-3aec-477d-b952-68184c8893f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:31.751222 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 249/517] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:31.751978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396fcc9-3aec-477d-b952-68184c8893f8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:31.771437 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1551d17-be4e-482e-b09e-73a766fef326 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:31.803529 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fea0f9-59f4-40fb-81fb-49ff6f34d1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:31.804310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fea0f9-59f4-40fb-81fb-49ff6f34d1fe None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:31.804592 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fea0f9-59f4-40fb-81fb-49ff6f34d1fe None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:31.804863 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fea0f9-59f4-40fb-81fb-49ff6f34d1fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:31.814852 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fea0f9-59f4-40fb-81fb-49ff6f34d1fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:31.816294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fea0f9-59f4-40fb-81fb-49ff6f34d1fe None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:31.832291 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-57fea0f9-59f4-40fb-81fb-49ff6f34d1fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:31.833468 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 269/518] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:31.834261 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fea0f9-59f4-40fb-81fb-49ff6f34d1fe None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:31.847622 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396fcc9-3aec-477d-b952-68184c8893f8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:31.881066 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3705e12-8936-41ab-9938-1a0b0f38980c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:31.881789 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3705e12-8936-41ab-9938-1a0b0f38980c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:31.882100 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3705e12-8936-41ab-9938-1a0b0f38980c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:31.882372 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3705e12-8936-41ab-9938-1a0b0f38980c None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:31.883174 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3705e12-8936-41ab-9938-1a0b0f38980c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:31.883476 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3705e12-8936-41ab-9938-1a0b0f38980c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:31.884868 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3705e12-8936-41ab-9938-1a0b0f38980c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:31.895978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 250/519] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:31.896777 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3705e12-8936-41ab-9938-1a0b0f38980c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:31.945204 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fea0f9-59f4-40fb-81fb-49ff6f34d1fe None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:31.982823 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd608fa4-dd68-4e49-80f4-0d0fcc317188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:31.983402 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd608fa4-dd68-4e49-80f4-0d0fcc317188 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:31.983681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd608fa4-dd68-4e49-80f4-0d0fcc317188 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:31.983951 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd608fa4-dd68-4e49-80f4-0d0fcc317188 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:31.984689 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd608fa4-dd68-4e49-80f4-0d0fcc317188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:31.984988 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd608fa4-dd68-4e49-80f4-0d0fcc317188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:31.986343 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd608fa4-dd68-4e49-80f4-0d0fcc317188 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:31.992372 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3705e12-8936-41ab-9938-1a0b0f38980c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:31.999236 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 270/520] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:32.000362 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd608fa4-dd68-4e49-80f4-0d0fcc317188 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:32.032973 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f145a-6d7d-4d48-97a2-ddeb6324a312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:32.033729 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f145a-6d7d-4d48-97a2-ddeb6324a312 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:32.034100 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f145a-6d7d-4d48-97a2-ddeb6324a312 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:32.034382 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f145a-6d7d-4d48-97a2-ddeb6324a312 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:32.096597 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd608fa4-dd68-4e49-80f4-0d0fcc317188 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:32.109480 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f145a-6d7d-4d48-97a2-ddeb6324a312 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:32.111036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f145a-6d7d-4d48-97a2-ddeb6324a312 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:32.128223 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd41af0-c27b-4235-9eab-e453d4ccccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:32.128888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd41af0-c27b-4235-9eab-e453d4ccccfa None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:32.129165 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd41af0-c27b-4235-9eab-e453d4ccccfa None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:32.129463 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd41af0-c27b-4235-9eab-e453d4ccccfa None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:32.130273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd41af0-c27b-4235-9eab-e453d4ccccfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:32.130580 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd41af0-c27b-4235-9eab-e453d4ccccfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:32.132238 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd41af0-c27b-4235-9eab-e453d4ccccfa None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:32.153819 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 271/521] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:32.154651 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd41af0-c27b-4235-9eab-e453d4ccccfa None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:32.206807 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 251/522] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:32.207697 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f145a-6d7d-4d48-97a2-ddeb6324a312 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:32.251727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd41af0-c27b-4235-9eab-e453d4ccccfa None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:32.283712 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f88402-f9c0-4937-adc4-2815ccd095f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:32.284363 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f88402-f9c0-4937-adc4-2815ccd095f8 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:32.284643 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f88402-f9c0-4937-adc4-2815ccd095f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:32.284915 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f88402-f9c0-4937-adc4-2815ccd095f8 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:32.285623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f88402-f9c0-4937-adc4-2815ccd095f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:32.285926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f88402-f9c0-4937-adc4-2815ccd095f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:32.287336 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f88402-f9c0-4937-adc4-2815ccd095f8 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:32.298503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 272/523] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:32.299315 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f88402-f9c0-4937-adc4-2815ccd095f8 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:32.299886 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f145a-6d7d-4d48-97a2-ddeb6324a312 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:32.332103 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893230ee-d315-4466-9997-dacc61281bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:32.332759 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893230ee-d315-4466-9997-dacc61281bcd None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:32.333036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893230ee-d315-4466-9997-dacc61281bcd None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:32.333305 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893230ee-d315-4466-9997-dacc61281bcd None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:32.333985 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893230ee-d315-4466-9997-dacc61281bcd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:32.335441 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893230ee-d315-4466-9997-dacc61281bcd None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:32.354647 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 252/524] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Apr 11 16:37:32 2022] POST /identity/v3/users => generated 247 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:37:32.355479 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893230ee-d315-4466-9997-dacc61281bcd None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:32.401565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f88402-f9c0-4937-adc4-2815ccd095f8 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:32.437908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c8c48-6359-4ad6-97d2-8137ba2da35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:32.438745 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c8c48-6359-4ad6-97d2-8137ba2da35f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:32.439029 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c8c48-6359-4ad6-97d2-8137ba2da35f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:32.439312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0c8c48-6359-4ad6-97d2-8137ba2da35f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:32.448828 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c8c48-6359-4ad6-97d2-8137ba2da35f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:32.450318 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0c8c48-6359-4ad6-97d2-8137ba2da35f None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:32.465079 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-ef0c8c48-6359-4ad6-97d2-8137ba2da35f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 11 16:37:32.471128 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 273/525] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:32.471128 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c8c48-6359-4ad6-97d2-8137ba2da35f None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:32.471409 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893230ee-d315-4466-9997-dacc61281bcd None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:32.506070 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244705a-1b4d-416c-b542-8bc819251caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:32.506682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244705a-1b4d-416c-b542-8bc819251caf None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:32.506965 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244705a-1b4d-416c-b542-8bc819251caf None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:32.507237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4244705a-1b4d-416c-b542-8bc819251caf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:32.508069 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244705a-1b4d-416c-b542-8bc819251caf None admin] RBAC: Adding query filter params (role.id=16dc6f09d53447fd9e4a95fb1df71d9d, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=ba3665d046864985916fdd6c4a4edcd1) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:32.508380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244705a-1b4d-416c-b542-8bc819251caf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:32.510399 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4244705a-1b4d-416c-b542-8bc819251caf None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:32.517054 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 253/526] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:37:32 2022] GET /identity/v3/role_assignments?user.id=ba3665d046864985916fdd6c4a4edcd1&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=16dc6f09d53447fd9e4a95fb1df71d9d => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:32.518334 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244705a-1b4d-416c-b542-8bc819251caf None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:32.613341 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0c8c48-6359-4ad6-97d2-8137ba2da35f None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:32.631518 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4244705a-1b4d-416c-b542-8bc819251caf None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:32.651502 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671774e9-6b72-490a-959c-33dc3cd7886b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:32.652483 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671774e9-6b72-490a-959c-33dc3cd7886b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:32.652866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671774e9-6b72-490a-959c-33dc3cd7886b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:32.653237 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671774e9-6b72-490a-959c-33dc3cd7886b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:32.665603 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671774e9-6b72-490a-959c-33dc3cd7886b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:32.667228 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671774e9-6b72-490a-959c-33dc3cd7886b None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:32.669072 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c058f-45ac-4729-8382-064750499455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:32.669896 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c058f-45ac-4729-8382-064750499455 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:32.670186 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c058f-45ac-4729-8382-064750499455 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:32.670466 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c058f-45ac-4729-8382-064750499455 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:32.678332 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c058f-45ac-4729-8382-064750499455 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:32.679834 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101c058f-45ac-4729-8382-064750499455 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:32.686578 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-671774e9-6b72-490a-959c-33dc3cd7886b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:32.688624 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 274/527] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:32.689681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671774e9-6b72-490a-959c-33dc3cd7886b None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:32.694710 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-101c058f-45ac-4729-8382-064750499455 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:32.696337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 254/528] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:32.697209 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c058f-45ac-4729-8382-064750499455 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:32.796269 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671774e9-6b72-490a-959c-33dc3cd7886b None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:32.798192 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c058f-45ac-4729-8382-064750499455 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:32.830582 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b7c59-9629-4aa7-b7cd-562700100551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:32.831894 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b5c59-ba33-45a4-9e28-b8c9b82b1c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:32.832261 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b7c59-9629-4aa7-b7cd-562700100551 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:32.832552 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b5c59-ba33-45a4-9e28-b8c9b82b1c36 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:32.832836 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b5c59-ba33-45a4-9e28-b8c9b82b1c36 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:32.833112 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b5c59-ba33-45a4-9e28-b8c9b82b1c36 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:32.833367 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b7c59-9629-4aa7-b7cd-562700100551 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:32.833827 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b5c59-ba33-45a4-9e28-b8c9b82b1c36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:32.834033 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b7c59-9629-4aa7-b7cd-562700100551 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:32.834138 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b5c59-ba33-45a4-9e28-b8c9b82b1c36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:32.835172 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b7c59-9629-4aa7-b7cd-562700100551 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:32.835510 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b5c59-ba33-45a4-9e28-b8c9b82b1c36 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:32.835894 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b7c59-9629-4aa7-b7cd-562700100551 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:32.838281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b7c59-9629-4aa7-b7cd-562700100551 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:32.848579 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 255/529] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:32.849061 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b5c59-ba33-45a4-9e28-b8c9b82b1c36 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:32.857901 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 275/530] 10.222.0.73 () {56 vars in 1139 bytes} [Mon Apr 11 16:37:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:32.859127 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b7c59-9629-4aa7-b7cd-562700100551 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:32.952722 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b5c59-ba33-45a4-9e28-b8c9b82b1c36 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:32.968945 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b7c59-9629-4aa7-b7cd-562700100551 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:32.986953 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b37d7-a59b-46b0-ab51-5aaf62dc1b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:32.987813 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b37d7-a59b-46b0-ab51-5aaf62dc1b06 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:32.987923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b37d7-a59b-46b0-ab51-5aaf62dc1b06 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:32.988150 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b37d7-a59b-46b0-ab51-5aaf62dc1b06 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:32.988932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b37d7-a59b-46b0-ab51-5aaf62dc1b06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:32.989245 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b37d7-a59b-46b0-ab51-5aaf62dc1b06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:32.990711 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b37d7-a59b-46b0-ab51-5aaf62dc1b06 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:33.005396 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131578f-c564-40b8-a1e5-a2b7707ec228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:33.006504 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131578f-c564-40b8-a1e5-a2b7707ec228 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:33.007014 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131578f-c564-40b8-a1e5-a2b7707ec228 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:33.007544 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131578f-c564-40b8-a1e5-a2b7707ec228 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:33.008802 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 256/531] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:33.009762 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b37d7-a59b-46b0-ab51-5aaf62dc1b06 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:33.015428 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131578f-c564-40b8-a1e5-a2b7707ec228 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:33.017160 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131578f-c564-40b8-a1e5-a2b7707ec228 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:33.031195 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-6131578f-c564-40b8-a1e5-a2b7707ec228 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:33.032675 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 276/532] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:33.033634 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131578f-c564-40b8-a1e5-a2b7707ec228 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:33.111958 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b37d7-a59b-46b0-ab51-5aaf62dc1b06 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:33.134153 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131578f-c564-40b8-a1e5-a2b7707ec228 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:33.155549 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428fc31-62dc-4c21-9d40-6e12c923a6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:33.156373 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428fc31-62dc-4c21-9d40-6e12c923a6ca None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:33.156747 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428fc31-62dc-4c21-9d40-6e12c923a6ca None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:33.157033 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428fc31-62dc-4c21-9d40-6e12c923a6ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:33.169666 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f9ae7-6f24-4bc6-b31c-17638803c8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:33.170723 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f9ae7-6f24-4bc6-b31c-17638803c8af None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:33.171338 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f9ae7-6f24-4bc6-b31c-17638803c8af None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:33.171825 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f9ae7-6f24-4bc6-b31c-17638803c8af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:33.172892 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f9ae7-6f24-4bc6-b31c-17638803c8af None admin] RBAC: Adding query filter params (role.id=16dc6f09d53447fd9e4a95fb1df71d9d, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=92dc1464c4b24c6c8ea5dfcc796f0279) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:33.173398 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f9ae7-6f24-4bc6-b31c-17638803c8af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:33.175136 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f9ae7-6f24-4bc6-b31c-17638803c8af None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:33.181360 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 277/533] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:37:33 2022] GET /identity/v3/role_assignments?user.id=92dc1464c4b24c6c8ea5dfcc796f0279&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=16dc6f09d53447fd9e4a95fb1df71d9d => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:33.182456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f9ae7-6f24-4bc6-b31c-17638803c8af None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:33.237862 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428fc31-62dc-4c21-9d40-6e12c923a6ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:33.239690 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428fc31-62dc-4c21-9d40-6e12c923a6ca None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:33.314554 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f9ae7-6f24-4bc6-b31c-17638803c8af None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:33.345674 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 257/534] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:33.353438 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428fc31-62dc-4c21-9d40-6e12c923a6ca None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:33.424070 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190131bf-a46b-4c4d-8fcf-62231888f68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:33.424693 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190131bf-a46b-4c4d-8fcf-62231888f68d None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:33.424953 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190131bf-a46b-4c4d-8fcf-62231888f68d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:33.425281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190131bf-a46b-4c4d-8fcf-62231888f68d None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:33.426253 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190131bf-a46b-4c4d-8fcf-62231888f68d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:33.426372 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190131bf-a46b-4c4d-8fcf-62231888f68d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:33.427894 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190131bf-a46b-4c4d-8fcf-62231888f68d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:33.451535 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 278/535] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:33.457503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190131bf-a46b-4c4d-8fcf-62231888f68d None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:33.471521 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428fc31-62dc-4c21-9d40-6e12c923a6ca None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:33.529269 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535aa02-1395-4a57-8206-f04ccc0ac85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:33.530067 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535aa02-1395-4a57-8206-f04ccc0ac85c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:33.530352 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535aa02-1395-4a57-8206-f04ccc0ac85c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:33.530645 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535aa02-1395-4a57-8206-f04ccc0ac85c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:33.552200 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535aa02-1395-4a57-8206-f04ccc0ac85c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:33.553677 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0535aa02-1395-4a57-8206-f04ccc0ac85c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:33.584337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-0535aa02-1395-4a57-8206-f04ccc0ac85c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:33.585593 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 258/536] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:33.592195 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535aa02-1395-4a57-8206-f04ccc0ac85c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:33.625189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190131bf-a46b-4c4d-8fcf-62231888f68d None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:33.687883 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11172232-3b6b-4ed7-b3a8-c88623f13ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:33.688461 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11172232-3b6b-4ed7-b3a8-c88623f13ffa None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:33.688743 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11172232-3b6b-4ed7-b3a8-c88623f13ffa None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:33.689014 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11172232-3b6b-4ed7-b3a8-c88623f13ffa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:33.689830 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11172232-3b6b-4ed7-b3a8-c88623f13ffa None admin] RBAC: Adding query filter params (role.id=16dc6f09d53447fd9e4a95fb1df71d9d, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=a4531e7936634508bb4cbfaaaca5bbde) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:33.690882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11172232-3b6b-4ed7-b3a8-c88623f13ffa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:33.692522 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11172232-3b6b-4ed7-b3a8-c88623f13ffa None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:33.706884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 279/537] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:37:33 2022] GET /identity/v3/role_assignments?user.id=a4531e7936634508bb4cbfaaaca5bbde&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=16dc6f09d53447fd9e4a95fb1df71d9d => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:33.753569 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0535aa02-1395-4a57-8206-f04ccc0ac85c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:33.790159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3560b-a7f7-47ac-b6f2-668d3219916d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:33.790869 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3560b-a7f7-47ac-b6f2-668d3219916d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:33.791201 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3560b-a7f7-47ac-b6f2-668d3219916d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:33.791482 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3560b-a7f7-47ac-b6f2-668d3219916d None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:33.792213 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3560b-a7f7-47ac-b6f2-668d3219916d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:33.792515 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3560b-a7f7-47ac-b6f2-668d3219916d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:33.793901 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3560b-a7f7-47ac-b6f2-668d3219916d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:33.807228 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 259/538] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:33.815831 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11172232-3b6b-4ed7-b3a8-c88623f13ffa None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:33.928059 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11172232-3b6b-4ed7-b3a8-c88623f13ffa None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:33.963257 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb80f52-a98b-4832-8693-dd29fe0bfc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:33.964341 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb80f52-a98b-4832-8693-dd29fe0bfc44 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:33.964620 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb80f52-a98b-4832-8693-dd29fe0bfc44 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:33.964888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb80f52-a98b-4832-8693-dd29fe0bfc44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:33.973509 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb80f52-a98b-4832-8693-dd29fe0bfc44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:33.973796 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb80f52-a98b-4832-8693-dd29fe0bfc44 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:33.988048 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-2cb80f52-a98b-4832-8693-dd29fe0bfc44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:33.989521 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 280/539] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:33.999665 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3560b-a7f7-47ac-b6f2-668d3219916d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:34.101229 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3560b-a7f7-47ac-b6f2-668d3219916d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:34.135075 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db076ac9-5381-4afe-ac79-7bedcec1aa49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:34.136018 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db076ac9-5381-4afe-ac79-7bedcec1aa49 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:34.136493 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db076ac9-5381-4afe-ac79-7bedcec1aa49 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:34.136934 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db076ac9-5381-4afe-ac79-7bedcec1aa49 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:34.137876 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db076ac9-5381-4afe-ac79-7bedcec1aa49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:34.138357 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db076ac9-5381-4afe-ac79-7bedcec1aa49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:34.139961 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db076ac9-5381-4afe-ac79-7bedcec1aa49 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:34.153449 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 260/540] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:34.159492 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb80f52-a98b-4832-8693-dd29fe0bfc44 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:34.260021 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb80f52-a98b-4832-8693-dd29fe0bfc44 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:34.294901 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77956fbd-ce77-41c5-b38a-ff2ce9d3b3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:34.295909 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77956fbd-ce77-41c5-b38a-ff2ce9d3b3e3 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:34.296386 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77956fbd-ce77-41c5-b38a-ff2ce9d3b3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:34.296856 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77956fbd-ce77-41c5-b38a-ff2ce9d3b3e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:34.297855 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77956fbd-ce77-41c5-b38a-ff2ce9d3b3e3 None admin] RBAC: Adding query filter params (role.id=16dc6f09d53447fd9e4a95fb1df71d9d, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=7990c92f59454156bbd99445387ca889) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:34.298336 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77956fbd-ce77-41c5-b38a-ff2ce9d3b3e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:34.299959 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77956fbd-ce77-41c5-b38a-ff2ce9d3b3e3 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:34.306838 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 281/541] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:37:34 2022] GET /identity/v3/role_assignments?user.id=7990c92f59454156bbd99445387ca889&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=16dc6f09d53447fd9e4a95fb1df71d9d => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:35.126840 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72755c-e9c5-4a9b-a7e1-944d828cbbce None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:35.127353 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72755c-e9c5-4a9b-a7e1-944d828cbbce None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:35.127353 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72755c-e9c5-4a9b-a7e1-944d828cbbce None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:35.128971 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 261/542] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:35.133957 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d8363-a65a-437a-8aee-b01cd201e791 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:35.134363 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d8363-a65a-437a-8aee-b01cd201e791 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:35.134531 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d8363-a65a-437a-8aee-b01cd201e791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:35.151693 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-102d8363-a65a-437a-8aee-b01cd201e791 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:35.152880 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-102d8363-a65a-437a-8aee-b01cd201e791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:35.219776 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 282/543] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:35.242549 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72755c-e9c5-4a9b-a7e1-944d828cbbce None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:35.344433 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72755c-e9c5-4a9b-a7e1-944d828cbbce None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:35.347887 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902e4ca-72c4-48db-b94e-b991ff8eb0ee None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:35.348177 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902e4ca-72c4-48db-b94e-b991ff8eb0ee None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:35.348456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902e4ca-72c4-48db-b94e-b991ff8eb0ee None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:35.350080 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 283/544] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:37:35.355294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb26e8-a8d6-4b42-993d-da3b9081f3fa None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:35.355578 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb26e8-a8d6-4b42-993d-da3b9081f3fa None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:35.355904 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb26e8-a8d6-4b42-993d-da3b9081f3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:35.372506 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-c4cb26e8-a8d6-4b42-993d-da3b9081f3fa None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:35.373689 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-c4cb26e8-a8d6-4b42-993d-da3b9081f3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:35.390727 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a9376-50d4-4420-9b49-f95825fd36dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:35.391532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a9376-50d4-4420-9b49-f95825fd36dd None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:35.391811 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a9376-50d4-4420-9b49-f95825fd36dd None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:35.392083 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a9376-50d4-4420-9b49-f95825fd36dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:35.405988 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a9376-50d4-4420-9b49-f95825fd36dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:35.413497 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-b27a9376-50d4-4420-9b49-f95825fd36dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:37:35.415538 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 262/545] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:35.424584 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a9376-50d4-4420-9b49-f95825fd36dd None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:35.508361 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 284/546] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:35.537347 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb26e8-a8d6-4b42-993d-da3b9081f3fa None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:35.581405 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a9376-50d4-4420-9b49-f95825fd36dd None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:35.621014 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b283f8-4eab-4400-bb41-ce83e644ef58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:35.622063 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b283f8-4eab-4400-bb41-ce83e644ef58 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:35.622560 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b283f8-4eab-4400-bb41-ce83e644ef58 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:35.623225 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b283f8-4eab-4400-bb41-ce83e644ef58 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:35.626068 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b283f8-4eab-4400-bb41-ce83e644ef58 None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:35.626624 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b283f8-4eab-4400-bb41-ce83e644ef58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:35.628221 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b283f8-4eab-4400-bb41-ce83e644ef58 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:35.649336 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 263/547] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:37:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:35.651127 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b283f8-4eab-4400-bb41-ce83e644ef58 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:35.747450 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb26e8-a8d6-4b42-993d-da3b9081f3fa None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:35.763119 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b283f8-4eab-4400-bb41-ce83e644ef58 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:35.781393 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cae14e-a8b7-434c-be78-f2271f03d0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:35.782468 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cae14e-a8b7-434c-be78-f2271f03d0eb None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:35.782778 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cae14e-a8b7-434c-be78-f2271f03d0eb None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:35.783049 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cae14e-a8b7-434c-be78-f2271f03d0eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:35.793745 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cae14e-a8b7-434c-be78-f2271f03d0eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:35.800660 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-95cae14e-a8b7-434c-be78-f2271f03d0eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:37:35.802128 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 285/548] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:35.808061 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cae14e-a8b7-434c-be78-f2271f03d0eb None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:35.811298 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad9bd7-75fa-4114-81d9-5befe36f43f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:35.812364 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad9bd7-75fa-4114-81d9-5befe36f43f3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:35.812870 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad9bd7-75fa-4114-81d9-5befe36f43f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:35.813341 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad9bd7-75fa-4114-81d9-5befe36f43f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:35.835853 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad9bd7-75fa-4114-81d9-5befe36f43f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:35.838199 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad9bd7-75fa-4114-81d9-5befe36f43f3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:35.865934 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-e7ad9bd7-75fa-4114-81d9-5befe36f43f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:35.874904 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 264/549] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:35.875686 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad9bd7-75fa-4114-81d9-5befe36f43f3 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:35.907376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cae14e-a8b7-434c-be78-f2271f03d0eb None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:35.958001 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b6e8f-b28b-4368-b866-503a73833b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:35.958705 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b6e8f-b28b-4368-b866-503a73833b96 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:35.958985 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b6e8f-b28b-4368-b866-503a73833b96 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:35.959256 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6b6e8f-b28b-4368-b866-503a73833b96 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:35.960007 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b6e8f-b28b-4368-b866-503a73833b96 None admin] RBAC: Adding query filter params (name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:35.960306 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b6e8f-b28b-4368-b866-503a73833b96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:35.962245 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6b6e8f-b28b-4368-b866-503a73833b96 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:35.977347 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 286/550] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:37:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:35.984471 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b6e8f-b28b-4368-b866-503a73833b96 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:36.072853 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad9bd7-75fa-4114-81d9-5befe36f43f3 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:36.091665 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6b6e8f-b28b-4368-b866-503a73833b96 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:36.116774 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cdb3d-9fbf-462d-a395-9e385e941061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:36.117858 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cdb3d-9fbf-462d-a395-9e385e941061 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:36.118342 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cdb3d-9fbf-462d-a395-9e385e941061 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:36.118837 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cdb3d-9fbf-462d-a395-9e385e941061 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:36.119751 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cdb3d-9fbf-462d-a395-9e385e941061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:36.120264 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cdb3d-9fbf-462d-a395-9e385e941061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:36.121833 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cdb3d-9fbf-462d-a395-9e385e941061 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:36.126215 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50c0fc-7680-45f1-9213-dc6a1c8afbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:36.127346 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50c0fc-7680-45f1-9213-dc6a1c8afbf4 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:36.127821 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50c0fc-7680-45f1-9213-dc6a1c8afbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:36.128313 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac50c0fc-7680-45f1-9213-dc6a1c8afbf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:36.139764 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50c0fc-7680-45f1-9213-dc6a1c8afbf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:36.142231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac50c0fc-7680-45f1-9213-dc6a1c8afbf4 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:36.147951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 265/551] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:36.153609 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cdb3d-9fbf-462d-a395-9e385e941061 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:36.160525 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-ac50c0fc-7680-45f1-9213-dc6a1c8afbf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:36.162235 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 287/552] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:36.167740 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50c0fc-7680-45f1-9213-dc6a1c8afbf4 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:36.271175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac50c0fc-7680-45f1-9213-dc6a1c8afbf4 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:36.333505 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cdb3d-9fbf-462d-a395-9e385e941061 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:36.362185 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08175658-f813-4776-afd7-d668f7f3e41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:36.362892 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08175658-f813-4776-afd7-d668f7f3e41d None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:36.363178 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08175658-f813-4776-afd7-d668f7f3e41d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:36.363454 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08175658-f813-4776-afd7-d668f7f3e41d None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:36.364187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08175658-f813-4776-afd7-d668f7f3e41d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:36.364495 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08175658-f813-4776-afd7-d668f7f3e41d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:36.365867 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08175658-f813-4776-afd7-d668f7f3e41d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:36.371244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be100262-72c2-477f-9762-04a305dfe1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:36.372370 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be100262-72c2-477f-9762-04a305dfe1b2 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:36.372846 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be100262-72c2-477f-9762-04a305dfe1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:36.373333 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be100262-72c2-477f-9762-04a305dfe1b2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:36.382524 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be100262-72c2-477f-9762-04a305dfe1b2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:36.384806 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be100262-72c2-477f-9762-04a305dfe1b2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:36.392220 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 288/553] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:36.398578 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08175658-f813-4776-afd7-d668f7f3e41d None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:36.406251 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-be100262-72c2-477f-9762-04a305dfe1b2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 16:37:36.408047 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 266/554] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Apr 11 16:37:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:36.417397 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfff0c-ea8c-4802-b7e4-45d1259b8f2d None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:36.417710 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfff0c-ea8c-4802-b7e4-45d1259b8f2d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:36.417988 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfff0c-ea8c-4802-b7e4-45d1259b8f2d None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:36.419843 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 267/555] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:36.420550 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfff0c-ea8c-4802-b7e4-45d1259b8f2d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:36.509187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08175658-f813-4776-afd7-d668f7f3e41d None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:36.528490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfff0c-ea8c-4802-b7e4-45d1259b8f2d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:36.552978 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f3ac3-7149-4114-940c-104c60a642f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:36.554293 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f3ac3-7149-4114-940c-104c60a642f9 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:36.554846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f3ac3-7149-4114-940c-104c60a642f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:36.555354 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f3ac3-7149-4114-940c-104c60a642f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:36.563256 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f3ac3-7149-4114-940c-104c60a642f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:36.565324 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f3ac3-7149-4114-940c-104c60a642f9 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:36.567567 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977e919-32f9-4b23-ad8b-ddb97bf2f4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:36.568438 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977e919-32f9-4b23-ad8b-ddb97bf2f4f6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:36.568755 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977e919-32f9-4b23-ad8b-ddb97bf2f4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:36.569118 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977e919-32f9-4b23-ad8b-ddb97bf2f4f6 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:36.570067 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977e919-32f9-4b23-ad8b-ddb97bf2f4f6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:36.570441 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977e919-32f9-4b23-ad8b-ddb97bf2f4f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:36.572002 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b977e919-32f9-4b23-ad8b-ddb97bf2f4f6 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:36.580831 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-6a9f3ac3-7149-4114-940c-104c60a642f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 16:37:36.587712 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 289/556] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:37:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:36.589396 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a077d04-25f7-4f35-aa74-e1d1a561b3f3 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:36.589884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a077d04-25f7-4f35-aa74-e1d1a561b3f3 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:36.591823 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 268/557] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Apr 11 16:37:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:36.592111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977e919-32f9-4b23-ad8b-ddb97bf2f4f6 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:36.592364 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a077d04-25f7-4f35-aa74-e1d1a561b3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:36.609762 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-2a077d04-25f7-4f35-aa74-e1d1a561b3f3 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:36.611260 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-2a077d04-25f7-4f35-aa74-e1d1a561b3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:36.677002 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 290/558] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:36.678212 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a077d04-25f7-4f35-aa74-e1d1a561b3f3 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:36.715029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977e919-32f9-4b23-ad8b-ddb97bf2f4f6 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:36.757801 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee5cca-57f3-4907-bfbe-30710d463af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:36.758844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee5cca-57f3-4907-bfbe-30710d463af9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:36.759134 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee5cca-57f3-4907-bfbe-30710d463af9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:36.759688 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee5cca-57f3-4907-bfbe-30710d463af9 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:36.760524 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee5cca-57f3-4907-bfbe-30710d463af9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:36.760839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee5cca-57f3-4907-bfbe-30710d463af9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:36.763078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee5cca-57f3-4907-bfbe-30710d463af9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:36.781830 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 269/559] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Apr 11 16:37:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:36.782857 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee5cca-57f3-4907-bfbe-30710d463af9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:36.783573 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a077d04-25f7-4f35-aa74-e1d1a561b3f3 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:36.817122 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8719f45a-9402-4bb1-8970-3b1996192bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:36.817945 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719f45a-9402-4bb1-8970-3b1996192bf1 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:36.818233 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719f45a-9402-4bb1-8970-3b1996192bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:36.818559 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8719f45a-9402-4bb1-8970-3b1996192bf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:36.830025 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719f45a-9402-4bb1-8970-3b1996192bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:36.831527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8719f45a-9402-4bb1-8970-3b1996192bf1 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:36.849233 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-8719f45a-9402-4bb1-8970-3b1996192bf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:36.850374 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 291/560] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:36.851597 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec478134-8ab7-4454-8847-6b617b9eb75f None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:36.851874 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec478134-8ab7-4454-8847-6b617b9eb75f None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:36.852395 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec478134-8ab7-4454-8847-6b617b9eb75f None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:36.853829 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 292/561] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:36.857335 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec478134-8ab7-4454-8847-6b617b9eb75f None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:36.886675 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee5cca-57f3-4907-bfbe-30710d463af9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:36.924445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a6563-e3f4-465a-9db8-cabbd7acfbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:36.925254 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a6563-e3f4-465a-9db8-cabbd7acfbad None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:36.925532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a6563-e3f4-465a-9db8-cabbd7acfbad None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:36.925807 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a6563-e3f4-465a-9db8-cabbd7acfbad None admin] PATH_INFO: `/v3/roles/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:36.935801 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a6563-e3f4-465a-9db8-cabbd7acfbad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:36.942854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-ac6a6563-e3f4-465a-9db8-cabbd7acfbad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:37:36.944226 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 270/562] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:36.944923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a6563-e3f4-465a-9db8-cabbd7acfbad None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:36.958857 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec478134-8ab7-4454-8847-6b617b9eb75f None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:36.991692 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ae996d-aebc-4c8d-a9ff-dfc0bd5d1a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:36.992331 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae996d-aebc-4c8d-a9ff-dfc0bd5d1a2f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:36.992612 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae996d-aebc-4c8d-a9ff-dfc0bd5d1a2f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:36.992910 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae996d-aebc-4c8d-a9ff-dfc0bd5d1a2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:37.039178 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a6563-e3f4-465a-9db8-cabbd7acfbad None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:37.056354 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae996d-aebc-4c8d-a9ff-dfc0bd5d1a2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:37.057810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ae996d-aebc-4c8d-a9ff-dfc0bd5d1a2f None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:37.070323 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2efff-08c7-447c-8db1-03ed0bfaaa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:37.071537 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2efff-08c7-447c-8db1-03ed0bfaaa3d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:37.071822 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2efff-08c7-447c-8db1-03ed0bfaaa3d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:37.072098 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2efff-08c7-447c-8db1-03ed0bfaaa3d None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:37.072806 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2efff-08c7-447c-8db1-03ed0bfaaa3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:37.073112 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2efff-08c7-447c-8db1-03ed0bfaaa3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:37.074480 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2efff-08c7-447c-8db1-03ed0bfaaa3d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:37.085630 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 271/563] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:37.087513 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c66282-e1f1-4294-8408-3d706ed620a1 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:37.087797 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c66282-e1f1-4294-8408-3d706ed620a1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:37.088077 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c66282-e1f1-4294-8408-3d706ed620a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:37.104998 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b7c66282-e1f1-4294-8408-3d706ed620a1 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:37.106124 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b7c66282-e1f1-4294-8408-3d706ed620a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:37.151382 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 293/564] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:37.152776 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c11d9-b925-4d2d-b599-b9c200ea4690 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:37.153072 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c11d9-b925-4d2d-b599-b9c200ea4690 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:37.153357 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c11d9-b925-4d2d-b599-b9c200ea4690 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:37.154616 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 294/565] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:37.155320 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c11d9-b925-4d2d-b599-b9c200ea4690 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:37.173612 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 272/566] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:37.174452 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c66282-e1f1-4294-8408-3d706ed620a1 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:37.251425 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c11d9-b925-4d2d-b599-b9c200ea4690 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:37.274885 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c66282-e1f1-4294-8408-3d706ed620a1 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:37.283386 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4aa4c-70c6-4236-8634-3b95e143e8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:37.284045 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4aa4c-70c6-4236-8634-3b95e143e8e2 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:37.284326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4aa4c-70c6-4236-8634-3b95e143e8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:37.284605 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4aa4c-70c6-4236-8634-3b95e143e8e2 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:37.285332 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4aa4c-70c6-4236-8634-3b95e143e8e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:37.285634 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4aa4c-70c6-4236-8634-3b95e143e8e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:37.287029 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4aa4c-70c6-4236-8634-3b95e143e8e2 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:37.294574 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 295/567] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:37:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:37.295469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4aa4c-70c6-4236-8634-3b95e143e8e2 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:37.307597 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acf7c7-8849-4cf6-a6f9-14921ec53f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:37.308388 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acf7c7-8849-4cf6-a6f9-14921ec53f74 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:37.308675 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acf7c7-8849-4cf6-a6f9-14921ec53f74 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:37.308949 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acf7c7-8849-4cf6-a6f9-14921ec53f74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:37.315600 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acf7c7-8849-4cf6-a6f9-14921ec53f74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:37.317048 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31acf7c7-8849-4cf6-a6f9-14921ec53f74 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:37.330242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-31acf7c7-8849-4cf6-a6f9-14921ec53f74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:37.331446 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 273/568] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:37.332600 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a64ba-9fd1-48c7-811c-3a75e6e98b66 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:37.332884 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a64ba-9fd1-48c7-811c-3a75e6e98b66 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:37.333162 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a64ba-9fd1-48c7-811c-3a75e6e98b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:37.348938 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ce8a64ba-9fd1-48c7-811c-3a75e6e98b66 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:37.350114 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ce8a64ba-9fd1-48c7-811c-3a75e6e98b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:37.391314 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4aa4c-70c6-4236-8634-3b95e143e8e2 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:37.412326 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 274/569] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:37.413158 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a64ba-9fd1-48c7-811c-3a75e6e98b66 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:37.431182 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb40e25-f731-43c4-b3b3-979b0f47dea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:37.431987 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb40e25-f731-43c4-b3b3-979b0f47dea5 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:37.432257 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb40e25-f731-43c4-b3b3-979b0f47dea5 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:37.432533 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb40e25-f731-43c4-b3b3-979b0f47dea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:37.443579 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb40e25-f731-43c4-b3b3-979b0f47dea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:37.445023 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb40e25-f731-43c4-b3b3-979b0f47dea5 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:37.461391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-cdb40e25-f731-43c4-b3b3-979b0f47dea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:37.462626 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 296/570] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:37.463478 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb40e25-f731-43c4-b3b3-979b0f47dea5 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:37.507935 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a64ba-9fd1-48c7-811c-3a75e6e98b66 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:37.540135 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8bee7-3c92-43d9-a405-85540adc0a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:37.540921 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8bee7-3c92-43d9-a405-85540adc0a44 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:37.541221 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8bee7-3c92-43d9-a405-85540adc0a44 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:37.541481 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f8bee7-3c92-43d9-a405-85540adc0a44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:37.551079 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f8bee7-3c92-43d9-a405-85540adc0a44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:37.556541 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb40e25-f731-43c4-b3b3-979b0f47dea5 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:37.558430 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-b1f8bee7-3c92-43d9-a405-85540adc0a44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:37:37.559646 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 275/571] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:37.560407 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8bee7-3c92-43d9-a405-85540adc0a44 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:37.588202 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7edf8-72ec-43a8-ae51-bf4ac436fc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:37.588983 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7edf8-72ec-43a8-ae51-bf4ac436fc07 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:37.589259 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7edf8-72ec-43a8-ae51-bf4ac436fc07 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:37.589528 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7edf8-72ec-43a8-ae51-bf4ac436fc07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:37.599432 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7edf8-72ec-43a8-ae51-bf4ac436fc07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:37.600882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7edf8-72ec-43a8-ae51-bf4ac436fc07 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:37.617060 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-d8e7edf8-72ec-43a8-ae51-bf4ac436fc07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:37.618837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 297/572] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:37.619601 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7edf8-72ec-43a8-ae51-bf4ac436fc07 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:37.666957 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f8bee7-3c92-43d9-a405-85540adc0a44 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:37.702718 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee259a5-c7da-41ea-a449-7bb1e1d050cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:37.703583 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee259a5-c7da-41ea-a449-7bb1e1d050cc None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:37.704270 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee259a5-c7da-41ea-a449-7bb1e1d050cc None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:37.704557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee259a5-c7da-41ea-a449-7bb1e1d050cc None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:37.705653 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee259a5-c7da-41ea-a449-7bb1e1d050cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:37.705965 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee259a5-c7da-41ea-a449-7bb1e1d050cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:37.707415 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee259a5-c7da-41ea-a449-7bb1e1d050cc None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:37.712060 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7edf8-72ec-43a8-ae51-bf4ac436fc07 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:37.721490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 276/573] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:37.722287 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee259a5-c7da-41ea-a449-7bb1e1d050cc None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:37.744681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e489b49-f48b-4672-b893-62afc9b96c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:37.745464 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e489b49-f48b-4672-b893-62afc9b96c2a None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:37.745740 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e489b49-f48b-4672-b893-62afc9b96c2a None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:37.746009 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e489b49-f48b-4672-b893-62afc9b96c2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:37.755500 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e489b49-f48b-4672-b893-62afc9b96c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:37.762374 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-8e489b49-f48b-4672-b893-62afc9b96c2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:37:37.763573 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 298/574] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:37.764323 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e489b49-f48b-4672-b893-62afc9b96c2a None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:37.823250 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee259a5-c7da-41ea-a449-7bb1e1d050cc None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:37.855564 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819c25b-914f-42c0-ae10-7c224a900588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:37.855744 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e489b49-f48b-4672-b893-62afc9b96c2a None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:37.856213 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819c25b-914f-42c0-ae10-7c224a900588 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:37.856493 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819c25b-914f-42c0-ae10-7c224a900588 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:37.856767 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819c25b-914f-42c0-ae10-7c224a900588 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:37.857482 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819c25b-914f-42c0-ae10-7c224a900588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:37.857789 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819c25b-914f-42c0-ae10-7c224a900588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:37.859175 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7819c25b-914f-42c0-ae10-7c224a900588 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:37.870455 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 277/575] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:37.871276 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819c25b-914f-42c0-ae10-7c224a900588 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:37.887387 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc8028-7e48-47ad-97eb-a156e28d6e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:37.888036 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc8028-7e48-47ad-97eb-a156e28d6e80 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:37.888312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc8028-7e48-47ad-97eb-a156e28d6e80 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:37.888580 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc8028-7e48-47ad-97eb-a156e28d6e80 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:37.889307 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc8028-7e48-47ad-97eb-a156e28d6e80 None admin] RBAC: Adding query filter params (name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:37.889606 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc8028-7e48-47ad-97eb-a156e28d6e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:37.891273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbc8028-7e48-47ad-97eb-a156e28d6e80 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:37.898938 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 299/576] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:37:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:37.899630 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc8028-7e48-47ad-97eb-a156e28d6e80 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:37.973840 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819c25b-914f-42c0-ae10-7c224a900588 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:38.001263 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc8028-7e48-47ad-97eb-a156e28d6e80 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:38.005230 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f2c3c-0ab0-4652-bb0d-977ae5395dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:38.005861 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f2c3c-0ab0-4652-bb0d-977ae5395dbb None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:38.006136 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f2c3c-0ab0-4652-bb0d-977ae5395dbb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:38.006406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f2c3c-0ab0-4652-bb0d-977ae5395dbb None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:38.007143 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f2c3c-0ab0-4652-bb0d-977ae5395dbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:38.007444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f2c3c-0ab0-4652-bb0d-977ae5395dbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:38.008823 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f2c3c-0ab0-4652-bb0d-977ae5395dbb None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:38.020243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 278/577] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:38.020941 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f2c3c-0ab0-4652-bb0d-977ae5395dbb None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:38.033261 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130faa6f-fddc-4d63-bcda-9b2b4fd718c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:38.034142 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130faa6f-fddc-4d63-bcda-9b2b4fd718c9 None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:38.034428 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130faa6f-fddc-4d63-bcda-9b2b4fd718c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:38.034721 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130faa6f-fddc-4d63-bcda-9b2b4fd718c9 None admin] PATH_INFO: `/v3/projects/c1eb8559ca744abda7039b767af5818f/users/ba3665d046864985916fdd6c4a4edcd1/roles/16dc6f09d53447fd9e4a95fb1df71d9d` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:38.049349 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130faa6f-fddc-4d63-bcda-9b2b4fd718c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1eb8559ca744abda7039b767af5818f, user_id=ba3665d046864985916fdd6c4a4edcd1, role_id=16dc6f09d53447fd9e4a95fb1df71d9d)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:38.050799 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130faa6f-fddc-4d63-bcda-9b2b4fd718c9 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:38.062158 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 300/578] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:37:37 2022] PUT /identity/v3/projects/c1eb8559ca744abda7039b767af5818f/users/ba3665d046864985916fdd6c4a4edcd1/roles/16dc6f09d53447fd9e4a95fb1df71d9d => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:37:38.064083 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130faa6f-fddc-4d63-bcda-9b2b4fd718c9 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:38.121674 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f2c3c-0ab0-4652-bb0d-977ae5395dbb None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:38.158167 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96dd55-30a1-40bf-bb71-c4ec5572c808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:38.158877 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96dd55-30a1-40bf-bb71-c4ec5572c808 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:38.159156 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96dd55-30a1-40bf-bb71-c4ec5572c808 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:38.159421 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96dd55-30a1-40bf-bb71-c4ec5572c808 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:38.160175 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96dd55-30a1-40bf-bb71-c4ec5572c808 None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:38.160478 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96dd55-30a1-40bf-bb71-c4ec5572c808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:38.161879 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96dd55-30a1-40bf-bb71-c4ec5572c808 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:38.170819 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 279/579] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:37:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:38.172128 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96dd55-30a1-40bf-bb71-c4ec5572c808 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:38.176280 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130faa6f-fddc-4d63-bcda-9b2b4fd718c9 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:38.213693 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1e39c-2128-4e34-8a77-a07649067324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:38.214431 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1e39c-2128-4e34-8a77-a07649067324 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:38.214746 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1e39c-2128-4e34-8a77-a07649067324 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:38.215020 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c1e39c-2128-4e34-8a77-a07649067324 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:38.222401 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1e39c-2128-4e34-8a77-a07649067324 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:38.223927 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c1e39c-2128-4e34-8a77-a07649067324 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:38.238168 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-a6c1e39c-2128-4e34-8a77-a07649067324 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:38.239438 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 301/580] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:38.240282 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1e39c-2128-4e34-8a77-a07649067324 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:38.282110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96dd55-30a1-40bf-bb71-c4ec5572c808 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:38.314556 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c013f75-3563-4006-8139-1183d2d15b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:38.315389 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c013f75-3563-4006-8139-1183d2d15b99 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:38.315688 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c013f75-3563-4006-8139-1183d2d15b99 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:38.315965 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c013f75-3563-4006-8139-1183d2d15b99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:38.327657 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c013f75-3563-4006-8139-1183d2d15b99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:38.329142 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c013f75-3563-4006-8139-1183d2d15b99 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:38.343344 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c1e39c-2128-4e34-8a77-a07649067324 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:38.345187 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-4c013f75-3563-4006-8139-1183d2d15b99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:38.346390 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 280/581] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:38.347202 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c013f75-3563-4006-8139-1183d2d15b99 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:38.380878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c0605-ab59-45e7-9588-97ab30f6224b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:38.381782 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c0605-ab59-45e7-9588-97ab30f6224b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:38.382125 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c0605-ab59-45e7-9588-97ab30f6224b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:38.382469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c0605-ab59-45e7-9588-97ab30f6224b None admin] PATH_INFO: `/v3/users/glance` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:38.389936 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c0605-ab59-45e7-9588-97ab30f6224b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:38.391664 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9c0605-ab59-45e7-9588-97ab30f6224b None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:38.404745 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-4d9c0605-ab59-45e7-9588-97ab30f6224b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 11 16:37:38.405935 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 302/582] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:38.406726 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c0605-ab59-45e7-9588-97ab30f6224b None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:38.459225 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c013f75-3563-4006-8139-1183d2d15b99 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:38.500882 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f57af-1829-4661-a441-cc693f456289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:38.502044 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f57af-1829-4661-a441-cc693f456289 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:38.502391 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f57af-1829-4661-a441-cc693f456289 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:38.502845 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f57af-1829-4661-a441-cc693f456289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:38.505929 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c0605-ab59-45e7-9588-97ab30f6224b None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:38.514617 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f57af-1829-4661-a441-cc693f456289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:38.516400 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36f57af-1829-4661-a441-cc693f456289 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:38.536172 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-f36f57af-1829-4661-a441-cc693f456289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:38.537772 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 281/583] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:38.538690 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f57af-1829-4661-a441-cc693f456289 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:38.543122 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa9b64-3071-43db-b51e-a0d31c123f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:38.543786 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa9b64-3071-43db-b51e-a0d31c123f52 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:38.544067 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa9b64-3071-43db-b51e-a0d31c123f52 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:38.544338 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa9b64-3071-43db-b51e-a0d31c123f52 None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:38.545116 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa9b64-3071-43db-b51e-a0d31c123f52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:38.545422 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa9b64-3071-43db-b51e-a0d31c123f52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:38.547069 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa9b64-3071-43db-b51e-a0d31c123f52 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:38.559411 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 303/584] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:38.564462 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa9b64-3071-43db-b51e-a0d31c123f52 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:38.655854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f57af-1829-4661-a441-cc693f456289 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:38.661081 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa9b64-3071-43db-b51e-a0d31c123f52 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:38.688490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbe4b6-df72-4b45-8f98-db6f78536262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:38.689143 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbe4b6-df72-4b45-8f98-db6f78536262 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:38.689425 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbe4b6-df72-4b45-8f98-db6f78536262 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:38.689706 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbe4b6-df72-4b45-8f98-db6f78536262 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:38.690412 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbe4b6-df72-4b45-8f98-db6f78536262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:38.690740 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbe4b6-df72-4b45-8f98-db6f78536262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:38.692097 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfbe4b6-df72-4b45-8f98-db6f78536262 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:38.694537 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f317875-207c-4624-9831-afcf0e1e72ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:38.695285 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f317875-207c-4624-9831-afcf0e1e72ea None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:38.695623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f317875-207c-4624-9831-afcf0e1e72ea None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:38.695989 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f317875-207c-4624-9831-afcf0e1e72ea None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:38.696878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f317875-207c-4624-9831-afcf0e1e72ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:38.697243 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f317875-207c-4624-9831-afcf0e1e72ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:38.698737 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f317875-207c-4624-9831-afcf0e1e72ea None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:38.703541 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 282/585] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:38.704502 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbe4b6-df72-4b45-8f98-db6f78536262 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:38.719775 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 304/586] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Apr 11 16:37:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:38.720607 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f317875-207c-4624-9831-afcf0e1e72ea None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:38.809408 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbe4b6-df72-4b45-8f98-db6f78536262 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:38.820445 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f317875-207c-4624-9831-afcf0e1e72ea None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:38.844179 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adaa36-c770-44b6-aeeb-d35e645c5769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:38.844848 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adaa36-c770-44b6-aeeb-d35e645c5769 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:38.845130 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adaa36-c770-44b6-aeeb-d35e645c5769 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:38.845406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adaa36-c770-44b6-aeeb-d35e645c5769 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:38.846126 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adaa36-c770-44b6-aeeb-d35e645c5769 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:38.846434 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adaa36-c770-44b6-aeeb-d35e645c5769 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:38.847840 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87adaa36-c770-44b6-aeeb-d35e645c5769 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:38.857976 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe1112-4749-4aa2-84fa-2e8d42df77ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:38.860336 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe1112-4749-4aa2-84fa-2e8d42df77ea None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:38.860336 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe1112-4749-4aa2-84fa-2e8d42df77ea None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:38.860336 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe1112-4749-4aa2-84fa-2e8d42df77ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:38.860580 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 283/587] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:38.860652 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe1112-4749-4aa2-84fa-2e8d42df77ea None admin] RBAC: Adding query filter params (role.id=16dc6f09d53447fd9e4a95fb1df71d9d, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=1f6659c6661840a79ba9ff1c3c9e93c6) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:38.860652 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe1112-4749-4aa2-84fa-2e8d42df77ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:38.860787 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adaa36-c770-44b6-aeeb-d35e645c5769 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:38.866651 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe1112-4749-4aa2-84fa-2e8d42df77ea None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:38.868789 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 305/588] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:37:38 2022] GET /identity/v3/role_assignments?user.id=1f6659c6661840a79ba9ff1c3c9e93c6&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=16dc6f09d53447fd9e4a95fb1df71d9d => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:38.869887 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe1112-4749-4aa2-84fa-2e8d42df77ea None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:38.971140 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adaa36-c770-44b6-aeeb-d35e645c5769 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:38.980794 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe1112-4749-4aa2-84fa-2e8d42df77ea None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:39.007592 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a148f9-ccc5-4827-9623-80809cfab175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:39.008679 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a148f9-ccc5-4827-9623-80809cfab175 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:39.009029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a148f9-ccc5-4827-9623-80809cfab175 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:39.009401 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a148f9-ccc5-4827-9623-80809cfab175 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:39.016127 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee40fa7-239c-4937-84a3-69013b21d782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:39.016933 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee40fa7-239c-4937-84a3-69013b21d782 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:39.017210 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee40fa7-239c-4937-84a3-69013b21d782 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:39.017483 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee40fa7-239c-4937-84a3-69013b21d782 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:39.018800 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a148f9-ccc5-4827-9623-80809cfab175 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:39.020414 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a148f9-ccc5-4827-9623-80809cfab175 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:39.030229 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee40fa7-239c-4937-84a3-69013b21d782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:39.031739 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee40fa7-239c-4937-84a3-69013b21d782 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:39.035923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-88a148f9-ccc5-4827-9623-80809cfab175 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 16:37:39.042575 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 284/589] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:39.043546 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a148f9-ccc5-4827-9623-80809cfab175 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:39.050414 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-bee40fa7-239c-4937-84a3-69013b21d782 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:39.052031 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 306/590] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:39.052973 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee40fa7-239c-4937-84a3-69013b21d782 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:39.160221 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a148f9-ccc5-4827-9623-80809cfab175 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:39.160424 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee40fa7-239c-4937-84a3-69013b21d782 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:39.198578 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde06fb-bdd9-4abc-9b6c-297bfa53f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:39.199871 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde06fb-bdd9-4abc-9b6c-297bfa53f132 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:39.200352 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde06fb-bdd9-4abc-9b6c-297bfa53f132 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:39.200821 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde06fb-bdd9-4abc-9b6c-297bfa53f132 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:39.209762 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde06fb-bdd9-4abc-9b6c-297bfa53f132 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:39.211676 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfde06fb-bdd9-4abc-9b6c-297bfa53f132 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:39.215370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b29d7-5fcc-44cf-b5db-fe609d447f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:39.216057 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b29d7-5fcc-44cf-b5db-fe609d447f74 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:39.216342 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b29d7-5fcc-44cf-b5db-fe609d447f74 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:39.216617 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b29d7-5fcc-44cf-b5db-fe609d447f74 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:39.217456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b29d7-5fcc-44cf-b5db-fe609d447f74 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:39.217766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b29d7-5fcc-44cf-b5db-fe609d447f74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:39.219309 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b29d7-5fcc-44cf-b5db-fe609d447f74 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:39.229159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-dfde06fb-bdd9-4abc-9b6c-297bfa53f132 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 11 16:37:39.234942 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 285/591] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:39.236081 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde06fb-bdd9-4abc-9b6c-297bfa53f132 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:39.257496 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 307/592] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Apr 11 16:37:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:39.258425 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b29d7-5fcc-44cf-b5db-fe609d447f74 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:39.366023 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b29d7-5fcc-44cf-b5db-fe609d447f74 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:39.383666 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde06fb-bdd9-4abc-9b6c-297bfa53f132 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:39.406076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c889936-adbf-4eac-963d-29c206d08a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:39.409910 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c889936-adbf-4eac-963d-29c206d08a44 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:39.410212 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c889936-adbf-4eac-963d-29c206d08a44 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:39.410566 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c889936-adbf-4eac-963d-29c206d08a44 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:39.411354 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c889936-adbf-4eac-963d-29c206d08a44 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:39.411664 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c889936-adbf-4eac-963d-29c206d08a44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:39.413281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c889936-adbf-4eac-963d-29c206d08a44 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:39.435907 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 308/593] 10.222.0.73 () {56 vars in 1139 bytes} [Mon Apr 11 16:37:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:39.435907 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c889936-adbf-4eac-963d-29c206d08a44 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:39.439040 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab1920-2ab7-483f-966a-aca035245068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:39.440083 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab1920-2ab7-483f-966a-aca035245068 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:39.440948 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab1920-2ab7-483f-966a-aca035245068 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:39.441501 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab1920-2ab7-483f-966a-aca035245068 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:39.442614 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab1920-2ab7-483f-966a-aca035245068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:39.443696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab1920-2ab7-483f-966a-aca035245068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:39.446628 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab1920-2ab7-483f-966a-aca035245068 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:39.471774 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 286/594] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:39.472932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab1920-2ab7-483f-966a-aca035245068 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:39.531247 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c889936-adbf-4eac-963d-29c206d08a44 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:39.568793 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c762b1-bc97-4b21-b4dd-e88a4885b4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:39.569588 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c762b1-bc97-4b21-b4dd-e88a4885b4ad None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:39.569870 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c762b1-bc97-4b21-b4dd-e88a4885b4ad None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:39.570141 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c762b1-bc97-4b21-b4dd-e88a4885b4ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:39.586311 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c762b1-bc97-4b21-b4dd-e88a4885b4ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:39.587949 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c762b1-bc97-4b21-b4dd-e88a4885b4ad None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:39.605718 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-e6c762b1-bc97-4b21-b4dd-e88a4885b4ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:39.611725 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 309/595] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:39.612588 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c762b1-bc97-4b21-b4dd-e88a4885b4ad None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:39.614230 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab1920-2ab7-483f-966a-aca035245068 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:39.669368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd44510-dc8a-48d2-98d8-b9a153b80944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:39.671048 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd44510-dc8a-48d2-98d8-b9a153b80944 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:39.672181 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd44510-dc8a-48d2-98d8-b9a153b80944 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:39.674004 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd44510-dc8a-48d2-98d8-b9a153b80944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:39.692656 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd44510-dc8a-48d2-98d8-b9a153b80944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:39.694094 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd44510-dc8a-48d2-98d8-b9a153b80944 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:39.718236 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-bdd44510-dc8a-48d2-98d8-b9a153b80944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:39.721774 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 287/596] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:39.722567 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd44510-dc8a-48d2-98d8-b9a153b80944 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:39.835753 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c762b1-bc97-4b21-b4dd-e88a4885b4ad None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:39.882926 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd44510-dc8a-48d2-98d8-b9a153b80944 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:39.894964 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f38b4-7e23-45e8-ad94-168cdfd9178c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:39.895841 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f38b4-7e23-45e8-ad94-168cdfd9178c None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:39.896187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f38b4-7e23-45e8-ad94-168cdfd9178c None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:39.896527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48f38b4-7e23-45e8-ad94-168cdfd9178c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:39.903512 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f38b4-7e23-45e8-ad94-168cdfd9178c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:39.906888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48f38b4-7e23-45e8-ad94-168cdfd9178c None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:39.919611 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-f48f38b4-7e23-45e8-ad94-168cdfd9178c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:39.922184 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ead9c-1eff-4830-b951-60f791207fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:39.922918 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ead9c-1eff-4830-b951-60f791207fec None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:39.923204 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ead9c-1eff-4830-b951-60f791207fec None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:39.923484 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ead9c-1eff-4830-b951-60f791207fec None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:39.924207 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ead9c-1eff-4830-b951-60f791207fec None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:39.924515 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ead9c-1eff-4830-b951-60f791207fec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:39.925509 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 310/597] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:39.925895 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6ead9c-1eff-4830-b951-60f791207fec None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:39.926333 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f38b4-7e23-45e8-ad94-168cdfd9178c None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:39.942393 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 288/598] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:39.950613 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ead9c-1eff-4830-b951-60f791207fec None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:40.034290 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48f38b4-7e23-45e8-ad94-168cdfd9178c None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:40.073495 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34f2bf-a43c-4b36-9f65-1f9207425ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:40.074371 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34f2bf-a43c-4b36-9f65-1f9207425ed9 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:40.074691 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34f2bf-a43c-4b36-9f65-1f9207425ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:40.074967 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34f2bf-a43c-4b36-9f65-1f9207425ed9 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:40.075686 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34f2bf-a43c-4b36-9f65-1f9207425ed9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:40.075986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34f2bf-a43c-4b36-9f65-1f9207425ed9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:40.077375 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34f2bf-a43c-4b36-9f65-1f9207425ed9 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:40.079452 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ead9c-1eff-4830-b951-60f791207fec None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:40.093814 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 311/599] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:40.095164 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34f2bf-a43c-4b36-9f65-1f9207425ed9 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:40.124756 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22921d-8adb-4e8b-8651-97f1b68011ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:40.125778 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22921d-8adb-4e8b-8651-97f1b68011ae None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:40.126331 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22921d-8adb-4e8b-8651-97f1b68011ae None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:40.126630 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22921d-8adb-4e8b-8651-97f1b68011ae None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:40.127601 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22921d-8adb-4e8b-8651-97f1b68011ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:40.127973 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22921d-8adb-4e8b-8651-97f1b68011ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:40.130042 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22921d-8adb-4e8b-8651-97f1b68011ae None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:40.148832 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 289/600] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:40.149744 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22921d-8adb-4e8b-8651-97f1b68011ae None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:40.197042 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34f2bf-a43c-4b36-9f65-1f9207425ed9 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:40.230502 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0679b-2c59-4f0c-897f-784cc181b836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:40.231462 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0679b-2c59-4f0c-897f-784cc181b836 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:40.231889 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0679b-2c59-4f0c-897f-784cc181b836 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:40.232256 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0679b-2c59-4f0c-897f-784cc181b836 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:40.239211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0679b-2c59-4f0c-897f-784cc181b836 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:40.240739 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a0679b-2c59-4f0c-897f-784cc181b836 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:40.248780 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22921d-8adb-4e8b-8651-97f1b68011ae None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:40.254608 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-18a0679b-2c59-4f0c-897f-784cc181b836 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:40.255862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 312/601] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:40.256833 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0679b-2c59-4f0c-897f-784cc181b836 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:40.285959 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b257a56-d550-4546-b1bc-973497d42f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:40.286922 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b257a56-d550-4546-b1bc-973497d42f05 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:40.287261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b257a56-d550-4546-b1bc-973497d42f05 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:40.287614 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b257a56-d550-4546-b1bc-973497d42f05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:40.295121 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b257a56-d550-4546-b1bc-973497d42f05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:40.296694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b257a56-d550-4546-b1bc-973497d42f05 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:40.312179 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-0b257a56-d550-4546-b1bc-973497d42f05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:40.318038 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 290/602] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:40.318983 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b257a56-d550-4546-b1bc-973497d42f05 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:40.361367 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0679b-2c59-4f0c-897f-784cc181b836 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:40.395317 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9e130-0b82-4773-b44a-946ee6830aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:40.396212 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9e130-0b82-4773-b44a-946ee6830aac None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:40.396495 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9e130-0b82-4773-b44a-946ee6830aac None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:40.396770 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d9e130-0b82-4773-b44a-946ee6830aac None admin] PATH_INFO: `/v3/projects/c1eb8559ca744abda7039b767af5818f/users/92dc1464c4b24c6c8ea5dfcc796f0279/roles/16dc6f09d53447fd9e4a95fb1df71d9d` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:40.411714 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d9e130-0b82-4773-b44a-946ee6830aac None admin] RBAC: Authorizing `identity:create_grant(project_id=c1eb8559ca744abda7039b767af5818f, user_id=92dc1464c4b24c6c8ea5dfcc796f0279, role_id=16dc6f09d53447fd9e4a95fb1df71d9d)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:40.413168 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d9e130-0b82-4773-b44a-946ee6830aac None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:40.419133 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b257a56-d550-4546-b1bc-973497d42f05 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:40.435195 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 313/603] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:37:40 2022] PUT /identity/v3/projects/c1eb8559ca744abda7039b767af5818f/users/92dc1464c4b24c6c8ea5dfcc796f0279/roles/16dc6f09d53447fd9e4a95fb1df71d9d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:37:40.436502 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9e130-0b82-4773-b44a-946ee6830aac None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:40.479001 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e67b48-e728-461a-9f6e-3db834ea2a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:40.480195 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e67b48-e728-461a-9f6e-3db834ea2a64 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:40.480627 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e67b48-e728-461a-9f6e-3db834ea2a64 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:40.481046 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e67b48-e728-461a-9f6e-3db834ea2a64 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:40.482204 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e67b48-e728-461a-9f6e-3db834ea2a64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:40.482697 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e67b48-e728-461a-9f6e-3db834ea2a64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:40.485289 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e67b48-e728-461a-9f6e-3db834ea2a64 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:40.501546 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 291/604] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:40.503206 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c03b6b-1048-4506-990b-53220713f5e9 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:40.503640 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c03b6b-1048-4506-990b-53220713f5e9 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:40.504057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c03b6b-1048-4506-990b-53220713f5e9 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:40.510127 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 292/605] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:40.510127 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c03b6b-1048-4506-990b-53220713f5e9 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:40.568180 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d9e130-0b82-4773-b44a-946ee6830aac None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:40.606314 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba265621-2a12-42c6-a3f8-c9913d4c77e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:40.607175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba265621-2a12-42c6-a3f8-c9913d4c77e7 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:40.607453 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba265621-2a12-42c6-a3f8-c9913d4c77e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:40.607722 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba265621-2a12-42c6-a3f8-c9913d4c77e7 None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:40.608579 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba265621-2a12-42c6-a3f8-c9913d4c77e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:40.608891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba265621-2a12-42c6-a3f8-c9913d4c77e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:40.610401 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba265621-2a12-42c6-a3f8-c9913d4c77e7 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:40.630546 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 314/606] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:40.631420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdd6f3-5386-41de-b234-0b1a30e1e33e None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:40.631707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdd6f3-5386-41de-b234-0b1a30e1e33e None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:40.631979 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdd6f3-5386-41de-b234-0b1a30e1e33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:40.636035 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c03b6b-1048-4506-990b-53220713f5e9 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:40.651928 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-66cdd6f3-5386-41de-b234-0b1a30e1e33e None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:40.653005 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-66cdd6f3-5386-41de-b234-0b1a30e1e33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:40.689303 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16308c78-fe37-42d3-9c5c-15750e093916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:40.690197 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16308c78-fe37-42d3-9c5c-15750e093916 None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:40.690514 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16308c78-fe37-42d3-9c5c-15750e093916 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:40.690828 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16308c78-fe37-42d3-9c5c-15750e093916 None admin] PATH_INFO: `/v3/projects/c1eb8559ca744abda7039b767af5818f/users/a4531e7936634508bb4cbfaaaca5bbde/roles/16dc6f09d53447fd9e4a95fb1df71d9d` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:40.712179 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16308c78-fe37-42d3-9c5c-15750e093916 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1eb8559ca744abda7039b767af5818f, user_id=a4531e7936634508bb4cbfaaaca5bbde, role_id=16dc6f09d53447fd9e4a95fb1df71d9d)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:40.714330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16308c78-fe37-42d3-9c5c-15750e093916 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:40.724269 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 315/607] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:40.725389 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdd6f3-5386-41de-b234-0b1a30e1e33e None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:40.732508 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 293/608] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:37:40 2022] PUT /identity/v3/projects/c1eb8559ca744abda7039b767af5818f/users/a4531e7936634508bb4cbfaaaca5bbde/roles/16dc6f09d53447fd9e4a95fb1df71d9d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:37:40.752892 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16308c78-fe37-42d3-9c5c-15750e093916 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:40.898757 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdd6f3-5386-41de-b234-0b1a30e1e33e None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:40.934670 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16308c78-fe37-42d3-9c5c-15750e093916 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:40.969676 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d146fb-d334-495a-89bf-f354782614ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:40.970646 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d146fb-d334-495a-89bf-f354782614ae None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:40.970927 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d146fb-d334-495a-89bf-f354782614ae None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:40.971195 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d146fb-d334-495a-89bf-f354782614ae None admin] PATH_INFO: `/v3/projects/c1eb8559ca744abda7039b767af5818f/users/7990c92f59454156bbd99445387ca889/roles/16dc6f09d53447fd9e4a95fb1df71d9d` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:40.986358 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e56990-d513-4635-893c-39dd5583c852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:40.987190 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e56990-d513-4635-893c-39dd5583c852 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:40.987472 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e56990-d513-4635-893c-39dd5583c852 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:40.987741 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e56990-d513-4635-893c-39dd5583c852 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:40.989400 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d146fb-d334-495a-89bf-f354782614ae None admin] RBAC: Authorizing `identity:create_grant(project_id=c1eb8559ca744abda7039b767af5818f, user_id=7990c92f59454156bbd99445387ca889, role_id=16dc6f09d53447fd9e4a95fb1df71d9d)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:40.991440 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d146fb-d334-495a-89bf-f354782614ae None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:41.000182 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e56990-d513-4635-893c-39dd5583c852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:41.008264 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 316/609] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:37:40 2022] PUT /identity/v3/projects/c1eb8559ca744abda7039b767af5818f/users/7990c92f59454156bbd99445387ca889/roles/16dc6f09d53447fd9e4a95fb1df71d9d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:37:41.010841 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-b9e56990-d513-4635-893c-39dd5583c852 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:37:41.012481 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 294/610] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:41.018829 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d146fb-d334-495a-89bf-f354782614ae None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:41.127427 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d146fb-d334-495a-89bf-f354782614ae None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:41.163087 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b5f26-7f9f-405b-b987-02ffcedd995c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:41.164152 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b5f26-7f9f-405b-b987-02ffcedd995c None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:41.164650 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b5f26-7f9f-405b-b987-02ffcedd995c None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:41.165142 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b5f26-7f9f-405b-b987-02ffcedd995c None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:41.166087 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b5f26-7f9f-405b-b987-02ffcedd995c None admin] RBAC: Adding query filter params (name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:41.166567 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b5f26-7f9f-405b-b987-02ffcedd995c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:41.168157 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b5f26-7f9f-405b-b987-02ffcedd995c None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:41.177830 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 317/611] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:37:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:41.187714 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e56990-d513-4635-893c-39dd5583c852 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:41.338281 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e56990-d513-4635-893c-39dd5583c852 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:41.377699 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4fb87-55a9-4b16-8d75-bc86a624abcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:41.378499 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4fb87-55a9-4b16-8d75-bc86a624abcf None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:41.378816 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4fb87-55a9-4b16-8d75-bc86a624abcf None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:41.379087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe4fb87-55a9-4b16-8d75-bc86a624abcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:41.389881 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4fb87-55a9-4b16-8d75-bc86a624abcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:41.391609 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe4fb87-55a9-4b16-8d75-bc86a624abcf None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:41.398644 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816338a-d3a6-44c4-9c09-cb6c1e5588b1 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:41.398644 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816338a-d3a6-44c4-9c09-cb6c1e5588b1 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:41.398644 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3816338a-d3a6-44c4-9c09-cb6c1e5588b1 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:41.399919 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 318/612] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:37:41.406354 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61ace-b2ec-4f01-9365-9d395022bbae None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:41.406919 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61ace-b2ec-4f01-9365-9d395022bbae None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:41.407394 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61ace-b2ec-4f01-9365-9d395022bbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:41.410459 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-cbe4fb87-55a9-4b16-8d75-bc86a624abcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:41.411958 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 295/613] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:41.419466 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4fb87-55a9-4b16-8d75-bc86a624abcf None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:41.432344 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-fcc61ace-b2ec-4f01-9365-9d395022bbae None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:41.433820 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-fcc61ace-b2ec-4f01-9365-9d395022bbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:41.521915 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 319/614] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:37:41.547377 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc61ace-b2ec-4f01-9365-9d395022bbae None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:41.586336 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe4fb87-55a9-4b16-8d75-bc86a624abcf None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:41.645624 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716beb2e-2f02-4675-a859-e87eed5562f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:41.646289 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716beb2e-2f02-4675-a859-e87eed5562f8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:41.646566 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716beb2e-2f02-4675-a859-e87eed5562f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:41.646865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716beb2e-2f02-4675-a859-e87eed5562f8 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:41.647630 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716beb2e-2f02-4675-a859-e87eed5562f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:41.647939 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716beb2e-2f02-4675-a859-e87eed5562f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:41.649563 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716beb2e-2f02-4675-a859-e87eed5562f8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:41.675129 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 296/615] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:41.684484 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc61ace-b2ec-4f01-9365-9d395022bbae None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:41.685245 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716beb2e-2f02-4675-a859-e87eed5562f8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:41.739346 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14077e-1926-448c-ac24-f91d94b69c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:41.740175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14077e-1926-448c-ac24-f91d94b69c18 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:41.740459 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14077e-1926-448c-ac24-f91d94b69c18 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:41.740732 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14077e-1926-448c-ac24-f91d94b69c18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:41.766264 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14077e-1926-448c-ac24-f91d94b69c18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:41.774511 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-fe14077e-1926-448c-ac24-f91d94b69c18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:37:41.776079 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 320/616] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:41.781608 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14077e-1926-448c-ac24-f91d94b69c18 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:41.899965 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716beb2e-2f02-4675-a859-e87eed5562f8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:41.927421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14077e-1926-448c-ac24-f91d94b69c18 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:41.977868 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcafc81-9285-4f31-8164-1a3c3b38458c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:41.979040 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcafc81-9285-4f31-8164-1a3c3b38458c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:41.980162 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcafc81-9285-4f31-8164-1a3c3b38458c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:41.980636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcafc81-9285-4f31-8164-1a3c3b38458c None admin] PATH_INFO: `/v3/users/nova` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:41.991246 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcafc81-9285-4f31-8164-1a3c3b38458c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:41.995231 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcafc81-9285-4f31-8164-1a3c3b38458c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:41.996563 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319c8a4-8801-4a6d-baad-0507f9564cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:41.997482 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319c8a4-8801-4a6d-baad-0507f9564cc1 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:41.997958 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319c8a4-8801-4a6d-baad-0507f9564cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:41.998425 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319c8a4-8801-4a6d-baad-0507f9564cc1 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:41.999407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319c8a4-8801-4a6d-baad-0507f9564cc1 None admin] RBAC: Adding query filter params (name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:41.999905 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319c8a4-8801-4a6d-baad-0507f9564cc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:42.001567 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319c8a4-8801-4a6d-baad-0507f9564cc1 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:42.025140 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 321/617] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:37:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:42.032674 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-5dcafc81-9285-4f31-8164-1a3c3b38458c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 16:37:42.033370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319c8a4-8801-4a6d-baad-0507f9564cc1 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:42.034652 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 297/618] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Apr 11 16:37:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:42.040358 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcafc81-9285-4f31-8164-1a3c3b38458c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:42.142930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcafc81-9285-4f31-8164-1a3c3b38458c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:42.177894 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ef1f3-ac94-4aa4-8495-8a90dbb4650f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:42.178924 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ef1f3-ac94-4aa4-8495-8a90dbb4650f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:42.179408 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ef1f3-ac94-4aa4-8495-8a90dbb4650f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:42.179900 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ef1f3-ac94-4aa4-8495-8a90dbb4650f None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:42.181495 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ef1f3-ac94-4aa4-8495-8a90dbb4650f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:42.182011 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ef1f3-ac94-4aa4-8495-8a90dbb4650f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:42.183740 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ef1f3-ac94-4aa4-8495-8a90dbb4650f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:42.202290 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 298/619] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Apr 11 16:37:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:42.208101 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ef1f3-ac94-4aa4-8495-8a90dbb4650f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:42.215995 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319c8a4-8801-4a6d-baad-0507f9564cc1 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:42.259290 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0120fdf-d77d-4c0a-bb3d-457edfd34775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:42.260088 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0120fdf-d77d-4c0a-bb3d-457edfd34775 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:42.260375 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0120fdf-d77d-4c0a-bb3d-457edfd34775 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:42.260645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0120fdf-d77d-4c0a-bb3d-457edfd34775 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:42.283576 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0120fdf-d77d-4c0a-bb3d-457edfd34775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:42.285046 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0120fdf-d77d-4c0a-bb3d-457edfd34775 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:42.309884 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ef1f3-ac94-4aa4-8495-8a90dbb4650f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:42.323455 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-a0120fdf-d77d-4c0a-bb3d-457edfd34775 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:42.325029 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 322/620] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:42.335766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0120fdf-d77d-4c0a-bb3d-457edfd34775 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:42.348933 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48580cb2-3de8-4a7e-9f88-8ee0536d5607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:42.349858 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48580cb2-3de8-4a7e-9f88-8ee0536d5607 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:42.350348 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48580cb2-3de8-4a7e-9f88-8ee0536d5607 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:42.350867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48580cb2-3de8-4a7e-9f88-8ee0536d5607 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:42.482087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48580cb2-3de8-4a7e-9f88-8ee0536d5607 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:42.483638 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48580cb2-3de8-4a7e-9f88-8ee0536d5607 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:42.495203 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0120fdf-d77d-4c0a-bb3d-457edfd34775 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:42.578468 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1054ee-5c55-4ced-a59b-d9871c1b8692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:42.579155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1054ee-5c55-4ced-a59b-d9871c1b8692 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:42.579430 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1054ee-5c55-4ced-a59b-d9871c1b8692 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:42.579701 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1054ee-5c55-4ced-a59b-d9871c1b8692 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:42.580417 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1054ee-5c55-4ced-a59b-d9871c1b8692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:42.580718 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1054ee-5c55-4ced-a59b-d9871c1b8692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:42.582085 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1054ee-5c55-4ced-a59b-d9871c1b8692 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:42.600973 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 299/621] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 16:37:42.606873 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 323/622] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:42.607511 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48580cb2-3de8-4a7e-9f88-8ee0536d5607 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:42.625287 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1054ee-5c55-4ced-a59b-d9871c1b8692 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:42.713514 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48580cb2-3de8-4a7e-9f88-8ee0536d5607 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:42.754251 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fceea6-0066-461e-a350-48bb67ae2124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:42.754990 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fceea6-0066-461e-a350-48bb67ae2124 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:42.755273 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fceea6-0066-461e-a350-48bb67ae2124 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:42.755546 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fceea6-0066-461e-a350-48bb67ae2124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:42.780631 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fceea6-0066-461e-a350-48bb67ae2124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:42.782084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fceea6-0066-461e-a350-48bb67ae2124 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:42.802697 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1054ee-5c55-4ced-a59b-d9871c1b8692 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:42.814095 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-92fceea6-0066-461e-a350-48bb67ae2124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:42.823038 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 300/623] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:42.829849 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fceea6-0066-461e-a350-48bb67ae2124 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:42.853951 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606c418-f69b-4983-a3c7-c92da4c257f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:42.855138 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606c418-f69b-4983-a3c7-c92da4c257f9 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:42.855654 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606c418-f69b-4983-a3c7-c92da4c257f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:42.856120 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606c418-f69b-4983-a3c7-c92da4c257f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:42.872339 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606c418-f69b-4983-a3c7-c92da4c257f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:42.874089 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606c418-f69b-4983-a3c7-c92da4c257f9 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:42.910239 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-a606c418-f69b-4983-a3c7-c92da4c257f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 16:37:42.921258 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 324/624] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:37:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:42.928190 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606c418-f69b-4983-a3c7-c92da4c257f9 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:43.034648 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fceea6-0066-461e-a350-48bb67ae2124 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:43.093041 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c991b-8835-4fa9-9dd2-5b252d91c1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:43.093704 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c991b-8835-4fa9-9dd2-5b252d91c1b7 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:43.093988 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c991b-8835-4fa9-9dd2-5b252d91c1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:43.094263 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c991b-8835-4fa9-9dd2-5b252d91c1b7 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:43.095016 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c991b-8835-4fa9-9dd2-5b252d91c1b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:43.095324 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c991b-8835-4fa9-9dd2-5b252d91c1b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:43.096704 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c991b-8835-4fa9-9dd2-5b252d91c1b7 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:43.109101 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 301/625] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:43.114527 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c991b-8835-4fa9-9dd2-5b252d91c1b7 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:43.126204 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606c418-f69b-4983-a3c7-c92da4c257f9 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:43.162961 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75249b-e403-49db-8c13-c4ffe617f783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:43.163628 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75249b-e403-49db-8c13-c4ffe617f783 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:43.163911 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75249b-e403-49db-8c13-c4ffe617f783 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:43.164185 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75249b-e403-49db-8c13-c4ffe617f783 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:43.165546 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75249b-e403-49db-8c13-c4ffe617f783 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:43.165853 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75249b-e403-49db-8c13-c4ffe617f783 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:43.167423 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d75249b-e403-49db-8c13-c4ffe617f783 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:43.185147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 325/626] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Apr 11 16:37:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:43.186446 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3380034-62c1-44d3-8912-7695694aebbf None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:43.186760 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3380034-62c1-44d3-8912-7695694aebbf None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:43.187041 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3380034-62c1-44d3-8912-7695694aebbf None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:43.188516 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 326/627] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:43.191053 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3380034-62c1-44d3-8912-7695694aebbf None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:43.236764 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c991b-8835-4fa9-9dd2-5b252d91c1b7 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:43.272184 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83596d49-393f-4a52-8553-5cf6f44016fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:43.273243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83596d49-393f-4a52-8553-5cf6f44016fd None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:43.273663 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83596d49-393f-4a52-8553-5cf6f44016fd None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:43.274739 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83596d49-393f-4a52-8553-5cf6f44016fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:43.281595 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83596d49-393f-4a52-8553-5cf6f44016fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:43.283284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83596d49-393f-4a52-8553-5cf6f44016fd None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:43.293798 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3380034-62c1-44d3-8912-7695694aebbf None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:43.297528 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-83596d49-393f-4a52-8553-5cf6f44016fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:43.299305 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 302/628] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:43.300790 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d6300-c84b-4e7f-85f0-9a6e2ff95b40 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:43.301268 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d6300-c84b-4e7f-85f0-9a6e2ff95b40 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:43.301759 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6d6300-c84b-4e7f-85f0-9a6e2ff95b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:43.318140 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-5c6d6300-c84b-4e7f-85f0-9a6e2ff95b40 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:43.319772 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5c6d6300-c84b-4e7f-85f0-9a6e2ff95b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:43.329076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1c3b7-aaa9-4386-8e19-e50435581704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:43.329868 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1c3b7-aaa9-4386-8e19-e50435581704 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:43.330202 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1c3b7-aaa9-4386-8e19-e50435581704 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:43.330483 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a1c3b7-aaa9-4386-8e19-e50435581704 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:43.341765 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1c3b7-aaa9-4386-8e19-e50435581704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:43.343280 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a1c3b7-aaa9-4386-8e19-e50435581704 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:43.362139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-f3a1c3b7-aaa9-4386-8e19-e50435581704 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:43.364121 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 327/629] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:43.364652 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1c3b7-aaa9-4386-8e19-e50435581704 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:43.390943 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 303/630] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:43.392219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d6300-c84b-4e7f-85f0-9a6e2ff95b40 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:43.469081 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a1c3b7-aaa9-4386-8e19-e50435581704 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:43.493579 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6d6300-c84b-4e7f-85f0-9a6e2ff95b40 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:43.503877 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566141ba-24e3-49f7-9ca6-b43bdfddfef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:43.504534 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566141ba-24e3-49f7-9ca6-b43bdfddfef7 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:43.504819 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566141ba-24e3-49f7-9ca6-b43bdfddfef7 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:43.505095 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566141ba-24e3-49f7-9ca6-b43bdfddfef7 None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:43.505932 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566141ba-24e3-49f7-9ca6-b43bdfddfef7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:43.506181 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566141ba-24e3-49f7-9ca6-b43bdfddfef7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:43.507727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566141ba-24e3-49f7-9ca6-b43bdfddfef7 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:43.525197 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 328/631] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:43.525197 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566141ba-24e3-49f7-9ca6-b43bdfddfef7 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:43.537554 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b76c3-710c-486b-b5db-31daf71e01de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:43.538242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b76c3-710c-486b-b5db-31daf71e01de None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:43.538524 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b76c3-710c-486b-b5db-31daf71e01de None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:43.538834 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b76c3-710c-486b-b5db-31daf71e01de None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:43.540122 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b76c3-710c-486b-b5db-31daf71e01de None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:43.540433 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b76c3-710c-486b-b5db-31daf71e01de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:43.541783 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b76c3-710c-486b-b5db-31daf71e01de None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:43.552985 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 304/632] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:43.553976 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bb2f2-99c2-4815-a734-bbf709eeb6e7 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:43.554263 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bb2f2-99c2-4815-a734-bbf709eeb6e7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:43.554536 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bb2f2-99c2-4815-a734-bbf709eeb6e7 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:43.555967 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 305/633] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:43.556517 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bb2f2-99c2-4815-a734-bbf709eeb6e7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:43.622208 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566141ba-24e3-49f7-9ca6-b43bdfddfef7 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:43.654177 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63dfacd-6ac7-4295-a4a2-dc68e98c32db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:43.654991 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dfacd-6ac7-4295-a4a2-dc68e98c32db None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:43.655270 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dfacd-6ac7-4295-a4a2-dc68e98c32db None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:43.655542 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dfacd-6ac7-4295-a4a2-dc68e98c32db None admin] PATH_INFO: `/v3/roles/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:43.660073 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5bb2f2-99c2-4815-a734-bbf709eeb6e7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:43.665567 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63dfacd-6ac7-4295-a4a2-dc68e98c32db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:43.672619 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-d63dfacd-6ac7-4295-a4a2-dc68e98c32db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:37:43.678488 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 329/634] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:43.678488 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63dfacd-6ac7-4295-a4a2-dc68e98c32db None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:43.699171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313a9c96-937d-40bc-9589-c5978455b8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:43.699853 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a9c96-937d-40bc-9589-c5978455b8af None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:43.700134 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a9c96-937d-40bc-9589-c5978455b8af None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:43.700410 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313a9c96-937d-40bc-9589-c5978455b8af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:43.701231 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a9c96-937d-40bc-9589-c5978455b8af None admin] RBAC: Adding query filter params (role.id=16dc6f09d53447fd9e4a95fb1df71d9d, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=ba3665d046864985916fdd6c4a4edcd1) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:43.701539 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a9c96-937d-40bc-9589-c5978455b8af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:43.703109 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313a9c96-937d-40bc-9589-c5978455b8af None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:43.718886 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 306/635] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:37:43 2022] GET /identity/v3/role_assignments?user.id=ba3665d046864985916fdd6c4a4edcd1&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=16dc6f09d53447fd9e4a95fb1df71d9d => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:43.718886 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deb3a6-c4a6-403c-811e-8130613f9807 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:43.718886 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deb3a6-c4a6-403c-811e-8130613f9807 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:43.718886 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2deb3a6-c4a6-403c-811e-8130613f9807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:43.727888 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-d2deb3a6-c4a6-403c-811e-8130613f9807 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:43.729087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d2deb3a6-c4a6-403c-811e-8130613f9807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:43.802975 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 307/636] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:43.804191 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deb3a6-c4a6-403c-811e-8130613f9807 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:43.805242 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63dfacd-6ac7-4295-a4a2-dc68e98c32db None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:43.845495 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f195d34e-6afd-4ccb-a25e-80901005ab65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:43.846310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195d34e-6afd-4ccb-a25e-80901005ab65 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:43.846575 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195d34e-6afd-4ccb-a25e-80901005ab65 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:43.846882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f195d34e-6afd-4ccb-a25e-80901005ab65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:43.854922 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195d34e-6afd-4ccb-a25e-80901005ab65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:43.856936 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f195d34e-6afd-4ccb-a25e-80901005ab65 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:43.871536 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-f195d34e-6afd-4ccb-a25e-80901005ab65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:43.877326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 330/637] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:43.877326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a16900-51e5-4f21-a1f1-3534de67ae25 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:43.877326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a16900-51e5-4f21-a1f1-3534de67ae25 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:43.877326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a16900-51e5-4f21-a1f1-3534de67ae25 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:43.877326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 331/638] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:43.877326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a16900-51e5-4f21-a1f1-3534de67ae25 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:43.925433 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2deb3a6-c4a6-403c-811e-8130613f9807 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:43.969342 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b3456-15d2-4338-b444-346b3d9ea441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:43.970065 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b3456-15d2-4338-b444-346b3d9ea441 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:43.970342 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b3456-15d2-4338-b444-346b3d9ea441 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:43.970875 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b3456-15d2-4338-b444-346b3d9ea441 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:43.972057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b3456-15d2-4338-b444-346b3d9ea441 None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:43.972057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b3456-15d2-4338-b444-346b3d9ea441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:43.973024 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b3456-15d2-4338-b444-346b3d9ea441 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:43.983773 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 308/639] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:37:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:43.984677 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b3456-15d2-4338-b444-346b3d9ea441 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:43.993030 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a16900-51e5-4f21-a1f1-3534de67ae25 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:44.031657 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546e48e-301d-4425-9816-fda60d0f63b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:44.032459 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546e48e-301d-4425-9816-fda60d0f63b6 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:44.032740 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546e48e-301d-4425-9816-fda60d0f63b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:44.033050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546e48e-301d-4425-9816-fda60d0f63b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:44.044139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4546e48e-301d-4425-9816-fda60d0f63b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:44.051106 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-4546e48e-301d-4425-9816-fda60d0f63b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:37:44.052468 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 332/640] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:44.053473 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4004265-59fc-431a-8ff9-faf11daff0e1 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:44.053753 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4004265-59fc-431a-8ff9-faf11daff0e1 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:44.054026 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4004265-59fc-431a-8ff9-faf11daff0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:44.071627 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-c4004265-59fc-431a-8ff9-faf11daff0e1 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:44.072725 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-c4004265-59fc-431a-8ff9-faf11daff0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:44.091305 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b3456-15d2-4338-b444-346b3d9ea441 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:44.125013 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abd9b1-67e1-451f-92f0-9b5685ccd12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:44.125669 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abd9b1-67e1-451f-92f0-9b5685ccd12b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:44.125948 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abd9b1-67e1-451f-92f0-9b5685ccd12b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:44.126225 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0abd9b1-67e1-451f-92f0-9b5685ccd12b None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:44.127035 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abd9b1-67e1-451f-92f0-9b5685ccd12b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:44.127341 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abd9b1-67e1-451f-92f0-9b5685ccd12b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:44.128754 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0abd9b1-67e1-451f-92f0-9b5685ccd12b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:44.137132 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 333/641] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:44.138214 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4004265-59fc-431a-8ff9-faf11daff0e1 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:44.154308 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 309/642] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:44.155366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abd9b1-67e1-451f-92f0-9b5685ccd12b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:44.236184 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4004265-59fc-431a-8ff9-faf11daff0e1 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:44.249874 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0abd9b1-67e1-451f-92f0-9b5685ccd12b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:44.269693 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686106a-3387-4f71-bbe2-b0d4d482f008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:44.270459 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686106a-3387-4f71-bbe2-b0d4d482f008 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:44.270771 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686106a-3387-4f71-bbe2-b0d4d482f008 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:44.271046 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686106a-3387-4f71-bbe2-b0d4d482f008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:44.280586 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686106a-3387-4f71-bbe2-b0d4d482f008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:44.282018 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686106a-3387-4f71-bbe2-b0d4d482f008 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:44.283244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb5fb5-e845-4eec-a5d2-71feda72438d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:44.284492 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb5fb5-e845-4eec-a5d2-71feda72438d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:44.284915 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb5fb5-e845-4eec-a5d2-71feda72438d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:44.285359 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcb5fb5-e845-4eec-a5d2-71feda72438d None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:44.286229 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb5fb5-e845-4eec-a5d2-71feda72438d None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:44.286703 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb5fb5-e845-4eec-a5d2-71feda72438d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:44.288170 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcb5fb5-e845-4eec-a5d2-71feda72438d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:44.297490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 310/643] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:37:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:44.298391 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb5fb5-e845-4eec-a5d2-71feda72438d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:44.298668 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-3686106a-3387-4f71-bbe2-b0d4d482f008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:44.301961 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 334/644] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:44.301961 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686106a-3387-4f71-bbe2-b0d4d482f008 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:44.396266 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcb5fb5-e845-4eec-a5d2-71feda72438d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:44.399127 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686106a-3387-4f71-bbe2-b0d4d482f008 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:44.428149 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbbba7-c8a5-45e8-9173-ddc035f78fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:44.429019 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbbba7-c8a5-45e8-9173-ddc035f78fca None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:44.429304 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbbba7-c8a5-45e8-9173-ddc035f78fca None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:44.429581 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbbba7-c8a5-45e8-9173-ddc035f78fca None admin] PATH_INFO: `/v3/projects/c1eb8559ca744abda7039b767af5818f/users/1f6659c6661840a79ba9ff1c3c9e93c6/roles/16dc6f09d53447fd9e4a95fb1df71d9d` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:44.433860 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159d7a9-c42c-45ca-aa39-e2b6cd3452f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:44.434897 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159d7a9-c42c-45ca-aa39-e2b6cd3452f1 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:44.435378 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159d7a9-c42c-45ca-aa39-e2b6cd3452f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:44.435847 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a159d7a9-c42c-45ca-aa39-e2b6cd3452f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:44.444017 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbbba7-c8a5-45e8-9173-ddc035f78fca None admin] RBAC: Authorizing `identity:create_grant(project_id=c1eb8559ca744abda7039b767af5818f, user_id=1f6659c6661840a79ba9ff1c3c9e93c6, role_id=16dc6f09d53447fd9e4a95fb1df71d9d)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:44.445446 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bbbba7-c8a5-45e8-9173-ddc035f78fca None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:44.446380 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a159d7a9-c42c-45ca-aa39-e2b6cd3452f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:44.453826 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-a159d7a9-c42c-45ca-aa39-e2b6cd3452f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:37:44.455292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 335/645] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:44.456272 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159d7a9-c42c-45ca-aa39-e2b6cd3452f1 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:44.458635 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 311/646] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:37:44 2022] PUT /identity/v3/projects/c1eb8559ca744abda7039b767af5818f/users/1f6659c6661840a79ba9ff1c3c9e93c6/roles/16dc6f09d53447fd9e4a95fb1df71d9d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:37:44.458635 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbbba7-c8a5-45e8-9173-ddc035f78fca None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:44.567758 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbbba7-c8a5-45e8-9173-ddc035f78fca None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:44.577440 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a159d7a9-c42c-45ca-aa39-e2b6cd3452f1 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:44.606130 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b870c-509f-4b02-8433-71bc69b77ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:44.607173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b870c-509f-4b02-8433-71bc69b77ba9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:44.607634 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b870c-509f-4b02-8433-71bc69b77ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:44.608082 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b870c-509f-4b02-8433-71bc69b77ba9 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:44.609019 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b870c-509f-4b02-8433-71bc69b77ba9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:44.609531 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b870c-509f-4b02-8433-71bc69b77ba9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:44.611216 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05b870c-509f-4b02-8433-71bc69b77ba9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:44.615043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbb7e4-1702-4547-9803-3b30f7a84ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:44.615857 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbb7e4-1702-4547-9803-3b30f7a84ec5 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:44.616137 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbb7e4-1702-4547-9803-3b30f7a84ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:44.616412 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbb7e4-1702-4547-9803-3b30f7a84ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:44.629634 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbb7e4-1702-4547-9803-3b30f7a84ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:44.630243 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbb7e4-1702-4547-9803-3b30f7a84ec5 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:44.630447 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 312/647] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:44.631623 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b870c-509f-4b02-8433-71bc69b77ba9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:44.650659 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-b6cbb7e4-1702-4547-9803-3b30f7a84ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:44.652722 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 336/648] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:44.653510 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbb7e4-1702-4547-9803-3b30f7a84ec5 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:44.743336 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b870c-509f-4b02-8433-71bc69b77ba9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:44.757699 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbb7e4-1702-4547-9803-3b30f7a84ec5 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:44.776424 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4b7d3-6af5-48b2-aca5-ced5230ac561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:44.777093 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4b7d3-6af5-48b2-aca5-ced5230ac561 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:44.777379 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4b7d3-6af5-48b2-aca5-ced5230ac561 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:44.777653 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4b7d3-6af5-48b2-aca5-ced5230ac561 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:44.778396 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4b7d3-6af5-48b2-aca5-ced5230ac561 None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:44.778722 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4b7d3-6af5-48b2-aca5-ced5230ac561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:44.780091 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4b7d3-6af5-48b2-aca5-ced5230ac561 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:44.788393 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 313/649] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:37:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:44.789468 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4b7d3-6af5-48b2-aca5-ced5230ac561 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:44.796391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca4c4f-291b-40df-8a54-37fbba4e483b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:44.797187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca4c4f-291b-40df-8a54-37fbba4e483b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:44.797532 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca4c4f-291b-40df-8a54-37fbba4e483b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:44.797807 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca4c4f-291b-40df-8a54-37fbba4e483b None admin] PATH_INFO: `/v3/users/glance` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:44.806607 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca4c4f-291b-40df-8a54-37fbba4e483b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:44.808130 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca4c4f-291b-40df-8a54-37fbba4e483b None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:44.822094 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-f9ca4c4f-291b-40df-8a54-37fbba4e483b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 11 16:37:44.823798 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 337/650] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:44.824577 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca4c4f-291b-40df-8a54-37fbba4e483b None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:44.894438 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4b7d3-6af5-48b2-aca5-ced5230ac561 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:44.927843 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca4c4f-291b-40df-8a54-37fbba4e483b None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:44.929222 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e747d-14be-4d81-a1c8-ef1e5a4da252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:44.930655 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e747d-14be-4d81-a1c8-ef1e5a4da252 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:44.931092 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e747d-14be-4d81-a1c8-ef1e5a4da252 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:44.931510 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e747d-14be-4d81-a1c8-ef1e5a4da252 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:44.932397 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e747d-14be-4d81-a1c8-ef1e5a4da252 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:44.932845 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e747d-14be-4d81-a1c8-ef1e5a4da252 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:44.934378 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e747d-14be-4d81-a1c8-ef1e5a4da252 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:44.950832 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 314/651] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:44.951882 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e747d-14be-4d81-a1c8-ef1e5a4da252 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:44.968610 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c882215-c2da-4449-b0bf-4925677a5634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:44.969477 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c882215-c2da-4449-b0bf-4925677a5634 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:44.969755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c882215-c2da-4449-b0bf-4925677a5634 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:44.970079 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c882215-c2da-4449-b0bf-4925677a5634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:44.980959 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c882215-c2da-4449-b0bf-4925677a5634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:44.982476 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c882215-c2da-4449-b0bf-4925677a5634 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:44.999660 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-0c882215-c2da-4449-b0bf-4925677a5634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:45.001207 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 338/652] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:45.002051 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c882215-c2da-4449-b0bf-4925677a5634 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:45.050457 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e747d-14be-4d81-a1c8-ef1e5a4da252 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:45.084345 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c0387-bd98-47cb-b7d6-dfdf9759ff21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:45.085295 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c0387-bd98-47cb-b7d6-dfdf9759ff21 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:45.085756 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c0387-bd98-47cb-b7d6-dfdf9759ff21 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:45.086236 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5c0387-bd98-47cb-b7d6-dfdf9759ff21 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:45.091331 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c0387-bd98-47cb-b7d6-dfdf9759ff21 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:45.091862 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c0387-bd98-47cb-b7d6-dfdf9759ff21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:45.093467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5c0387-bd98-47cb-b7d6-dfdf9759ff21 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:45.103739 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c882215-c2da-4449-b0bf-4925677a5634 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:45.115932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 315/653] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Apr 11 16:37:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:45.116999 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c0387-bd98-47cb-b7d6-dfdf9759ff21 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:45.138634 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ac42d-38bf-4795-bba1-fd225e761d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:45.139485 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ac42d-38bf-4795-bba1-fd225e761d64 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:45.139744 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ac42d-38bf-4795-bba1-fd225e761d64 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:45.140289 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ac42d-38bf-4795-bba1-fd225e761d64 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:45.147954 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ac42d-38bf-4795-bba1-fd225e761d64 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:45.149503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ac42d-38bf-4795-bba1-fd225e761d64 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:45.164843 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-725ac42d-38bf-4795-bba1-fd225e761d64 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 16:37:45.170939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 339/654] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:45.171666 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ac42d-38bf-4795-bba1-fd225e761d64 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:45.215814 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5c0387-bd98-47cb-b7d6-dfdf9759ff21 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:45.250200 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ea772-e842-4867-8552-97e760cc4d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:45.251212 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ea772-e842-4867-8552-97e760cc4d25 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:45.251674 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ea772-e842-4867-8552-97e760cc4d25 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:45.252124 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ea772-e842-4867-8552-97e760cc4d25 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:45.253026 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ea772-e842-4867-8552-97e760cc4d25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:45.253506 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ea772-e842-4867-8552-97e760cc4d25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:45.255095 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ea772-e842-4867-8552-97e760cc4d25 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:45.267328 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 316/655] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:45.268443 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ea772-e842-4867-8552-97e760cc4d25 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:45.273364 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ac42d-38bf-4795-bba1-fd225e761d64 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:45.308146 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee620bee-a5bb-4892-8bb6-6e29eb858e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:45.308517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee620bee-a5bb-4892-8bb6-6e29eb858e89 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:45.308834 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee620bee-a5bb-4892-8bb6-6e29eb858e89 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:45.309157 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee620bee-a5bb-4892-8bb6-6e29eb858e89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:45.367512 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ea772-e842-4867-8552-97e760cc4d25 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:45.379371 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee620bee-a5bb-4892-8bb6-6e29eb858e89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:45.380835 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee620bee-a5bb-4892-8bb6-6e29eb858e89 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:45.403846 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baedf6-cb19-470d-a0b8-11bad03ff6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:45.404517 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baedf6-cb19-470d-a0b8-11bad03ff6c2 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:45.404799 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baedf6-cb19-470d-a0b8-11bad03ff6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:45.405071 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baedf6-cb19-470d-a0b8-11bad03ff6c2 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:45.405899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22baedf6-cb19-470d-a0b8-11bad03ff6c2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:45.406205 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22baedf6-cb19-470d-a0b8-11bad03ff6c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:45.407646 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22baedf6-cb19-470d-a0b8-11bad03ff6c2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:45.425364 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 317/656] 10.222.0.73 () {56 vars in 1137 bytes} [Mon Apr 11 16:37:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:45.426200 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baedf6-cb19-470d-a0b8-11bad03ff6c2 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:45.485839 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 340/657] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:45.486710 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee620bee-a5bb-4892-8bb6-6e29eb858e89 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:45.525232 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baedf6-cb19-470d-a0b8-11bad03ff6c2 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:45.559698 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1fd49-9d88-43cf-ba49-82a11acac98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:45.560501 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1fd49-9d88-43cf-ba49-82a11acac98b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:45.560781 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1fd49-9d88-43cf-ba49-82a11acac98b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:45.561057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1fd49-9d88-43cf-ba49-82a11acac98b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:45.568371 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1fd49-9d88-43cf-ba49-82a11acac98b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:45.569865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1fd49-9d88-43cf-ba49-82a11acac98b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:45.584297 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-12a1fd49-9d88-43cf-ba49-82a11acac98b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 11 16:37:45.585097 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee620bee-a5bb-4892-8bb6-6e29eb858e89 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:45.585808 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 318/658] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:45.590914 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1fd49-9d88-43cf-ba49-82a11acac98b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:45.620084 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179cf03-f799-4759-a0c6-58f5f406dba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:45.620725 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179cf03-f799-4759-a0c6-58f5f406dba1 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:45.621003 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179cf03-f799-4759-a0c6-58f5f406dba1 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:45.621273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5179cf03-f799-4759-a0c6-58f5f406dba1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:45.689758 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1fd49-9d88-43cf-ba49-82a11acac98b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:45.690105 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179cf03-f799-4759-a0c6-58f5f406dba1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:45.691522 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5179cf03-f799-4759-a0c6-58f5f406dba1 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:45.725972 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa551b29-f445-49e2-95fb-ab0150e5dba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:45.726867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa551b29-f445-49e2-95fb-ab0150e5dba6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:45.727149 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa551b29-f445-49e2-95fb-ab0150e5dba6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:45.727424 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa551b29-f445-49e2-95fb-ab0150e5dba6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:45.738887 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa551b29-f445-49e2-95fb-ab0150e5dba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:45.740275 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa551b29-f445-49e2-95fb-ab0150e5dba6 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:45.759460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-fa551b29-f445-49e2-95fb-ab0150e5dba6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:45.760995 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 319/659] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:45.761850 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa551b29-f445-49e2-95fb-ab0150e5dba6 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:45.799970 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 341/660] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:45.800939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179cf03-f799-4759-a0c6-58f5f406dba1 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:45.860311 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa551b29-f445-49e2-95fb-ab0150e5dba6 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:45.895678 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c3713-74cf-4127-9208-26d8b302b0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:45.896347 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c3713-74cf-4127-9208-26d8b302b0cf None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:45.896622 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c3713-74cf-4127-9208-26d8b302b0cf None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:45.896896 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c3713-74cf-4127-9208-26d8b302b0cf None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:45.897727 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c3713-74cf-4127-9208-26d8b302b0cf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:45.898033 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c3713-74cf-4127-9208-26d8b302b0cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:45.898998 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5179cf03-f799-4759-a0c6-58f5f406dba1 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:45.899490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c3713-74cf-4127-9208-26d8b302b0cf None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:45.927018 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 320/661] 10.222.0.73 () {56 vars in 1139 bytes} [Mon Apr 11 16:37:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:45.927900 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c3713-74cf-4127-9208-26d8b302b0cf None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:45.933909 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7059001-34cf-435f-a261-844ef6cfdef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:45.934577 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7059001-34cf-435f-a261-844ef6cfdef0 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:45.934934 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7059001-34cf-435f-a261-844ef6cfdef0 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:45.935301 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7059001-34cf-435f-a261-844ef6cfdef0 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:45.936062 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7059001-34cf-435f-a261-844ef6cfdef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:45.936368 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7059001-34cf-435f-a261-844ef6cfdef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:45.938129 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7059001-34cf-435f-a261-844ef6cfdef0 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:45.952228 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 342/662] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:45.953470 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7059001-34cf-435f-a261-844ef6cfdef0 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:46.029248 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c3713-74cf-4127-9208-26d8b302b0cf None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:46.052221 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7059001-34cf-435f-a261-844ef6cfdef0 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:46.063269 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77389271-ab9b-4f00-b65d-c40532bb7b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:46.063864 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77389271-ab9b-4f00-b65d-c40532bb7b7b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:46.064231 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77389271-ab9b-4f00-b65d-c40532bb7b7b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:46.064494 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77389271-ab9b-4f00-b65d-c40532bb7b7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:46.075449 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77389271-ab9b-4f00-b65d-c40532bb7b7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:46.076909 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77389271-ab9b-4f00-b65d-c40532bb7b7b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:46.088920 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929cd539-45f9-4836-94df-e24a254e4df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:46.089867 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cd539-45f9-4836-94df-e24a254e4df5 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:46.090355 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cd539-45f9-4836-94df-e24a254e4df5 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:46.090858 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929cd539-45f9-4836-94df-e24a254e4df5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:46.095062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-77389271-ab9b-4f00-b65d-c40532bb7b7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:46.100724 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 321/663] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:46.100724 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77389271-ab9b-4f00-b65d-c40532bb7b7b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:46.163875 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929cd539-45f9-4836-94df-e24a254e4df5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:46.165703 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929cd539-45f9-4836-94df-e24a254e4df5 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:46.195414 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77389271-ab9b-4f00-b65d-c40532bb7b7b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:46.227548 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903c24d-8b8d-4a7c-b8bc-1fb8697dd2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:46.228328 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903c24d-8b8d-4a7c-b8bc-1fb8697dd2dd None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:46.228607 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903c24d-8b8d-4a7c-b8bc-1fb8697dd2dd None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:46.228878 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903c24d-8b8d-4a7c-b8bc-1fb8697dd2dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:46.235322 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903c24d-8b8d-4a7c-b8bc-1fb8697dd2dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:46.236735 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903c24d-8b8d-4a7c-b8bc-1fb8697dd2dd None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:46.250731 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-5903c24d-8b8d-4a7c-b8bc-1fb8697dd2dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:46.252211 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 322/664] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:46.252923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903c24d-8b8d-4a7c-b8bc-1fb8697dd2dd None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:46.270147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 343/665] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:46.270147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9f514-3efd-4842-a7ba-38a79e15aeb7 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:46.270147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9f514-3efd-4842-a7ba-38a79e15aeb7 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:46.270147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9f514-3efd-4842-a7ba-38a79e15aeb7 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:46.270147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 344/666] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:46.270147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9f514-3efd-4842-a7ba-38a79e15aeb7 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:46.354332 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903c24d-8b8d-4a7c-b8bc-1fb8697dd2dd None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:46.369157 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9f514-3efd-4842-a7ba-38a79e15aeb7 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:46.385912 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de44c58-dba9-4b33-a846-efdc2deb8597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:46.386728 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de44c58-dba9-4b33-a846-efdc2deb8597 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:46.387015 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de44c58-dba9-4b33-a846-efdc2deb8597 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:46.387286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de44c58-dba9-4b33-a846-efdc2deb8597 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:46.388021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de44c58-dba9-4b33-a846-efdc2deb8597 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:46.388334 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de44c58-dba9-4b33-a846-efdc2deb8597 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:46.389729 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de44c58-dba9-4b33-a846-efdc2deb8597 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:46.405984 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 323/667] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:46.405984 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de44c58-dba9-4b33-a846-efdc2deb8597 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:46.406574 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6129379-0fba-4263-840a-984394cd3156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:46.407250 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6129379-0fba-4263-840a-984394cd3156 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:46.407526 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6129379-0fba-4263-840a-984394cd3156 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:46.407798 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6129379-0fba-4263-840a-984394cd3156 None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:46.408568 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6129379-0fba-4263-840a-984394cd3156 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:46.408878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6129379-0fba-4263-840a-984394cd3156 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:46.410297 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6129379-0fba-4263-840a-984394cd3156 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:46.421992 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 345/668] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:46.423238 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78cffe-252a-4b89-942c-7ae8a2acaf6e None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:46.423525 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78cffe-252a-4b89-942c-7ae8a2acaf6e None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:46.423795 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78cffe-252a-4b89-942c-7ae8a2acaf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:46.440663 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-7a78cffe-252a-4b89-942c-7ae8a2acaf6e None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:46.441864 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-7a78cffe-252a-4b89-942c-7ae8a2acaf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:46.505955 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 346/669] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:46.506827 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78cffe-252a-4b89-942c-7ae8a2acaf6e None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:46.508851 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de44c58-dba9-4b33-a846-efdc2deb8597 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:46.545448 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad677b88-0252-486c-98fa-33e5b98bc624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:46.546259 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad677b88-0252-486c-98fa-33e5b98bc624 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:46.546540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad677b88-0252-486c-98fa-33e5b98bc624 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:46.546847 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad677b88-0252-486c-98fa-33e5b98bc624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:46.558945 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad677b88-0252-486c-98fa-33e5b98bc624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:46.560409 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad677b88-0252-486c-98fa-33e5b98bc624 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:46.578527 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-ad677b88-0252-486c-98fa-33e5b98bc624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:46.584044 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 324/670] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:46.584044 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad677b88-0252-486c-98fa-33e5b98bc624 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:46.618348 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78cffe-252a-4b89-942c-7ae8a2acaf6e None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:46.651299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c241798-4f17-4cd1-a91d-d5a33c6394c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:46.652081 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c241798-4f17-4cd1-a91d-d5a33c6394c1 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:46.652358 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c241798-4f17-4cd1-a91d-d5a33c6394c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:46.652625 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c241798-4f17-4cd1-a91d-d5a33c6394c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:46.659508 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c241798-4f17-4cd1-a91d-d5a33c6394c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:46.660955 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c241798-4f17-4cd1-a91d-d5a33c6394c1 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:46.675535 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-0c241798-4f17-4cd1-a91d-d5a33c6394c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:46.676891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 347/671] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:46.677493 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c241798-4f17-4cd1-a91d-d5a33c6394c1 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:46.684551 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad677b88-0252-486c-98fa-33e5b98bc624 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:46.716706 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea1e30-e334-4de7-a490-6d423faef9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:46.717674 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea1e30-e334-4de7-a490-6d423faef9e9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:46.718179 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea1e30-e334-4de7-a490-6d423faef9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:46.718670 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea1e30-e334-4de7-a490-6d423faef9e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:46.719750 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea1e30-e334-4de7-a490-6d423faef9e9 None admin] RBAC: Adding query filter params (role.id=16dc6f09d53447fd9e4a95fb1df71d9d, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=92dc1464c4b24c6c8ea5dfcc796f0279) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:46.720118 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea1e30-e334-4de7-a490-6d423faef9e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:46.721664 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea1e30-e334-4de7-a490-6d423faef9e9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:46.734910 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 325/672] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:37:46 2022] GET /identity/v3/role_assignments?user.id=92dc1464c4b24c6c8ea5dfcc796f0279&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=16dc6f09d53447fd9e4a95fb1df71d9d => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:46.734910 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea1e30-e334-4de7-a490-6d423faef9e9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:46.790177 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c241798-4f17-4cd1-a91d-d5a33c6394c1 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:46.828153 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd025b-a4ec-42cc-a493-82de43bcefff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:46.829015 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd025b-a4ec-42cc-a493-82de43bcefff None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:46.829290 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd025b-a4ec-42cc-a493-82de43bcefff None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:46.829609 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debd025b-a4ec-42cc-a493-82de43bcefff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:46.841937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debd025b-a4ec-42cc-a493-82de43bcefff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:46.849148 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-debd025b-a4ec-42cc-a493-82de43bcefff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:37:46.855024 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 348/673] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:37:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:46.855955 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd025b-a4ec-42cc-a493-82de43bcefff None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:46.869077 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea1e30-e334-4de7-a490-6d423faef9e9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:46.915127 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad253d01-8f0c-4032-8834-93ce85039a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:46.916091 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad253d01-8f0c-4032-8834-93ce85039a41 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:46.916374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad253d01-8f0c-4032-8834-93ce85039a41 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:46.916726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad253d01-8f0c-4032-8834-93ce85039a41 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:46.917689 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad253d01-8f0c-4032-8834-93ce85039a41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:46.918395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad253d01-8f0c-4032-8834-93ce85039a41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:46.920280 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad253d01-8f0c-4032-8834-93ce85039a41 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:46.936690 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 326/674] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:46.937672 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad253d01-8f0c-4032-8834-93ce85039a41 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:46.966479 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debd025b-a4ec-42cc-a493-82de43bcefff None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:47.003316 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3568aaf-f833-4e57-b39e-7c1f47bd33bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:47.004268 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3568aaf-f833-4e57-b39e-7c1f47bd33bc None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:47.004549 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3568aaf-f833-4e57-b39e-7c1f47bd33bc None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:47.004822 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3568aaf-f833-4e57-b39e-7c1f47bd33bc None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:47.005594 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3568aaf-f833-4e57-b39e-7c1f47bd33bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:47.005897 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3568aaf-f833-4e57-b39e-7c1f47bd33bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:47.007645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3568aaf-f833-4e57-b39e-7c1f47bd33bc None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:47.019955 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 349/675] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:47.021331 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962526b-09aa-4dd4-8fb3-9e14a7608984 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:47.021613 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962526b-09aa-4dd4-8fb3-9e14a7608984 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:47.021883 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962526b-09aa-4dd4-8fb3-9e14a7608984 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:47.023313 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 350/676] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:47.027156 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962526b-09aa-4dd4-8fb3-9e14a7608984 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:47.050748 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad253d01-8f0c-4032-8834-93ce85039a41 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:47.083886 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd081ddf-f5f6-4bbf-b076-a62ecb2110fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:47.084649 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd081ddf-f5f6-4bbf-b076-a62ecb2110fe None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:47.084927 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd081ddf-f5f6-4bbf-b076-a62ecb2110fe None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:47.085200 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd081ddf-f5f6-4bbf-b076-a62ecb2110fe None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:47.085930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd081ddf-f5f6-4bbf-b076-a62ecb2110fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:47.086784 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd081ddf-f5f6-4bbf-b076-a62ecb2110fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:47.088143 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd081ddf-f5f6-4bbf-b076-a62ecb2110fe None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:47.095953 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 327/677] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:47.096744 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd081ddf-f5f6-4bbf-b076-a62ecb2110fe None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:47.125267 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962526b-09aa-4dd4-8fb3-9e14a7608984 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:47.158797 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceea56-89b5-45ff-ad79-124583521c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:47.159870 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceea56-89b5-45ff-ad79-124583521c45 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:47.160306 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceea56-89b5-45ff-ad79-124583521c45 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:47.160586 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceea56-89b5-45ff-ad79-124583521c45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:47.167851 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ceea56-89b5-45ff-ad79-124583521c45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:47.169298 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ceea56-89b5-45ff-ad79-124583521c45 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:47.182016 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-b9ceea56-89b5-45ff-ad79-124583521c45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:47.187613 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 351/678] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:47.187613 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49214f-c089-4687-924f-576d047e5b8a None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:47.187613 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49214f-c089-4687-924f-576d047e5b8a None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:47.187613 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49214f-c089-4687-924f-576d047e5b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:47.200931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-9f49214f-c089-4687-924f-576d047e5b8a None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:47.202093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9f49214f-c089-4687-924f-576d047e5b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:47.204323 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd081ddf-f5f6-4bbf-b076-a62ecb2110fe None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:47.238002 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d67e68-11a7-4127-a071-30faab8872d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:47.238682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d67e68-11a7-4127-a071-30faab8872d4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:47.238966 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d67e68-11a7-4127-a071-30faab8872d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:47.239241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d67e68-11a7-4127-a071-30faab8872d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:47.240060 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d67e68-11a7-4127-a071-30faab8872d4 None admin] RBAC: Adding query filter params (role.id=16dc6f09d53447fd9e4a95fb1df71d9d, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=a4531e7936634508bb4cbfaaaca5bbde) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:47.240370 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d67e68-11a7-4127-a071-30faab8872d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:47.241795 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d67e68-11a7-4127-a071-30faab8872d4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:47.248097 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 328/679] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:37:47 2022] GET /identity/v3/role_assignments?user.id=a4531e7936634508bb4cbfaaaca5bbde&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=16dc6f09d53447fd9e4a95fb1df71d9d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:47.248877 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d67e68-11a7-4127-a071-30faab8872d4 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:47.282822 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 352/680] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:47.283938 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49214f-c089-4687-924f-576d047e5b8a None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:47.364357 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d67e68-11a7-4127-a071-30faab8872d4 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:47.392028 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49214f-c089-4687-924f-576d047e5b8a None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:47.401709 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409e4c8-5276-43c6-95ff-c51d616c7625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:47.402786 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409e4c8-5276-43c6-95ff-c51d616c7625 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:47.403299 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409e4c8-5276-43c6-95ff-c51d616c7625 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:47.403786 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b409e4c8-5276-43c6-95ff-c51d616c7625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:47.415916 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409e4c8-5276-43c6-95ff-c51d616c7625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:47.417729 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b409e4c8-5276-43c6-95ff-c51d616c7625 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:47.428416 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ad802-4036-47cb-8f8c-6f07d48a703a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:47.429076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ad802-4036-47cb-8f8c-6f07d48a703a None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:47.429351 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ad802-4036-47cb-8f8c-6f07d48a703a None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:47.429624 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ad802-4036-47cb-8f8c-6f07d48a703a None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:47.430443 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ad802-4036-47cb-8f8c-6f07d48a703a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:47.430795 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ad802-4036-47cb-8f8c-6f07d48a703a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:47.432242 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ad802-4036-47cb-8f8c-6f07d48a703a None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:47.437442 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-b409e4c8-5276-43c6-95ff-c51d616c7625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:47.443709 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 329/681] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:47.444957 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409e4c8-5276-43c6-95ff-c51d616c7625 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:47.446069 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 353/682] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:47.446937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ad802-4036-47cb-8f8c-6f07d48a703a None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:47.566403 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ad802-4036-47cb-8f8c-6f07d48a703a None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:47.572529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b409e4c8-5276-43c6-95ff-c51d616c7625 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:47.600821 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4777b-b20d-4bb7-9e7d-74c6240512d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:47.601486 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4777b-b20d-4bb7-9e7d-74c6240512d6 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:47.601802 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4777b-b20d-4bb7-9e7d-74c6240512d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:47.602076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4777b-b20d-4bb7-9e7d-74c6240512d6 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:47.603170 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4777b-b20d-4bb7-9e7d-74c6240512d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:47.603598 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4777b-b20d-4bb7-9e7d-74c6240512d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:47.605293 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4777b-b20d-4bb7-9e7d-74c6240512d6 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:47.614342 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d3b66-f55c-4841-b451-9490c670af85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:47.616354 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d3b66-f55c-4841-b451-9490c670af85 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:47.617095 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d3b66-f55c-4841-b451-9490c670af85 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:47.617603 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d3b66-f55c-4841-b451-9490c670af85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:47.619099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 354/683] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:47.622878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4777b-b20d-4bb7-9e7d-74c6240512d6 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:47.634114 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d3b66-f55c-4841-b451-9490c670af85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:47.641618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-dc8d3b66-f55c-4841-b451-9490c670af85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:37:47.643226 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 330/684] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:47.643952 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d3b66-f55c-4841-b451-9490c670af85 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:47.723390 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4777b-b20d-4bb7-9e7d-74c6240512d6 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:47.744830 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d3b66-f55c-4841-b451-9490c670af85 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:47.757688 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644a092-4f16-425c-81ae-a87f7e21685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:47.759181 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644a092-4f16-425c-81ae-a87f7e21685e None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:47.759656 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644a092-4f16-425c-81ae-a87f7e21685e None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:47.760137 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644a092-4f16-425c-81ae-a87f7e21685e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:47.761258 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644a092-4f16-425c-81ae-a87f7e21685e None admin] RBAC: Adding query filter params (role.id=16dc6f09d53447fd9e4a95fb1df71d9d, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=7990c92f59454156bbd99445387ca889) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:47.761759 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644a092-4f16-425c-81ae-a87f7e21685e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:47.763415 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644a092-4f16-425c-81ae-a87f7e21685e None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:47.774860 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 355/685] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:37:47 2022] GET /identity/v3/role_assignments?user.id=7990c92f59454156bbd99445387ca889&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=16dc6f09d53447fd9e4a95fb1df71d9d => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:47.776188 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644a092-4f16-425c-81ae-a87f7e21685e None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:47.783244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1638f-7982-4615-ba38-e29cce7864e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:47.784053 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1638f-7982-4615-ba38-e29cce7864e4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:47.784337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1638f-7982-4615-ba38-e29cce7864e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:47.784614 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d1638f-7982-4615-ba38-e29cce7864e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:47.802926 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1638f-7982-4615-ba38-e29cce7864e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:47.804415 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d1638f-7982-4615-ba38-e29cce7864e4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:47.819564 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-58d1638f-7982-4615-ba38-e29cce7864e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 16:37:47.821741 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 331/686] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Apr 11 16:37:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:47.827147 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1638f-7982-4615-ba38-e29cce7864e4 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:47.947738 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d1638f-7982-4615-ba38-e29cce7864e4 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:47.986109 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79ac90-fc2b-4a1b-b9f6-2c4a54198176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:47.986832 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79ac90-fc2b-4a1b-b9f6-2c4a54198176 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:47.987117 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79ac90-fc2b-4a1b-b9f6-2c4a54198176 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:47.987395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79ac90-fc2b-4a1b-b9f6-2c4a54198176 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:47.988232 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79ac90-fc2b-4a1b-b9f6-2c4a54198176 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:47.988542 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79ac90-fc2b-4a1b-b9f6-2c4a54198176 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:47.989961 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79ac90-fc2b-4a1b-b9f6-2c4a54198176 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:48.018621 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 332/687] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Apr 11 16:37:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:48.020092 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644a092-4f16-425c-81ae-a87f7e21685e None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:48.025451 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79ac90-fc2b-4a1b-b9f6-2c4a54198176 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:48.065589 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f7d7a-c4c0-48b2-a23f-2b7369ef4e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:48.066810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f7d7a-c4c0-48b2-a23f-2b7369ef4e45 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:48.067344 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f7d7a-c4c0-48b2-a23f-2b7369ef4e45 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:48.067957 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f7d7a-c4c0-48b2-a23f-2b7369ef4e45 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:48.069080 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f7d7a-c4c0-48b2-a23f-2b7369ef4e45 None admin] RBAC: Adding query filter params (name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:48.069701 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f7d7a-c4c0-48b2-a23f-2b7369ef4e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:48.071880 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f7d7a-c4c0-48b2-a23f-2b7369ef4e45 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:48.080976 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 356/688] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:37:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:48.087636 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f7d7a-c4c0-48b2-a23f-2b7369ef4e45 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:48.141627 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79ac90-fc2b-4a1b-b9f6-2c4a54198176 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:48.175902 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badbe0d-7690-40d9-98f5-7f0868189e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:48.176915 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badbe0d-7690-40d9-98f5-7f0868189e20 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:48.177390 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badbe0d-7690-40d9-98f5-7f0868189e20 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:48.177876 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badbe0d-7690-40d9-98f5-7f0868189e20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:48.191330 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f7d7a-c4c0-48b2-a23f-2b7369ef4e45 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:48.225296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b74b08-64d5-4d80-b3ea-8dfefdca9ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:48.226013 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b74b08-64d5-4d80-b3ea-8dfefdca9ba3 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:48.226278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b74b08-64d5-4d80-b3ea-8dfefdca9ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:48.227084 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b74b08-64d5-4d80-b3ea-8dfefdca9ba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:48.238862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b74b08-64d5-4d80-b3ea-8dfefdca9ba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:48.240348 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b74b08-64d5-4d80-b3ea-8dfefdca9ba3 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:48.248417 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badbe0d-7690-40d9-98f5-7f0868189e20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:48.250079 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badbe0d-7690-40d9-98f5-7f0868189e20 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:48.257336 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-28b74b08-64d5-4d80-b3ea-8dfefdca9ba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:48.260021 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 357/689] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:48.267613 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b74b08-64d5-4d80-b3ea-8dfefdca9ba3 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:48.351505 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 333/690] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:48.357731 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badbe0d-7690-40d9-98f5-7f0868189e20 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:48.384757 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b74b08-64d5-4d80-b3ea-8dfefdca9ba3 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:48.419179 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cddd5a-1787-4ae0-ba6d-64833d51d549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:48.419864 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cddd5a-1787-4ae0-ba6d-64833d51d549 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:48.420148 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cddd5a-1787-4ae0-ba6d-64833d51d549 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:48.420421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cddd5a-1787-4ae0-ba6d-64833d51d549 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:48.421134 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cddd5a-1787-4ae0-ba6d-64833d51d549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:48.421437 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cddd5a-1787-4ae0-ba6d-64833d51d549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:48.422821 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cddd5a-1787-4ae0-ba6d-64833d51d549 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:48.446666 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 358/691] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:48.447971 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cddd5a-1787-4ae0-ba6d-64833d51d549 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:48.490444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badbe0d-7690-40d9-98f5-7f0868189e20 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:48.561260 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0317d49-998c-4606-a296-e718180ba2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:48.562056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0317d49-998c-4606-a296-e718180ba2ae None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:48.562332 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0317d49-998c-4606-a296-e718180ba2ae None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:48.562633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0317d49-998c-4606-a296-e718180ba2ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:48.590290 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0317d49-998c-4606-a296-e718180ba2ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:48.592101 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0317d49-998c-4606-a296-e718180ba2ae None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:48.629339 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-a0317d49-998c-4606-a296-e718180ba2ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:48.632243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 334/692] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:48.638984 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0317d49-998c-4606-a296-e718180ba2ae None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:48.650603 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cddd5a-1787-4ae0-ba6d-64833d51d549 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:48.704184 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd065cca-bb31-478c-a393-10d1ad8713bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:48.704984 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd065cca-bb31-478c-a393-10d1ad8713bc None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:48.705261 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd065cca-bb31-478c-a393-10d1ad8713bc None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:48.705530 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd065cca-bb31-478c-a393-10d1ad8713bc None admin] PATH_INFO: `/v3/users/swift` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:48.719678 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd065cca-bb31-478c-a393-10d1ad8713bc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:48.721120 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd065cca-bb31-478c-a393-10d1ad8713bc None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:48.742102 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-dd065cca-bb31-478c-a393-10d1ad8713bc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 16:37:48.752076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 359/693] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:37:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:48.767929 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd065cca-bb31-478c-a393-10d1ad8713bc None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:48.769775 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0317d49-998c-4606-a296-e718180ba2ae None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:48.807859 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337b4d0-d79f-47fe-9b97-f301226c2abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:48.808513 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337b4d0-d79f-47fe-9b97-f301226c2abc None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:48.808788 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337b4d0-d79f-47fe-9b97-f301226c2abc None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:48.809056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337b4d0-d79f-47fe-9b97-f301226c2abc None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:48.809763 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337b4d0-d79f-47fe-9b97-f301226c2abc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:48.810063 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337b4d0-d79f-47fe-9b97-f301226c2abc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:48.811432 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337b4d0-d79f-47fe-9b97-f301226c2abc None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:48.828483 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 335/694] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:48.829742 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337b4d0-d79f-47fe-9b97-f301226c2abc None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:48.957211 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337b4d0-d79f-47fe-9b97-f301226c2abc None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:48.996723 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357845c5-ccd2-4a8f-bf8a-f8a4e0f6a9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:48.997444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357845c5-ccd2-4a8f-bf8a-f8a4e0f6a9a3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:48.997723 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357845c5-ccd2-4a8f-bf8a-f8a4e0f6a9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:48.997991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357845c5-ccd2-4a8f-bf8a-f8a4e0f6a9a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:49.002774 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd065cca-bb31-478c-a393-10d1ad8713bc None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:49.015380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357845c5-ccd2-4a8f-bf8a-f8a4e0f6a9a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:49.016819 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357845c5-ccd2-4a8f-bf8a-f8a4e0f6a9a3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:49.037328 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-357845c5-ccd2-4a8f-bf8a-f8a4e0f6a9a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:49.045931 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 336/695] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:49.050484 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357845c5-ccd2-4a8f-bf8a-f8a4e0f6a9a3 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:49.069663 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65cb90-93bb-4dd1-bc67-4cf4a7853e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:49.070363 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65cb90-93bb-4dd1-bc67-4cf4a7853e85 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:49.070680 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65cb90-93bb-4dd1-bc67-4cf4a7853e85 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:49.070956 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae65cb90-93bb-4dd1-bc67-4cf4a7853e85 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:49.071789 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65cb90-93bb-4dd1-bc67-4cf4a7853e85 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:49.072094 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65cb90-93bb-4dd1-bc67-4cf4a7853e85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:49.073518 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae65cb90-93bb-4dd1-bc67-4cf4a7853e85 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:49.097242 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 360/696] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Apr 11 16:37:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:49.103097 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65cb90-93bb-4dd1-bc67-4cf4a7853e85 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:49.224884 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357845c5-ccd2-4a8f-bf8a-f8a4e0f6a9a3 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:49.261463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e008d-5436-49e8-9e48-ca8b8bf0474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:49.262049 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e008d-5436-49e8-9e48-ca8b8bf0474d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:49.262334 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e008d-5436-49e8-9e48-ca8b8bf0474d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:49.262623 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9e008d-5436-49e8-9e48-ca8b8bf0474d None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:49.263418 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e008d-5436-49e8-9e48-ca8b8bf0474d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:49.263734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e008d-5436-49e8-9e48-ca8b8bf0474d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:49.265425 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9e008d-5436-49e8-9e48-ca8b8bf0474d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:49.278301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 337/697] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:49.283787 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e008d-5436-49e8-9e48-ca8b8bf0474d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:49.318688 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae65cb90-93bb-4dd1-bc67-4cf4a7853e85 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:49.356792 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0536d-7a1b-4fd1-a9f1-813f00bb93a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:49.357648 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0536d-7a1b-4fd1-a9f1-813f00bb93a4 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:49.357932 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0536d-7a1b-4fd1-a9f1-813f00bb93a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:49.358203 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f0536d-7a1b-4fd1-a9f1-813f00bb93a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:49.429500 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0536d-7a1b-4fd1-a9f1-813f00bb93a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:49.431051 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f0536d-7a1b-4fd1-a9f1-813f00bb93a4 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:49.452659 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9e008d-5436-49e8-9e48-ca8b8bf0474d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:49.493610 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d92ca3e-5307-42ed-bcc2-c47d4b054782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:49.494417 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92ca3e-5307-42ed-bcc2-c47d4b054782 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:49.494724 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92ca3e-5307-42ed-bcc2-c47d4b054782 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:49.495296 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d92ca3e-5307-42ed-bcc2-c47d4b054782 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:49.496378 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92ca3e-5307-42ed-bcc2-c47d4b054782 None admin] RBAC: Adding query filter params (role.id=13de1ce875d44fcc988cc31b3a0639be, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=ba3665d046864985916fdd6c4a4edcd1) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:49.496689 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92ca3e-5307-42ed-bcc2-c47d4b054782 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:49.498091 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d92ca3e-5307-42ed-bcc2-c47d4b054782 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:49.511280 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 338/698] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:37:49 2022] GET /identity/v3/role_assignments?user.id=ba3665d046864985916fdd6c4a4edcd1&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:49.512894 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c1689-1a57-4165-8449-3324ab4022db None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:49.513527 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c1689-1a57-4165-8449-3324ab4022db None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:49.513807 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c1689-1a57-4165-8449-3324ab4022db None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:49.519959 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 339/699] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:49.521889 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dde7a9-5558-48a6-a3d9-1bb2ceccac06 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:49.522178 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dde7a9-5558-48a6-a3d9-1bb2ceccac06 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:49.522694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dde7a9-5558-48a6-a3d9-1bb2ceccac06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:49.553895 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-53dde7a9-5558-48a6-a3d9-1bb2ceccac06 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:49.557791 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-53dde7a9-5558-48a6-a3d9-1bb2ceccac06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:49.572122 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 361/700] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 16:37:49.578845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0536d-7a1b-4fd1-a9f1-813f00bb93a4 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:49.698366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 340/701] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:37:49.741404 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f0536d-7a1b-4fd1-a9f1-813f00bb93a4 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:49.748225 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dde7a9-5558-48a6-a3d9-1bb2ceccac06 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:49.793446 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a735ad0-58c4-4ccb-b9a2-60a27a87eb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:49.794159 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a735ad0-58c4-4ccb-b9a2-60a27a87eb42 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:49.794437 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a735ad0-58c4-4ccb-b9a2-60a27a87eb42 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:49.794752 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a735ad0-58c4-4ccb-b9a2-60a27a87eb42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:49.806561 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a735ad0-58c4-4ccb-b9a2-60a27a87eb42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:49.808604 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a735ad0-58c4-4ccb-b9a2-60a27a87eb42 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:49.827704 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-7a735ad0-58c4-4ccb-b9a2-60a27a87eb42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:49.829841 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 362/702] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:49.837932 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a735ad0-58c4-4ccb-b9a2-60a27a87eb42 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:49.948908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a735ad0-58c4-4ccb-b9a2-60a27a87eb42 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:49.957532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dde7a9-5558-48a6-a3d9-1bb2ceccac06 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:49.993910 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27c3e55-5cdf-484e-8ef4-eaf6207521ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:49.994728 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c3e55-5cdf-484e-8ef4-eaf6207521ec None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:49.995007 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c3e55-5cdf-484e-8ef4-eaf6207521ec None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:49.995279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27c3e55-5cdf-484e-8ef4-eaf6207521ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:49.996495 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617c45ee-596a-4f26-bda2-19a0ab2eebd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:49.997396 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c45ee-596a-4f26-bda2-19a0ab2eebd5 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:49.998045 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c45ee-596a-4f26-bda2-19a0ab2eebd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:49.998391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617c45ee-596a-4f26-bda2-19a0ab2eebd5 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:49.999200 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c45ee-596a-4f26-bda2-19a0ab2eebd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:49.999573 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c45ee-596a-4f26-bda2-19a0ab2eebd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:50.001015 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617c45ee-596a-4f26-bda2-19a0ab2eebd5 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:50.005120 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c3e55-5cdf-484e-8ef4-eaf6207521ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:50.006532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27c3e55-5cdf-484e-8ef4-eaf6207521ec None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:50.016165 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 363/703] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:50.017595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6839a-3431-4087-a3ea-3c3b97d8759c None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:50.017949 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6839a-3431-4087-a3ea-3c3b97d8759c None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:50.018295 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6839a-3431-4087-a3ea-3c3b97d8759c None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:50.019884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 364/704] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:50.025138 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6839a-3431-4087-a3ea-3c3b97d8759c None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:50.029664 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-d27c3e55-5cdf-484e-8ef4-eaf6207521ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:50.030410 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 341/705] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:50.034006 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b19719-022e-45ce-a5e6-db0edcd05335 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:50.034006 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b19719-022e-45ce-a5e6-db0edcd05335 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:50.034006 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b19719-022e-45ce-a5e6-db0edcd05335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:50.050532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-d8b19719-022e-45ce-a5e6-db0edcd05335 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:50.051973 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d8b19719-022e-45ce-a5e6-db0edcd05335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:50.142620 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 342/706] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:50.142620 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b19719-022e-45ce-a5e6-db0edcd05335 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:50.159680 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6839a-3431-4087-a3ea-3c3b97d8759c None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:50.194120 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a61d8-5e91-470e-9155-5c025926124d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:50.194943 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a61d8-5e91-470e-9155-5c025926124d None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:50.195244 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a61d8-5e91-470e-9155-5c025926124d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:50.195517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a61d8-5e91-470e-9155-5c025926124d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:50.202194 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a61d8-5e91-470e-9155-5c025926124d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:50.203721 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a61d8-5e91-470e-9155-5c025926124d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:50.216995 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-6c5a61d8-5e91-470e-9155-5c025926124d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:50.223075 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 365/707] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:50.223928 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a61d8-5e91-470e-9155-5c025926124d None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:50.273939 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b19719-022e-45ce-a5e6-db0edcd05335 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:50.322800 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc0d46-3cbc-4970-8203-d40802cc7e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:50.324115 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc0d46-3cbc-4970-8203-d40802cc7e3f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:50.324806 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc0d46-3cbc-4970-8203-d40802cc7e3f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:50.325236 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc0d46-3cbc-4970-8203-d40802cc7e3f None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:50.326261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc0d46-3cbc-4970-8203-d40802cc7e3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:50.327075 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc0d46-3cbc-4970-8203-d40802cc7e3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:50.328979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc0d46-3cbc-4970-8203-d40802cc7e3f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:50.335258 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a61d8-5e91-470e-9155-5c025926124d None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:50.349341 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 343/708] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:50.349341 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc0d46-3cbc-4970-8203-d40802cc7e3f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:50.374665 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad10ba-f117-4790-b538-4416e7df6761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:50.375633 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad10ba-f117-4790-b538-4416e7df6761 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:50.375974 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad10ba-f117-4790-b538-4416e7df6761 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:50.376315 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ad10ba-f117-4790-b538-4416e7df6761 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:50.377081 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad10ba-f117-4790-b538-4416e7df6761 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:50.378506 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ad10ba-f117-4790-b538-4416e7df6761 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:50.392195 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-83ad10ba-f117-4790-b538-4416e7df6761 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 11 16:37:50.398976 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 366/709] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Apr 11 16:37:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:50.398976 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad10ba-f117-4790-b538-4416e7df6761 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:50.476123 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc0d46-3cbc-4970-8203-d40802cc7e3f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:50.506849 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ad10ba-f117-4790-b538-4416e7df6761 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:50.509189 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32ec9b-d7cf-4274-8dfe-4ba514acb2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:50.509849 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32ec9b-d7cf-4274-8dfe-4ba514acb2a9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:50.510124 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32ec9b-d7cf-4274-8dfe-4ba514acb2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:50.510429 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e32ec9b-d7cf-4274-8dfe-4ba514acb2a9 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:50.511287 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32ec9b-d7cf-4274-8dfe-4ba514acb2a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:50.511595 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32ec9b-d7cf-4274-8dfe-4ba514acb2a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:50.513097 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e32ec9b-d7cf-4274-8dfe-4ba514acb2a9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:50.530288 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 344/710] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:50.530288 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32ec9b-d7cf-4274-8dfe-4ba514acb2a9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:50.545217 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df06a73-2da4-4fdb-8bde-89324b3a37ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:50.545876 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df06a73-2da4-4fdb-8bde-89324b3a37ba None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:50.546155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df06a73-2da4-4fdb-8bde-89324b3a37ba None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:50.546418 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df06a73-2da4-4fdb-8bde-89324b3a37ba None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:50.547142 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df06a73-2da4-4fdb-8bde-89324b3a37ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:50.548573 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df06a73-2da4-4fdb-8bde-89324b3a37ba None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:50.567957 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 367/711] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Apr 11 16:37:50 2022] POST /identity/v3/users => generated 254 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:37:50.569647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec87d0-63da-47d3-848d-76c739f90cf4 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:50.570714 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec87d0-63da-47d3-848d-76c739f90cf4 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:50.571186 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ec87d0-63da-47d3-848d-76c739f90cf4 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:50.572666 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 368/712] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:50.573716 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec87d0-63da-47d3-848d-76c739f90cf4 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:50.635290 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e32ec9b-d7cf-4274-8dfe-4ba514acb2a9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:50.672613 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e604da88-2ab7-4359-bb18-f01b0626a475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:50.673460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604da88-2ab7-4359-bb18-f01b0626a475 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:50.673748 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604da88-2ab7-4359-bb18-f01b0626a475 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:50.674025 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e604da88-2ab7-4359-bb18-f01b0626a475 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:50.674775 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604da88-2ab7-4359-bb18-f01b0626a475 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:50.675085 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604da88-2ab7-4359-bb18-f01b0626a475 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:50.676547 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e604da88-2ab7-4359-bb18-f01b0626a475 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:50.686615 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 345/713] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Apr 11 16:37:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:50.686615 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15053473-6551-446e-82b0-dd48fa995bf2 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:50.686615 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15053473-6551-446e-82b0-dd48fa995bf2 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:50.686615 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15053473-6551-446e-82b0-dd48fa995bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:50.705575 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-15053473-6551-446e-82b0-dd48fa995bf2 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:50.706810 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-15053473-6551-446e-82b0-dd48fa995bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:50.717611 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ec87d0-63da-47d3-848d-76c739f90cf4 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:50.771647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57ac50-90a5-4ffa-b761-54d6d73e7af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:50.773566 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57ac50-90a5-4ffa-b761-54d6d73e7af0 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:50.774629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57ac50-90a5-4ffa-b761-54d6d73e7af0 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:50.775536 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57ac50-90a5-4ffa-b761-54d6d73e7af0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:50.776820 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57ac50-90a5-4ffa-b761-54d6d73e7af0 None admin] RBAC: Adding query filter params (role.id=16dc6f09d53447fd9e4a95fb1df71d9d, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=1f6659c6661840a79ba9ff1c3c9e93c6) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:50.777373 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57ac50-90a5-4ffa-b761-54d6d73e7af0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:50.779234 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57ac50-90a5-4ffa-b761-54d6d73e7af0 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:50.786478 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 346/714] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:50.790833 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 369/715] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:37:50 2022] GET /identity/v3/role_assignments?user.id=1f6659c6661840a79ba9ff1c3c9e93c6&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=16dc6f09d53447fd9e4a95fb1df71d9d => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:50.791523 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15053473-6551-446e-82b0-dd48fa995bf2 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:50.811013 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57ac50-90a5-4ffa-b761-54d6d73e7af0 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:50.926987 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57ac50-90a5-4ffa-b761-54d6d73e7af0 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:50.948555 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15053473-6551-446e-82b0-dd48fa995bf2 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:50.982289 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e989ecd-d01d-4125-a8bb-f1732741919d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:50.983673 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e989ecd-d01d-4125-a8bb-f1732741919d None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:50.984531 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e989ecd-d01d-4125-a8bb-f1732741919d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:50.985154 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e989ecd-d01d-4125-a8bb-f1732741919d None admin] PATH_INFO: `/v3/services/network` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:50.986079 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e989ecd-d01d-4125-a8bb-f1732741919d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:50.988274 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e989ecd-d01d-4125-a8bb-f1732741919d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:50.993089 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b6618-5012-4721-a240-5c32ee8dec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:50.993761 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b6618-5012-4721-a240-5c32ee8dec87 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:50.994043 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b6618-5012-4721-a240-5c32ee8dec87 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:50.994317 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b6618-5012-4721-a240-5c32ee8dec87 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:50.995108 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b6618-5012-4721-a240-5c32ee8dec87 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:50.995404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b6618-5012-4721-a240-5c32ee8dec87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:50.997722 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b6618-5012-4721-a240-5c32ee8dec87 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:51.000825 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-1e989ecd-d01d-4125-a8bb-f1732741919d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 11 16:37:51.002338 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 370/716] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:50 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:51.004068 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 347/717] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Apr 11 16:37:50 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:51.011348 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e989ecd-d01d-4125-a8bb-f1732741919d None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:51.129681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e989ecd-d01d-4125-a8bb-f1732741919d None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:51.168939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3062e8-48d9-4528-bb52-aac2ebbc7dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:51.169906 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3062e8-48d9-4528-bb52-aac2ebbc7dd4 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:51.170387 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3062e8-48d9-4528-bb52-aac2ebbc7dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:51.170892 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3062e8-48d9-4528-bb52-aac2ebbc7dd4 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:51.171799 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3062e8-48d9-4528-bb52-aac2ebbc7dd4 None admin] RBAC: Adding query filter params (name=network) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:51.172283 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3062e8-48d9-4528-bb52-aac2ebbc7dd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:51.173857 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3062e8-48d9-4528-bb52-aac2ebbc7dd4 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:51.179548 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 371/718] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Apr 11 16:37:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:51.185313 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b6618-5012-4721-a240-5c32ee8dec87 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:51.292933 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b6618-5012-4721-a240-5c32ee8dec87 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:51.325861 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d1529-cd98-47f8-a970-99c2d6879191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:51.326526 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d1529-cd98-47f8-a970-99c2d6879191 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:51.326833 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d1529-cd98-47f8-a970-99c2d6879191 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:51.327106 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d1529-cd98-47f8-a970-99c2d6879191 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:51.327809 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d1529-cd98-47f8-a970-99c2d6879191 None admin] RBAC: Adding query filter params (type=network) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:51.328115 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d1529-cd98-47f8-a970-99c2d6879191 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:51.329472 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d1529-cd98-47f8-a970-99c2d6879191 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:51.334256 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 348/719] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Apr 11 16:37:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:52.132744 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26722b6c-ff06-4085-9c81-e286d6b54c4a None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:52.133533 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26722b6c-ff06-4085-9c81-e286d6b54c4a None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:52.133533 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26722b6c-ff06-4085-9c81-e286d6b54c4a None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:52.135051 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 372/720] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:52.141166 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2652c30-37f2-49c9-859f-24cf60a6581d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:52.141846 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2652c30-37f2-49c9-859f-24cf60a6581d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:52.141846 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2652c30-37f2-49c9-859f-24cf60a6581d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:52.167583 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f2652c30-37f2-49c9-859f-24cf60a6581d None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:52.168769 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f2652c30-37f2-49c9-859f-24cf60a6581d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:52.238340 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 349/721] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:52.267444 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26722b6c-ff06-4085-9c81-e286d6b54c4a None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:52.408195 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26722b6c-ff06-4085-9c81-e286d6b54c4a None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:52.453927 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e2e75-6e95-4925-97fe-c0fb1654d9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:52.454747 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e2e75-6e95-4925-97fe-c0fb1654d9c6 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:52.455023 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e2e75-6e95-4925-97fe-c0fb1654d9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:52.455282 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e2e75-6e95-4925-97fe-c0fb1654d9c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:52.472396 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e2e75-6e95-4925-97fe-c0fb1654d9c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:52.479607 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-9a8e2e75-6e95-4925-97fe-c0fb1654d9c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:37:52.481198 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 373/722] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:37:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:52.487103 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2652c30-37f2-49c9-859f-24cf60a6581d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:52.637203 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2652c30-37f2-49c9-859f-24cf60a6581d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:52.682262 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e68e8-bd68-4861-8cbb-dc223a0f9dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:52.682958 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e68e8-bd68-4861-8cbb-dc223a0f9dae None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:52.683235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e68e8-bd68-4861-8cbb-dc223a0f9dae None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:52.683507 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30e68e8-bd68-4861-8cbb-dc223a0f9dae None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:52.684244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e68e8-bd68-4861-8cbb-dc223a0f9dae None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:52.684546 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e68e8-bd68-4861-8cbb-dc223a0f9dae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:52.685899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30e68e8-bd68-4861-8cbb-dc223a0f9dae None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:52.697906 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 350/723] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:52.704310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e2e75-6e95-4925-97fe-c0fb1654d9c6 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:52.831031 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e2e75-6e95-4925-97fe-c0fb1654d9c6 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:52.870508 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d809cfb-c5ce-457d-83f1-f9a4fa25f9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:52.871319 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d809cfb-c5ce-457d-83f1-f9a4fa25f9d3 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:52.871597 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d809cfb-c5ce-457d-83f1-f9a4fa25f9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:52.871872 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d809cfb-c5ce-457d-83f1-f9a4fa25f9d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:52.882551 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d809cfb-c5ce-457d-83f1-f9a4fa25f9d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:52.884089 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d809cfb-c5ce-457d-83f1-f9a4fa25f9d3 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:52.910266 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-5d809cfb-c5ce-457d-83f1-f9a4fa25f9d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:52.911761 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 374/724] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:52.917816 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e68e8-bd68-4861-8cbb-dc223a0f9dae None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:53.067916 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30e68e8-bd68-4861-8cbb-dc223a0f9dae None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:53.116295 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0b7de-b77a-40e6-b5b6-93e4ab442287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:53.116983 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0b7de-b77a-40e6-b5b6-93e4ab442287 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:53.117267 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0b7de-b77a-40e6-b5b6-93e4ab442287 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:53.117546 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded0b7de-b77a-40e6-b5b6-93e4ab442287 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:53.118267 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0b7de-b77a-40e6-b5b6-93e4ab442287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:53.118575 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0b7de-b77a-40e6-b5b6-93e4ab442287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:53.119965 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded0b7de-b77a-40e6-b5b6-93e4ab442287 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:53.137613 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 351/725] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:53.143287 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d809cfb-c5ce-457d-83f1-f9a4fa25f9d3 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:53.251735 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d809cfb-c5ce-457d-83f1-f9a4fa25f9d3 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:53.290791 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a903c7e-3d47-49aa-a83a-8f4710912b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:53.291598 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a903c7e-3d47-49aa-a83a-8f4710912b36 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:53.291878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a903c7e-3d47-49aa-a83a-8f4710912b36 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:53.292148 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a903c7e-3d47-49aa-a83a-8f4710912b36 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:53.300457 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a903c7e-3d47-49aa-a83a-8f4710912b36 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:53.301909 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a903c7e-3d47-49aa-a83a-8f4710912b36 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:53.321287 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-7a903c7e-3d47-49aa-a83a-8f4710912b36 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 16:37:53.327021 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 375/726] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Apr 11 16:37:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:53.328661 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0b7de-b77a-40e6-b5b6-93e4ab442287 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:53.447979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded0b7de-b77a-40e6-b5b6-93e4ab442287 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:53.490985 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadaa9a-f554-4f86-a990-c9bab4e0ff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:53.491658 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadaa9a-f554-4f86-a990-c9bab4e0ff9b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:53.491995 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadaa9a-f554-4f86-a990-c9bab4e0ff9b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:53.492279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadaa9a-f554-4f86-a990-c9bab4e0ff9b None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:53.493109 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadaa9a-f554-4f86-a990-c9bab4e0ff9b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:53.493418 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadaa9a-f554-4f86-a990-c9bab4e0ff9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:53.494855 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eadaa9a-f554-4f86-a990-c9bab4e0ff9b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:53.520976 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 352/727] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Apr 11 16:37:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:53.526457 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a903c7e-3d47-49aa-a83a-8f4710912b36 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:53.637191 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a903c7e-3d47-49aa-a83a-8f4710912b36 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:53.671521 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6fa82-0727-4d2d-bd51-b236bddf101a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:53.672311 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6fa82-0727-4d2d-bd51-b236bddf101a None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:53.672595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6fa82-0727-4d2d-bd51-b236bddf101a None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:53.672872 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6fa82-0727-4d2d-bd51-b236bddf101a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:53.684298 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6fa82-0727-4d2d-bd51-b236bddf101a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:53.685819 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6fa82-0727-4d2d-bd51-b236bddf101a None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:53.702368 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-b9c6fa82-0727-4d2d-bd51-b236bddf101a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:53.703942 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 376/728] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:53.709456 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadaa9a-f554-4f86-a990-c9bab4e0ff9b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:53.812507 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eadaa9a-f554-4f86-a990-c9bab4e0ff9b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:53.822727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eda9e7-49c1-4a61-b469-e608637ac1cb None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:53.822727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eda9e7-49c1-4a61-b469-e608637ac1cb None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:53.822727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eda9e7-49c1-4a61-b469-e608637ac1cb None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:53.823647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 377/729] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:37:53.829458 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1ed78-84f9-4469-a1a2-b12afbffac74 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:53.830084 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1ed78-84f9-4469-a1a2-b12afbffac74 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:53.830568 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1ed78-84f9-4469-a1a2-b12afbffac74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:53.859111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610ea37-d31a-4d21-ba2b-766fb35c57fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:53.859111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610ea37-d31a-4d21-ba2b-766fb35c57fd None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:53.859111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610ea37-d31a-4d21-ba2b-766fb35c57fd None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:53.859111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610ea37-d31a-4d21-ba2b-766fb35c57fd None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:53.859541 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610ea37-d31a-4d21-ba2b-766fb35c57fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:53.859541 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610ea37-d31a-4d21-ba2b-766fb35c57fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:53.860535 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610ea37-d31a-4d21-ba2b-766fb35c57fd None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:53.873057 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-45e1ed78-84f9-4469-a1a2-b12afbffac74 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:53.873308 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 353/730] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:53.874802 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-45e1ed78-84f9-4469-a1a2-b12afbffac74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:53.882613 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610ea37-d31a-4d21-ba2b-766fb35c57fd None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:53.962199 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 378/731] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 16:37:53.963909 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572c3b3-39a1-4080-8858-9ea889126f4e None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:53.964195 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572c3b3-39a1-4080-8858-9ea889126f4e None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:53.964470 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572c3b3-39a1-4080-8858-9ea889126f4e None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:53.970513 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 379/732] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:53.971859 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8178fe-60fd-404b-a066-685507d78269 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:53.972305 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8178fe-60fd-404b-a066-685507d78269 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:53.972582 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8178fe-60fd-404b-a066-685507d78269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:53.994192 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-fa8178fe-60fd-404b-a066-685507d78269 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:53.995691 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-fa8178fe-60fd-404b-a066-685507d78269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:54.006119 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610ea37-d31a-4d21-ba2b-766fb35c57fd None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:54.053159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be226dd0-bb2c-45b7-ae11-6e92a2f591ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:54.054175 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be226dd0-bb2c-45b7-ae11-6e92a2f591ce None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:54.055156 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be226dd0-bb2c-45b7-ae11-6e92a2f591ce None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:54.055460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be226dd0-bb2c-45b7-ae11-6e92a2f591ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:54.068767 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be226dd0-bb2c-45b7-ae11-6e92a2f591ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:54.070853 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be226dd0-bb2c-45b7-ae11-6e92a2f591ce None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:54.073537 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 380/733] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:54.079698 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8178fe-60fd-404b-a066-685507d78269 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:54.086465 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-be226dd0-bb2c-45b7-ae11-6e92a2f591ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:54.088001 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 354/734] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:54.094027 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be226dd0-bb2c-45b7-ae11-6e92a2f591ce None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:54.196299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8178fe-60fd-404b-a066-685507d78269 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:54.205400 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be226dd0-bb2c-45b7-ae11-6e92a2f591ce None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:54.229995 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9cdb9-4113-453f-be28-6c61486b29be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:54.230811 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9cdb9-4113-453f-be28-6c61486b29be None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:54.231090 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9cdb9-4113-453f-be28-6c61486b29be None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:54.231367 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc9cdb9-4113-453f-be28-6c61486b29be None admin] PATH_INFO: `/v3/roles/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:54.239442 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e348c-1a71-4103-b1ae-dcb93cc76271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:54.240099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e348c-1a71-4103-b1ae-dcb93cc76271 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:54.240379 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e348c-1a71-4103-b1ae-dcb93cc76271 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:54.240656 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e348c-1a71-4103-b1ae-dcb93cc76271 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:54.241322 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc9cdb9-4113-453f-be28-6c61486b29be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:54.241432 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e348c-1a71-4103-b1ae-dcb93cc76271 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:54.241734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e348c-1a71-4103-b1ae-dcb93cc76271 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:54.243231 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e348c-1a71-4103-b1ae-dcb93cc76271 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:54.248298 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-6fc9cdb9-4113-453f-be28-6c61486b29be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:37:54.249859 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 381/735] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:54.250616 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9cdb9-4113-453f-be28-6c61486b29be None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:54.254647 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 355/736] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:54.256723 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175b39f-6fab-423c-86ba-e64a11deeeb6 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:54.257015 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175b39f-6fab-423c-86ba-e64a11deeeb6 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:54.257293 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175b39f-6fab-423c-86ba-e64a11deeeb6 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:54.263110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 356/737] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:54.263110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354ad04-eb9d-4be0-a890-6d369c07f0fd None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:54.263110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354ad04-eb9d-4be0-a890-6d369c07f0fd None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:54.263110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354ad04-eb9d-4be0-a890-6d369c07f0fd None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:54.263110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 357/738] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:54.263110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354ad04-eb9d-4be0-a890-6d369c07f0fd None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:54.347168 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc9cdb9-4113-453f-be28-6c61486b29be None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:54.358164 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354ad04-eb9d-4be0-a890-6d369c07f0fd None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:54.377618 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f03ec-1ba8-41e8-8ec5-fca0d5186b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:54.378264 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f03ec-1ba8-41e8-8ec5-fca0d5186b87 None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:54.378543 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f03ec-1ba8-41e8-8ec5-fca0d5186b87 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:54.378866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f03ec-1ba8-41e8-8ec5-fca0d5186b87 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:54.379572 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f03ec-1ba8-41e8-8ec5-fca0d5186b87 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:54.381278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f03ec-1ba8-41e8-8ec5-fca0d5186b87 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:54.392508 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8c9bd3-2525-45fb-ab5a-e94e75eab502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:54.393156 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c9bd3-2525-45fb-ab5a-e94e75eab502 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:54.393503 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c9bd3-2525-45fb-ab5a-e94e75eab502 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:54.393785 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8c9bd3-2525-45fb-ab5a-e94e75eab502 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:54.394518 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c9bd3-2525-45fb-ab5a-e94e75eab502 None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:54.394853 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c9bd3-2525-45fb-ab5a-e94e75eab502 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:54.395461 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 382/739] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Apr 11 16:37:54 2022] POST /identity/v3/services => generated 251 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:37:54.396320 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8c9bd3-2525-45fb-ab5a-e94e75eab502 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:54.396443 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f03ec-1ba8-41e8-8ec5-fca0d5186b87 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:54.410241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 358/740] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:37:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:54.410241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e7921-1280-4d14-87ed-02004a5c9559 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:54.410241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e7921-1280-4d14-87ed-02004a5c9559 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:54.410241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e7921-1280-4d14-87ed-02004a5c9559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:54.424514 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-d75e7921-1280-4d14-87ed-02004a5c9559 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:54.425716 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d75e7921-1280-4d14-87ed-02004a5c9559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:54.526631 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 359/741] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:54.526631 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5afe22-5161-47bf-8760-1664f363e9af None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:54.526631 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5afe22-5161-47bf-8760-1664f363e9af None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:54.526631 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5afe22-5161-47bf-8760-1664f363e9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:54.528410 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f03ec-1ba8-41e8-8ec5-fca0d5186b87 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:54.545786 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3b5afe22-5161-47bf-8760-1664f363e9af None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:54.547059 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3b5afe22-5161-47bf-8760-1664f363e9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:54.565781 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600fa7c-0f76-4d29-91fe-c426e89a5e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:54.567072 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600fa7c-0f76-4d29-91fe-c426e89a5e8e None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:54.567593 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600fa7c-0f76-4d29-91fe-c426e89a5e8e None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:54.568541 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b600fa7c-0f76-4d29-91fe-c426e89a5e8e None admin] PATH_INFO: `/v3/projects/c1eb8559ca744abda7039b767af5818f/users/ba3665d046864985916fdd6c4a4edcd1/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:54.571749 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600fa7c-0f76-4d29-91fe-c426e89a5e8e None admin] RBAC: Authorizing `identity:create_grant(project_id=c1eb8559ca744abda7039b767af5818f, user_id=ba3665d046864985916fdd6c4a4edcd1, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:54.573980 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b600fa7c-0f76-4d29-91fe-c426e89a5e8e None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:54.591884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 383/742] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:37:54 2022] PUT /identity/v3/projects/c1eb8559ca744abda7039b767af5818f/users/ba3665d046864985916fdd6c4a4edcd1/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:37:54.592707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600fa7c-0f76-4d29-91fe-c426e89a5e8e None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:54.618226 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 360/743] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 16:37:54.620084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5afe22-5161-47bf-8760-1664f363e9af None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:54.724864 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b600fa7c-0f76-4d29-91fe-c426e89a5e8e None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:54.728723 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5afe22-5161-47bf-8760-1664f363e9af None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:54.763255 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73898306-6b90-4c30-ae40-d857ff98a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:54.764141 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73898306-6b90-4c30-ae40-d857ff98a416 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:54.764367 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73898306-6b90-4c30-ae40-d857ff98a416 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:54.765002 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73898306-6b90-4c30-ae40-d857ff98a416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:54.766384 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f46868-17c9-4fb1-886f-75193523979c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:54.767094 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f46868-17c9-4fb1-886f-75193523979c None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:54.767380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f46868-17c9-4fb1-886f-75193523979c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:54.767658 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f46868-17c9-4fb1-886f-75193523979c None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:54.768396 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f46868-17c9-4fb1-886f-75193523979c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:54.769796 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f46868-17c9-4fb1-886f-75193523979c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:54.777055 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73898306-6b90-4c30-ae40-d857ff98a416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:54.778732 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73898306-6b90-4c30-ae40-d857ff98a416 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:54.790757 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 361/744] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Apr 11 16:37:54 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:37:54.791817 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f46868-17c9-4fb1-886f-75193523979c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:54.808166 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-73898306-6b90-4c30-ae40-d857ff98a416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:54.809444 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 384/745] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:54.816030 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73898306-6b90-4c30-ae40-d857ff98a416 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:54.969366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f46868-17c9-4fb1-886f-75193523979c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:54.972755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73898306-6b90-4c30-ae40-d857ff98a416 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:55.019480 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ca38f-9c6b-4723-94da-4a24c1d5cfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:55.020152 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ca38f-9c6b-4723-94da-4a24c1d5cfbb None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:55.020415 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ca38f-9c6b-4723-94da-4a24c1d5cfbb None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:55.020683 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2ca38f-9c6b-4723-94da-4a24c1d5cfbb None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:55.021392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ca38f-9c6b-4723-94da-4a24c1d5cfbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:55.021692 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ca38f-9c6b-4723-94da-4a24c1d5cfbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:55.023299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2ca38f-9c6b-4723-94da-4a24c1d5cfbb None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:55.023935 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316b2cd-8c31-47e8-9a18-e769ecbe8f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:55.024954 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316b2cd-8c31-47e8-9a18-e769ecbe8f3f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:55.025449 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316b2cd-8c31-47e8-9a18-e769ecbe8f3f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:55.025928 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2316b2cd-8c31-47e8-9a18-e769ecbe8f3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:55.036749 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 385/746] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:55.037729 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2316b2cd-8c31-47e8-9a18-e769ecbe8f3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:55.042732 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ca38f-9c6b-4723-94da-4a24c1d5cfbb None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:55.045739 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-2316b2cd-8c31-47e8-9a18-e769ecbe8f3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:37:55.047482 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 362/747] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:37:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:55.053021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316b2cd-8c31-47e8-9a18-e769ecbe8f3f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:55.158818 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2316b2cd-8c31-47e8-9a18-e769ecbe8f3f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:55.164803 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2ca38f-9c6b-4723-94da-4a24c1d5cfbb None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:55.195779 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca3ef4-24d2-4507-8a1d-327a334b42ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:55.196369 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca3ef4-24d2-4507-8a1d-327a334b42ae None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:55.196640 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca3ef4-24d2-4507-8a1d-327a334b42ae None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:55.196910 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca3ef4-24d2-4507-8a1d-327a334b42ae None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:55.197798 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca3ef4-24d2-4507-8a1d-327a334b42ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:55.197923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca3ef4-24d2-4507-8a1d-327a334b42ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:55.199322 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca3ef4-24d2-4507-8a1d-327a334b42ae None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:55.206701 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0711238-f527-4b58-93d6-426dcf2556a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:55.208087 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0711238-f527-4b58-93d6-426dcf2556a4 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:55.208579 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0711238-f527-4b58-93d6-426dcf2556a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:55.209040 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0711238-f527-4b58-93d6-426dcf2556a4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:55.216764 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 363/748] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:55.216764 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca3ef4-24d2-4507-8a1d-327a334b42ae None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:55.225037 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0711238-f527-4b58-93d6-426dcf2556a4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:55.227352 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0711238-f527-4b58-93d6-426dcf2556a4 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:55.242874 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-d0711238-f527-4b58-93d6-426dcf2556a4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 16:37:55.245162 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 386/749] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Apr 11 16:37:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:55.254742 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0711238-f527-4b58-93d6-426dcf2556a4 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:55.351821 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0711238-f527-4b58-93d6-426dcf2556a4 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:55.385002 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06d392-72fe-4a75-a568-cf1e4a4b58dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:55.385668 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06d392-72fe-4a75-a568-cf1e4a4b58dd None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:55.385953 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06d392-72fe-4a75-a568-cf1e4a4b58dd None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:55.386233 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06d392-72fe-4a75-a568-cf1e4a4b58dd None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:55.387099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06d392-72fe-4a75-a568-cf1e4a4b58dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:55.387411 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06d392-72fe-4a75-a568-cf1e4a4b58dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:55.388837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06d392-72fe-4a75-a568-cf1e4a4b58dd None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:55.405931 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca3ef4-24d2-4507-8a1d-327a334b42ae None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:55.407179 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 387/750] 10.222.0.73 () {56 vars in 1149 bytes} [Mon Apr 11 16:37:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:55.412717 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06d392-72fe-4a75-a568-cf1e4a4b58dd None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:55.439635 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5266a-fbba-4b73-b7ee-1c608d51daab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:55.440422 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5266a-fbba-4b73-b7ee-1c608d51daab None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:55.440754 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5266a-fbba-4b73-b7ee-1c608d51daab None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:55.441020 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c5266a-fbba-4b73-b7ee-1c608d51daab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:55.451800 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5266a-fbba-4b73-b7ee-1c608d51daab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:55.453177 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c5266a-fbba-4b73-b7ee-1c608d51daab None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:55.470053 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-38c5266a-fbba-4b73-b7ee-1c608d51daab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:55.475933 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 364/751] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:55.477256 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5266a-fbba-4b73-b7ee-1c608d51daab None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:55.512159 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06d392-72fe-4a75-a568-cf1e4a4b58dd None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:55.546126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0f06d-14cc-4722-a545-395f47324e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:55.546794 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0f06d-14cc-4722-a545-395f47324e27 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:55.547071 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0f06d-14cc-4722-a545-395f47324e27 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:55.547341 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0f06d-14cc-4722-a545-395f47324e27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:55.577888 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c5266a-fbba-4b73-b7ee-1c608d51daab None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:55.611041 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3aff2a-ad72-443d-94aa-366848cbe85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:55.611696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aff2a-ad72-443d-94aa-366848cbe85a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:55.612010 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aff2a-ad72-443d-94aa-366848cbe85a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:55.612283 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3aff2a-ad72-443d-94aa-366848cbe85a None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:55.612994 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3aff2a-ad72-443d-94aa-366848cbe85a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:55.613292 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3aff2a-ad72-443d-94aa-366848cbe85a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:55.614669 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3aff2a-ad72-443d-94aa-366848cbe85a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:55.615334 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0f06d-14cc-4722-a545-395f47324e27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:55.616776 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce0f06d-14cc-4722-a545-395f47324e27 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:55.631547 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 365/752] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:55.632826 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3aff2a-ad72-443d-94aa-366848cbe85a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:55.732253 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3aff2a-ad72-443d-94aa-366848cbe85a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:55.752835 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 388/753] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 16:37:55.758871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0f06d-14cc-4722-a545-395f47324e27 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:55.766601 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a134302-e7f2-4854-891e-22d49bbdcb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:55.767405 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a134302-e7f2-4854-891e-22d49bbdcb58 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:55.767682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a134302-e7f2-4854-891e-22d49bbdcb58 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:55.767953 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a134302-e7f2-4854-891e-22d49bbdcb58 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:55.775239 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a134302-e7f2-4854-891e-22d49bbdcb58 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:55.776744 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a134302-e7f2-4854-891e-22d49bbdcb58 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:55.790751 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-1a134302-e7f2-4854-891e-22d49bbdcb58 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 16:37:55.796527 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 366/754] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:37:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:55.797684 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a134302-e7f2-4854-891e-22d49bbdcb58 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:55.871000 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0f06d-14cc-4722-a545-395f47324e27 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:55.894548 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a134302-e7f2-4854-891e-22d49bbdcb58 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:55.905492 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a166f86-ab31-4cbb-851f-f389dd8c2253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:55.906283 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a166f86-ab31-4cbb-851f-f389dd8c2253 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:55.906557 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a166f86-ab31-4cbb-851f-f389dd8c2253 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:55.906856 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a166f86-ab31-4cbb-851f-f389dd8c2253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:55.917473 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a166f86-ab31-4cbb-851f-f389dd8c2253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:55.919022 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a166f86-ab31-4cbb-851f-f389dd8c2253 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:55.928880 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68f8fd-a15c-462f-8a4d-d30435a6c8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:55.929604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68f8fd-a15c-462f-8a4d-d30435a6c8ea None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:55.929880 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68f8fd-a15c-462f-8a4d-d30435a6c8ea None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:55.930153 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68f8fd-a15c-462f-8a4d-d30435a6c8ea None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:55.931003 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68f8fd-a15c-462f-8a4d-d30435a6c8ea None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:55.931308 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68f8fd-a15c-462f-8a4d-d30435a6c8ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:55.932721 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68f8fd-a15c-462f-8a4d-d30435a6c8ea None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:55.935782 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-4a166f86-ab31-4cbb-851f-f389dd8c2253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:55.942319 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 389/755] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:55.947995 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a166f86-ab31-4cbb-851f-f389dd8c2253 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:55.954692 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 367/756] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Apr 11 16:37:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:55.956359 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68f8fd-a15c-462f-8a4d-d30435a6c8ea None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:56.046520 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a166f86-ab31-4cbb-851f-f389dd8c2253 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:56.053450 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68f8fd-a15c-462f-8a4d-d30435a6c8ea None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:56.080046 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292211d2-7b6b-42fe-9c71-b68dbdbb6e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:56.080696 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292211d2-7b6b-42fe-9c71-b68dbdbb6e17 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:56.080973 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292211d2-7b6b-42fe-9c71-b68dbdbb6e17 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:56.081239 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292211d2-7b6b-42fe-9c71-b68dbdbb6e17 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:56.081936 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292211d2-7b6b-42fe-9c71-b68dbdbb6e17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:56.082231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292211d2-7b6b-42fe-9c71-b68dbdbb6e17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:56.083676 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292211d2-7b6b-42fe-9c71-b68dbdbb6e17 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:56.087929 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db80a6-fa18-4d85-876d-ceea35b04ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:56.088567 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db80a6-fa18-4d85-876d-ceea35b04ecd None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:56.088844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db80a6-fa18-4d85-876d-ceea35b04ecd None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:56.089115 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db80a6-fa18-4d85-876d-ceea35b04ecd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:56.095749 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 390/757] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:56.101148 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292211d2-7b6b-42fe-9c71-b68dbdbb6e17 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:56.156448 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db80a6-fa18-4d85-876d-ceea35b04ecd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:56.157899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db80a6-fa18-4d85-876d-ceea35b04ecd None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:56.203129 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292211d2-7b6b-42fe-9c71-b68dbdbb6e17 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:56.236533 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318a6db-2eb7-4d0b-9510-8754b1655eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:56.237319 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318a6db-2eb7-4d0b-9510-8754b1655eda None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:56.237597 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318a6db-2eb7-4d0b-9510-8754b1655eda None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:56.237864 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318a6db-2eb7-4d0b-9510-8754b1655eda None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:56.245389 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318a6db-2eb7-4d0b-9510-8754b1655eda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:56.246863 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318a6db-2eb7-4d0b-9510-8754b1655eda None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:56.261246 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-4318a6db-2eb7-4d0b-9510-8754b1655eda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:56.266806 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 391/759] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:56.268642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318a6db-2eb7-4d0b-9510-8754b1655eda None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:56.270392 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 368/759] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:55 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 16:37:56.271547 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db80a6-fa18-4d85-876d-ceea35b04ecd None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:56.370205 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db80a6-fa18-4d85-876d-ceea35b04ecd None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:56.370521 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318a6db-2eb7-4d0b-9510-8754b1655eda None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:56.404490 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d34dca-ab96-4ad7-8104-2c4affdbb04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:56.404829 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f777b9c-7ff9-45f1-9deb-a1b12880bf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:56.405141 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d34dca-ab96-4ad7-8104-2c4affdbb04d None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:56.405400 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f777b9c-7ff9-45f1-9deb-a1b12880bf91 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:56.405565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d34dca-ab96-4ad7-8104-2c4affdbb04d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:56.405726 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d34dca-ab96-4ad7-8104-2c4affdbb04d None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:56.405871 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f777b9c-7ff9-45f1-9deb-a1b12880bf91 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:56.406013 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f777b9c-7ff9-45f1-9deb-a1b12880bf91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:56.406579 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d34dca-ab96-4ad7-8104-2c4affdbb04d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:56.406760 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d34dca-ab96-4ad7-8104-2c4affdbb04d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:56.408169 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d34dca-ab96-4ad7-8104-2c4affdbb04d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:56.416819 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f777b9c-7ff9-45f1-9deb-a1b12880bf91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:56.418246 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f777b9c-7ff9-45f1-9deb-a1b12880bf91 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:56.420662 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 392/760] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:56.426465 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d34dca-ab96-4ad7-8104-2c4affdbb04d None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:56.435775 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-6f777b9c-7ff9-45f1-9deb-a1b12880bf91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:56.441672 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 369/761] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:56.442886 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f777b9c-7ff9-45f1-9deb-a1b12880bf91 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:56.548808 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f777b9c-7ff9-45f1-9deb-a1b12880bf91 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:56.578957 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d34dca-ab96-4ad7-8104-2c4affdbb04d None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:56.587437 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0bd33-a08d-420f-9b22-455c35666b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:56.588148 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0bd33-a08d-420f-9b22-455c35666b85 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:56.588424 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0bd33-a08d-420f-9b22-455c35666b85 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:56.588695 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0bd33-a08d-420f-9b22-455c35666b85 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:56.589443 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0bd33-a08d-420f-9b22-455c35666b85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:56.589743 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0bd33-a08d-420f-9b22-455c35666b85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:56.591132 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0bd33-a08d-420f-9b22-455c35666b85 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:56.612053 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 370/762] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:56.613295 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0bd33-a08d-420f-9b22-455c35666b85 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:56.643368 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df04a6-2044-4f27-8e8e-1e9c59e52fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:56.643946 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df04a6-2044-4f27-8e8e-1e9c59e52fd2 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:56.644226 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df04a6-2044-4f27-8e8e-1e9c59e52fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:56.644500 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38df04a6-2044-4f27-8e8e-1e9c59e52fd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:56.645320 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df04a6-2044-4f27-8e8e-1e9c59e52fd2 None admin] RBAC: Adding query filter params (role.id=16dc6f09d53447fd9e4a95fb1df71d9d, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=e0653575c0a24603bb9287e6222313de) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:56.645626 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df04a6-2044-4f27-8e8e-1e9c59e52fd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:56.647095 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38df04a6-2044-4f27-8e8e-1e9c59e52fd2 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:56.654769 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 393/763] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:37:56 2022] GET /identity/v3/role_assignments?user.id=e0653575c0a24603bb9287e6222313de&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=16dc6f09d53447fd9e4a95fb1df71d9d => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:56.739102 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0bd33-a08d-420f-9b22-455c35666b85 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:56.779702 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c062f-4856-412b-a58d-0a90784dede5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:56.780529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c062f-4856-412b-a58d-0a90784dede5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:56.780816 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c062f-4856-412b-a58d-0a90784dede5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:56.781095 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c062f-4856-412b-a58d-0a90784dede5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:56.790067 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c062f-4856-412b-a58d-0a90784dede5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:56.791224 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c062f-4856-412b-a58d-0a90784dede5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:56.809117 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-df0c062f-4856-412b-a58d-0a90784dede5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:37:56.814745 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 371/764] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:56.817357 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df04a6-2044-4f27-8e8e-1e9c59e52fd2 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:56.945902 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38df04a6-2044-4f27-8e8e-1e9c59e52fd2 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:56.990363 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062c5203-6a39-4e7c-9e19-19e84cd5aa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:56.991352 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c5203-6a39-4e7c-9e19-19e84cd5aa51 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:56.991837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c5203-6a39-4e7c-9e19-19e84cd5aa51 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:56.992260 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062c5203-6a39-4e7c-9e19-19e84cd5aa51 None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:56.993183 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c5203-6a39-4e7c-9e19-19e84cd5aa51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:56.993633 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c5203-6a39-4e7c-9e19-19e84cd5aa51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:56.995255 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062c5203-6a39-4e7c-9e19-19e84cd5aa51 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:57.010701 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 394/765] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:37:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:57.015203 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c062f-4856-412b-a58d-0a90784dede5 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:57.117777 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c062f-4856-412b-a58d-0a90784dede5 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:57.152991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092ba36-844c-45b2-9295-e484c50ee704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:57.153927 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092ba36-844c-45b2-9295-e484c50ee704 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:57.154364 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092ba36-844c-45b2-9295-e484c50ee704 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:57.154804 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092ba36-844c-45b2-9295-e484c50ee704 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:57.155769 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092ba36-844c-45b2-9295-e484c50ee704 None admin] RBAC: Adding query filter params (role.id=13de1ce875d44fcc988cc31b3a0639be, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=1f6659c6661840a79ba9ff1c3c9e93c6) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:57.156227 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092ba36-844c-45b2-9295-e484c50ee704 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:57.157825 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092ba36-844c-45b2-9295-e484c50ee704 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:57.170689 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 372/766] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:37:57 2022] GET /identity/v3/role_assignments?user.id=1f6659c6661840a79ba9ff1c3c9e93c6&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:57.197848 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0794f65-cedb-446b-a91a-5875861db266 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:57.198056 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0794f65-cedb-446b-a91a-5875861db266 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:57.198338 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0794f65-cedb-446b-a91a-5875861db266 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:57.200095 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 395/767] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:57.206054 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aac663-1636-4a55-83cb-62d6697b92a7 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:57.206555 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aac663-1636-4a55-83cb-62d6697b92a7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:57.207000 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aac663-1636-4a55-83cb-62d6697b92a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:57.224592 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-43aac663-1636-4a55-83cb-62d6697b92a7 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:57.226618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-43aac663-1636-4a55-83cb-62d6697b92a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:57.301543 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 373/768] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:37:57.362076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0794f65-cedb-446b-a91a-5875861db266 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:57.484361 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0794f65-cedb-446b-a91a-5875861db266 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:57.530024 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4388e5a-1d14-4f2e-b444-023f6420ff9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:57.530856 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388e5a-1d14-4f2e-b444-023f6420ff9d None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:57.531139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388e5a-1d14-4f2e-b444-023f6420ff9d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:57.531406 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4388e5a-1d14-4f2e-b444-023f6420ff9d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:57.532051 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4388e5a-1d14-4f2e-b444-023f6420ff9d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:57.533407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4388e5a-1d14-4f2e-b444-023f6420ff9d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:57.549942 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-e4388e5a-1d14-4f2e-b444-023f6420ff9d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 11 16:37:57.551476 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 396/769] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Apr 11 16:37:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:57.557431 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aac663-1636-4a55-83cb-62d6697b92a7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:57.734223 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aac663-1636-4a55-83cb-62d6697b92a7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:57.777722 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a083c6-8769-47dc-b55f-0e2d45579b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:57.778398 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a083c6-8769-47dc-b55f-0e2d45579b31 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:57.778707 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a083c6-8769-47dc-b55f-0e2d45579b31 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:57.779034 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a083c6-8769-47dc-b55f-0e2d45579b31 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:57.779750 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a083c6-8769-47dc-b55f-0e2d45579b31 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:57.780056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a083c6-8769-47dc-b55f-0e2d45579b31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:57.781413 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a083c6-8769-47dc-b55f-0e2d45579b31 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:57.790833 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 374/770] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Apr 11 16:37:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:57.795901 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4388e5a-1d14-4f2e-b444-023f6420ff9d None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:57.924476 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4388e5a-1d14-4f2e-b444-023f6420ff9d None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:57.963286 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6c76f3-222d-472e-bcb3-1691585888da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:57.963955 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c76f3-222d-472e-bcb3-1691585888da None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:57.964236 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c76f3-222d-472e-bcb3-1691585888da None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:57.964510 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c76f3-222d-472e-bcb3-1691585888da None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:57.965209 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c76f3-222d-472e-bcb3-1691585888da None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:57.965509 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c76f3-222d-472e-bcb3-1691585888da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:57.966948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6c76f3-222d-472e-bcb3-1691585888da None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:57.974766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 397/771] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Apr 11 16:37:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:57.983198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a083c6-8769-47dc-b55f-0e2d45579b31 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:58.062136 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37d6df-db98-4208-8b7f-6a8e3be4091f None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:58.062321 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37d6df-db98-4208-8b7f-6a8e3be4091f None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:58.062625 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b37d6df-db98-4208-8b7f-6a8e3be4091f None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:58.064215 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 398/772] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:58.069128 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095b42d-d5b1-4789-8686-a51793371345 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:58.069411 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095b42d-d5b1-4789-8686-a51793371345 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:58.069680 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095b42d-d5b1-4789-8686-a51793371345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:58.087416 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-3095b42d-d5b1-4789-8686-a51793371345 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:58.088595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3095b42d-d5b1-4789-8686-a51793371345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:58.167344 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a083c6-8769-47dc-b55f-0e2d45579b31 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:58.183091 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 399/773] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:37:58.187797 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857e059-6565-443e-bd8d-1b4b2565e55d None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:58.188334 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857e059-6565-443e-bd8d-1b4b2565e55d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:58.188808 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857e059-6565-443e-bd8d-1b4b2565e55d None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:58.195672 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 400/774] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:58.200215 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622e837-eed7-492f-86ed-55bf2363c296 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:58.201266 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622e837-eed7-492f-86ed-55bf2363c296 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:58.201757 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622e837-eed7-492f-86ed-55bf2363c296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:58.217220 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3df05e-a3f7-4166-a194-18d37f5d02bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:58.218225 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3df05e-a3f7-4166-a194-18d37f5d02bf None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:58.218754 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3df05e-a3f7-4166-a194-18d37f5d02bf None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:58.219284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3df05e-a3f7-4166-a194-18d37f5d02bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:58.220271 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3df05e-a3f7-4166-a194-18d37f5d02bf None admin] RBAC: Adding query filter params (interface=public, service_id=8432ad6ac19f4274b4f756471d7e85a8, region_id=RegionOne) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:58.220783 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3df05e-a3f7-4166-a194-18d37f5d02bf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:58.222340 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3df05e-a3f7-4166-a194-18d37f5d02bf None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:58.231789 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 375/775] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Apr 11 16:37:57 2022] GET /identity/v3/endpoints?service_id=8432ad6ac19f4274b4f756471d7e85a8&interface=public®ion_id=RegionOne => generated 194 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:58.231991 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-5622e837-eed7-492f-86ed-55bf2363c296 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:58.233015 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3df05e-a3f7-4166-a194-18d37f5d02bf None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:58.233123 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-5622e837-eed7-492f-86ed-55bf2363c296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:58.317603 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 401/776] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:37:58.318382 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622e837-eed7-492f-86ed-55bf2363c296 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:58.356292 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3df05e-a3f7-4166-a194-18d37f5d02bf None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:58.392177 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0edb8-797b-41da-8aac-dbcb2a7ec83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:58.392965 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0edb8-797b-41da-8aac-dbcb2a7ec83c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:58.393245 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0edb8-797b-41da-8aac-dbcb2a7ec83c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:58.393520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0edb8-797b-41da-8aac-dbcb2a7ec83c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:58.404233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0edb8-797b-41da-8aac-dbcb2a7ec83c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:37:58.411095 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-add0edb8-797b-41da-8aac-dbcb2a7ec83c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:37:58.412571 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 376/777] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:37:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:58.413345 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0edb8-797b-41da-8aac-dbcb2a7ec83c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:58.423008 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622e837-eed7-492f-86ed-55bf2363c296 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:58.467880 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e2423-09cb-4c3e-8716-81fe73cd8651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:58.468551 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e2423-09cb-4c3e-8716-81fe73cd8651 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:58.468830 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e2423-09cb-4c3e-8716-81fe73cd8651 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:58.469106 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3e2423-09cb-4c3e-8716-81fe73cd8651 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:58.469785 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e2423-09cb-4c3e-8716-81fe73cd8651 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:58.471927 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3e2423-09cb-4c3e-8716-81fe73cd8651 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:58.478984 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 402/778] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Apr 11 16:37:58 2022] GET /identity/v3/services => generated 772 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:58.480123 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e2423-09cb-4c3e-8716-81fe73cd8651 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:58.562480 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0edb8-797b-41da-8aac-dbcb2a7ec83c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:58.599528 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3e2423-09cb-4c3e-8716-81fe73cd8651 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:58.640094 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653ced3-7b4f-45a8-92e1-9c35a66e766d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:58.640869 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653ced3-7b4f-45a8-92e1-9c35a66e766d None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:58.641149 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653ced3-7b4f-45a8-92e1-9c35a66e766d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:58.641425 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3653ced3-7b4f-45a8-92e1-9c35a66e766d None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:58.642263 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653ced3-7b4f-45a8-92e1-9c35a66e766d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:58.642571 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653ced3-7b4f-45a8-92e1-9c35a66e766d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:58.643983 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3653ced3-7b4f-45a8-92e1-9c35a66e766d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:58.645280 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16c229-3bdd-49bc-b4b8-93aa5bf63d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:58.646143 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16c229-3bdd-49bc-b4b8-93aa5bf63d29 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:58.646421 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16c229-3bdd-49bc-b4b8-93aa5bf63d29 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:58.646710 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a16c229-3bdd-49bc-b4b8-93aa5bf63d29 None admin] PATH_INFO: `/v3/services/network` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:58.647368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16c229-3bdd-49bc-b4b8-93aa5bf63d29 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:58.648783 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a16c229-3bdd-49bc-b4b8-93aa5bf63d29 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:58.653467 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 403/779] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:37:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:58.662345 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653ced3-7b4f-45a8-92e1-9c35a66e766d None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:58.670815 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-3a16c229-3bdd-49bc-b4b8-93aa5bf63d29 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 11 16:37:58.672284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 377/780] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:37:58 2022] GET /identity/v3/services/network => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:58.683108 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16c229-3bdd-49bc-b4b8-93aa5bf63d29 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:58.780283 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3653ced3-7b4f-45a8-92e1-9c35a66e766d None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:58.817138 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e20363-f904-478c-ac43-df99f0d54f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:58.818273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e20363-f904-478c-ac43-df99f0d54f81 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:58.820380 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e20363-f904-478c-ac43-df99f0d54f81 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:58.820671 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e20363-f904-478c-ac43-df99f0d54f81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:58.838850 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e20363-f904-478c-ac43-df99f0d54f81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:58.840612 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e20363-f904-478c-ac43-df99f0d54f81 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:58.856604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a16c229-3bdd-49bc-b4b8-93aa5bf63d29 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:58.861214 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-c1e20363-f904-478c-ac43-df99f0d54f81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:37:58.862766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 404/781] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:37:58.869092 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e20363-f904-478c-ac43-df99f0d54f81 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:58.895747 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cd25c-4455-4acb-9ce4-c6b386e6d262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:58.896405 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cd25c-4455-4acb-9ce4-c6b386e6d262 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:58.896740 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cd25c-4455-4acb-9ce4-c6b386e6d262 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:58.897009 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900cd25c-4455-4acb-9ce4-c6b386e6d262 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:58.897754 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cd25c-4455-4acb-9ce4-c6b386e6d262 None admin] RBAC: Adding query filter params (name=network) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:58.898617 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cd25c-4455-4acb-9ce4-c6b386e6d262 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:58.900006 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900cd25c-4455-4acb-9ce4-c6b386e6d262 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:58.907499 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 378/782] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Apr 11 16:37:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:58.913248 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cd25c-4455-4acb-9ce4-c6b386e6d262 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:59.036444 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e20363-f904-478c-ac43-df99f0d54f81 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:59.101561 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2847046-f962-43d6-bad9-ac78735a4810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:59.102218 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2847046-f962-43d6-bad9-ac78735a4810 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:59.102494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2847046-f962-43d6-bad9-ac78735a4810 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:59.102785 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2847046-f962-43d6-bad9-ac78735a4810 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:59.103496 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2847046-f962-43d6-bad9-ac78735a4810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:59.103793 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2847046-f962-43d6-bad9-ac78735a4810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:59.105273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2847046-f962-43d6-bad9-ac78735a4810 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:59.105390 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900cd25c-4455-4acb-9ce4-c6b386e6d262 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:59.118093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 405/783] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:59.123440 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2847046-f962-43d6-bad9-ac78735a4810 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:59.180395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42289684-3221-473f-9368-fd9b8b0f9026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:59.181064 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42289684-3221-473f-9368-fd9b8b0f9026 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:59.181342 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42289684-3221-473f-9368-fd9b8b0f9026 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:59.181615 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42289684-3221-473f-9368-fd9b8b0f9026 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:59.182319 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42289684-3221-473f-9368-fd9b8b0f9026 None admin] RBAC: Adding query filter params (type=network) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:59.182638 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42289684-3221-473f-9368-fd9b8b0f9026 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:59.183997 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42289684-3221-473f-9368-fd9b8b0f9026 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:59.197048 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 379/784] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Apr 11 16:37:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:59.202767 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42289684-3221-473f-9368-fd9b8b0f9026 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:59.221748 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2847046-f962-43d6-bad9-ac78735a4810 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:59.256163 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ce3df-e0d5-4d85-8ee9-395df37389ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:59.256946 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ce3df-e0d5-4d85-8ee9-395df37389ff None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:59.257324 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ce3df-e0d5-4d85-8ee9-395df37389ff None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:59.257598 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ce3df-e0d5-4d85-8ee9-395df37389ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:59.265252 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ce3df-e0d5-4d85-8ee9-395df37389ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:59.266725 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ce3df-e0d5-4d85-8ee9-395df37389ff None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:59.281978 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-c68ce3df-e0d5-4d85-8ee9-395df37389ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 16:37:59.283527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 406/785] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Apr 11 16:37:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:37:59.288926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ce3df-e0d5-4d85-8ee9-395df37389ff None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:59.386547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ce3df-e0d5-4d85-8ee9-395df37389ff None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:59.423266 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0076c685-4978-4a2b-9fc1-fe575f00b8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:59.424694 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076c685-4978-4a2b-9fc1-fe575f00b8ff None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:59.425201 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076c685-4978-4a2b-9fc1-fe575f00b8ff None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:59.425684 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0076c685-4978-4a2b-9fc1-fe575f00b8ff None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:59.426771 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076c685-4978-4a2b-9fc1-fe575f00b8ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:59.427289 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076c685-4978-4a2b-9fc1-fe575f00b8ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:59.428890 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0076c685-4978-4a2b-9fc1-fe575f00b8ff None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:59.434226 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42289684-3221-473f-9368-fd9b8b0f9026 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:59.447950 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 407/786] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Apr 11 16:37:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:37:59.453866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9a3db-2afe-43a4-9b78-33d91c8a4680 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:59.454452 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9a3db-2afe-43a4-9b78-33d91c8a4680 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:59.454964 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e9a3db-2afe-43a4-9b78-33d91c8a4680 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:59.456724 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 408/787] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:37:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:37:59.457631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9a3db-2afe-43a4-9b78-33d91c8a4680 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:59.474134 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea98d0c-e3ba-4796-ba38-13d9dc023a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:59.475510 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea98d0c-e3ba-4796-ba38-13d9dc023a4e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:59.476830 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea98d0c-e3ba-4796-ba38-13d9dc023a4e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:59.477300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea98d0c-e3ba-4796-ba38-13d9dc023a4e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:59.478434 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea98d0c-e3ba-4796-ba38-13d9dc023a4e None admin] RBAC: Adding query filter params (interface=public, service_id=3555a55e4e12468d9df08a331b98ada0, region_id=RegionOne) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:37:59.479320 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea98d0c-e3ba-4796-ba38-13d9dc023a4e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:59.481321 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea98d0c-e3ba-4796-ba38-13d9dc023a4e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:59.487918 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 380/788] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Apr 11 16:37:59 2022] GET /identity/v3/endpoints?service_id=3555a55e4e12468d9df08a331b98ada0&interface=public®ion_id=RegionOne => generated 194 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:59.490223 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a4cdc-c610-4566-b984-d98fd3fad392 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:59.490724 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a4cdc-c610-4566-b984-d98fd3fad392 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:59.491300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a4cdc-c610-4566-b984-d98fd3fad392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:59.512889 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-354a4cdc-c610-4566-b984-d98fd3fad392 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:37:59.514966 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-354a4cdc-c610-4566-b984-d98fd3fad392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:37:59.587425 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e9a3db-2afe-43a4-9b78-33d91c8a4680 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:59.598612 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 381/789] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:37:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:37:59.600091 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a4cdc-c610-4566-b984-d98fd3fad392 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:59.626002 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f361e-7875-4e79-a50c-8ac9180b76c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:59.626870 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f361e-7875-4e79-a50c-8ac9180b76c1 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:59.627544 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f361e-7875-4e79-a50c-8ac9180b76c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:59.628001 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1f361e-7875-4e79-a50c-8ac9180b76c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:59.716942 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a4cdc-c610-4566-b984-d98fd3fad392 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:59.717722 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f361e-7875-4e79-a50c-8ac9180b76c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:59.720281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1f361e-7875-4e79-a50c-8ac9180b76c1 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:59.753116 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdd6ec-a570-4dcf-a9fa-b18c4ece8ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:59.754202 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdd6ec-a570-4dcf-a9fa-b18c4ece8ec3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:59.754604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdd6ec-a570-4dcf-a9fa-b18c4ece8ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:59.754988 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abdd6ec-a570-4dcf-a9fa-b18c4ece8ec3 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:59.755937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdd6ec-a570-4dcf-a9fa-b18c4ece8ec3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:37:59.758533 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abdd6ec-a570-4dcf-a9fa-b18c4ece8ec3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:37:59.765218 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 382/790] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Apr 11 16:37:59 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:37:59.766568 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdd6ec-a570-4dcf-a9fa-b18c4ece8ec3 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:59.827443 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 409/791] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:37:59 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:37:59.833376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f361e-7875-4e79-a50c-8ac9180b76c1 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:37:59.895750 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abdd6ec-a570-4dcf-a9fa-b18c4ece8ec3 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:59.959672 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1f361e-7875-4e79-a50c-8ac9180b76c1 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:37:59.963361 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458323cb-84b9-486f-a9b7-f6cb55937c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:37:59.964180 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458323cb-84b9-486f-a9b7-f6cb55937c9c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:37:59.964459 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458323cb-84b9-486f-a9b7-f6cb55937c9c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:37:59.964726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458323cb-84b9-486f-a9b7-f6cb55937c9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:37:59.991679 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458323cb-84b9-486f-a9b7-f6cb55937c9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:38:00.000852 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-458323cb-84b9-486f-a9b7-f6cb55937c9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:38:00.002836 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 383/792] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:37:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:00.004395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba3430-91e1-4d47-a1ee-cdbe476003df None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:00.004930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba3430-91e1-4d47-a1ee-cdbe476003df None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:00.005406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba3430-91e1-4d47-a1ee-cdbe476003df None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:00.007487 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 384/793] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:00.010981 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba3430-91e1-4d47-a1ee-cdbe476003df None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:00.022065 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef51e97-0bd5-47a4-9235-4c9336498330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:00.023453 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef51e97-0bd5-47a4-9235-4c9336498330 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:00.023728 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef51e97-0bd5-47a4-9235-4c9336498330 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:00.023996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef51e97-0bd5-47a4-9235-4c9336498330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:00.035616 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef51e97-0bd5-47a4-9235-4c9336498330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:00.037080 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef51e97-0bd5-47a4-9235-4c9336498330 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:00.055281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-5ef51e97-0bd5-47a4-9235-4c9336498330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:00.061124 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 410/794] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:00.062408 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf7457-65c3-462e-bf1c-102231fccf8a None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:00.062716 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf7457-65c3-462e-bf1c-102231fccf8a None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:00.063340 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf7457-65c3-462e-bf1c-102231fccf8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:00.080098 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-36cf7457-65c3-462e-bf1c-102231fccf8a None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:00.081275 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-36cf7457-65c3-462e-bf1c-102231fccf8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:00.128221 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba3430-91e1-4d47-a1ee-cdbe476003df None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:00.150853 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 411/795] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:00.151546 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf7457-65c3-462e-bf1c-102231fccf8a None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:00.169580 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025e532-6a25-44d5-9844-ed300d8cec81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:00.170628 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025e532-6a25-44d5-9844-ed300d8cec81 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:00.171131 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025e532-6a25-44d5-9844-ed300d8cec81 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:00.171701 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4025e532-6a25-44d5-9844-ed300d8cec81 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:00.173046 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025e532-6a25-44d5-9844-ed300d8cec81 None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:00.173562 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025e532-6a25-44d5-9844-ed300d8cec81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:00.175564 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4025e532-6a25-44d5-9844-ed300d8cec81 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:00.185721 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 385/796] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:38:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:00.189826 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025e532-6a25-44d5-9844-ed300d8cec81 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:00.286524 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf7457-65c3-462e-bf1c-102231fccf8a None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:00.304995 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4025e532-6a25-44d5-9844-ed300d8cec81 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:00.322084 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398e0a5-aa69-4beb-9e9f-4e9d18003649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:00.323002 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398e0a5-aa69-4beb-9e9f-4e9d18003649 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:00.323114 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398e0a5-aa69-4beb-9e9f-4e9d18003649 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:00.323356 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398e0a5-aa69-4beb-9e9f-4e9d18003649 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:00.324110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398e0a5-aa69-4beb-9e9f-4e9d18003649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:00.324420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398e0a5-aa69-4beb-9e9f-4e9d18003649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:00.325770 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398e0a5-aa69-4beb-9e9f-4e9d18003649 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:00.343089 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 412/797] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:00.343990 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398e0a5-aa69-4beb-9e9f-4e9d18003649 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:00.346672 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a3c0b-fdb1-4e26-8e93-8dcca482bdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:00.348665 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a3c0b-fdb1-4e26-8e93-8dcca482bdbe None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:00.349189 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a3c0b-fdb1-4e26-8e93-8dcca482bdbe None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:00.349676 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a3c0b-fdb1-4e26-8e93-8dcca482bdbe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:00.367045 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1a3c0b-fdb1-4e26-8e93-8dcca482bdbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:38:00.370937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-4a1a3c0b-fdb1-4e26-8e93-8dcca482bdbe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:38:00.377098 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 386/798] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:38:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:00.378029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a3c0b-fdb1-4e26-8e93-8dcca482bdbe None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:00.444075 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398e0a5-aa69-4beb-9e9f-4e9d18003649 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:00.478088 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b058e8-61e4-4180-a737-a8abeafe89c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:00.479656 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b058e8-61e4-4180-a737-a8abeafe89c5 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:00.480247 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b058e8-61e4-4180-a737-a8abeafe89c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:00.480774 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b058e8-61e4-4180-a737-a8abeafe89c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:00.494403 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b058e8-61e4-4180-a737-a8abeafe89c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:00.496747 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b058e8-61e4-4180-a737-a8abeafe89c5 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:00.498304 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a3c0b-fdb1-4e26-8e93-8dcca482bdbe None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:00.513977 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-a4b058e8-61e4-4180-a737-a8abeafe89c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:00.516055 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 413/799] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:00.516967 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b058e8-61e4-4180-a737-a8abeafe89c5 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:00.546499 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8c9ca-1dd1-4f56-9808-f8ec1867c508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:00.547533 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8c9ca-1dd1-4f56-9808-f8ec1867c508 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:00.547815 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8c9ca-1dd1-4f56-9808-f8ec1867c508 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:00.548084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8c9ca-1dd1-4f56-9808-f8ec1867c508 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:00.556878 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8c9ca-1dd1-4f56-9808-f8ec1867c508 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:00.558804 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b8c9ca-1dd1-4f56-9808-f8ec1867c508 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:00.576744 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-d7b8c9ca-1dd1-4f56-9808-f8ec1867c508 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:38:00.582858 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 387/800] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:38:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:00.583821 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8c9ca-1dd1-4f56-9808-f8ec1867c508 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:00.617142 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b058e8-61e4-4180-a737-a8abeafe89c5 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:00.651023 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d7373-04f1-4a7a-a3b2-07b88ca60707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:00.651916 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d7373-04f1-4a7a-a3b2-07b88ca60707 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:00.652337 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d7373-04f1-4a7a-a3b2-07b88ca60707 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:00.652773 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691d7373-04f1-4a7a-a3b2-07b88ca60707 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:00.653643 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d7373-04f1-4a7a-a3b2-07b88ca60707 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:00.654081 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d7373-04f1-4a7a-a3b2-07b88ca60707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:00.655604 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691d7373-04f1-4a7a-a3b2-07b88ca60707 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:00.664271 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 414/801] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:38:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:00.665361 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d7373-04f1-4a7a-a3b2-07b88ca60707 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:00.684889 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8c9ca-1dd1-4f56-9808-f8ec1867c508 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:00.719513 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa035df-06ba-41d5-a0fe-9a367e04f7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:00.720078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa035df-06ba-41d5-a0fe-9a367e04f7c6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:00.720352 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa035df-06ba-41d5-a0fe-9a367e04f7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:00.720621 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa035df-06ba-41d5-a0fe-9a367e04f7c6 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:00.721337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa035df-06ba-41d5-a0fe-9a367e04f7c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:00.721638 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa035df-06ba-41d5-a0fe-9a367e04f7c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:00.723166 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa035df-06ba-41d5-a0fe-9a367e04f7c6 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:00.739530 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 388/802] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:00.740421 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa035df-06ba-41d5-a0fe-9a367e04f7c6 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:00.767444 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691d7373-04f1-4a7a-a3b2-07b88ca60707 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:00.807000 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dadd51-3580-42e2-bc59-74a13b92cde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:00.807979 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dadd51-3580-42e2-bc59-74a13b92cde8 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:00.808451 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dadd51-3580-42e2-bc59-74a13b92cde8 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:00.808947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dadd51-3580-42e2-bc59-74a13b92cde8 None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:00.809922 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dadd51-3580-42e2-bc59-74a13b92cde8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:00.810421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dadd51-3580-42e2-bc59-74a13b92cde8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:00.812068 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dadd51-3580-42e2-bc59-74a13b92cde8 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:00.825056 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 415/803] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:38:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:00.826233 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dadd51-3580-42e2-bc59-74a13b92cde8 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:00.849340 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa035df-06ba-41d5-a0fe-9a367e04f7c6 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:00.884492 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05107efa-a612-4c3e-8ad0-ea7107659194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:00.885463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05107efa-a612-4c3e-8ad0-ea7107659194 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:00.885745 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05107efa-a612-4c3e-8ad0-ea7107659194 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:00.886014 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05107efa-a612-4c3e-8ad0-ea7107659194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:00.901347 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05107efa-a612-4c3e-8ad0-ea7107659194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:00.902844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05107efa-a612-4c3e-8ad0-ea7107659194 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:00.922244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-05107efa-a612-4c3e-8ad0-ea7107659194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:00.923798 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 389/804] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:00.924651 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05107efa-a612-4c3e-8ad0-ea7107659194 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:00.932787 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dadd51-3580-42e2-bc59-74a13b92cde8 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:00.967740 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8f9a1-92f6-413e-9d7f-0fec42d0eed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:00.968914 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8f9a1-92f6-413e-9d7f-0fec42d0eed9 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:00.969410 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8f9a1-92f6-413e-9d7f-0fec42d0eed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:00.969873 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af8f9a1-92f6-413e-9d7f-0fec42d0eed9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:00.977832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8f9a1-92f6-413e-9d7f-0fec42d0eed9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:00.979537 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af8f9a1-92f6-413e-9d7f-0fec42d0eed9 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:00.993887 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-6af8f9a1-92f6-413e-9d7f-0fec42d0eed9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 16:38:00.995668 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 416/805] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Apr 11 16:38:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:00.996638 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8f9a1-92f6-413e-9d7f-0fec42d0eed9 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:01.029371 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05107efa-a612-4c3e-8ad0-ea7107659194 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:01.065698 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d031ed3-45ae-4348-9e07-c5d49bc6d4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:01.066278 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d031ed3-45ae-4348-9e07-c5d49bc6d4bd None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:01.066557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d031ed3-45ae-4348-9e07-c5d49bc6d4bd None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:01.066854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d031ed3-45ae-4348-9e07-c5d49bc6d4bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:01.067839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d031ed3-45ae-4348-9e07-c5d49bc6d4bd None admin] RBAC: Adding query filter params (role.id=13de1ce875d44fcc988cc31b3a0639be, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=ba3665d046864985916fdd6c4a4edcd1) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:01.068155 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d031ed3-45ae-4348-9e07-c5d49bc6d4bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:01.070979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d031ed3-45ae-4348-9e07-c5d49bc6d4bd None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:01.078741 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 390/806] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:38:00 2022] GET /identity/v3/role_assignments?user.id=ba3665d046864985916fdd6c4a4edcd1&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:01.079909 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d031ed3-45ae-4348-9e07-c5d49bc6d4bd None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:01.123002 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af8f9a1-92f6-413e-9d7f-0fec42d0eed9 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:01.187404 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a2e0b-ac34-4a08-9071-310197880a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:01.188115 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a2e0b-ac34-4a08-9071-310197880a88 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:01.188399 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a2e0b-ac34-4a08-9071-310197880a88 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:01.188740 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a2e0b-ac34-4a08-9071-310197880a88 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:01.189476 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a2e0b-ac34-4a08-9071-310197880a88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:01.189783 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a2e0b-ac34-4a08-9071-310197880a88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:01.191235 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a2e0b-ac34-4a08-9071-310197880a88 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:01.205469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 417/807] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:01.205469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699b1f-32a9-48aa-bed0-d31ff8f28686 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:01.205469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699b1f-32a9-48aa-bed0-d31ff8f28686 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:01.205469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33699b1f-32a9-48aa-bed0-d31ff8f28686 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:01.205469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 418/808] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:01.215558 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699b1f-32a9-48aa-bed0-d31ff8f28686 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:01.244695 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d031ed3-45ae-4348-9e07-c5d49bc6d4bd None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:01.281392 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27feb46c-e912-4c08-805b-65fe54380a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:01.282412 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb46c-e912-4c08-805b-65fe54380a7a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:01.282919 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb46c-e912-4c08-805b-65fe54380a7a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:01.283391 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27feb46c-e912-4c08-805b-65fe54380a7a None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:01.284422 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27feb46c-e912-4c08-805b-65fe54380a7a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:01.284911 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27feb46c-e912-4c08-805b-65fe54380a7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:01.286517 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27feb46c-e912-4c08-805b-65fe54380a7a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:01.307419 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 391/809] 10.222.0.73 () {56 vars in 1149 bytes} [Mon Apr 11 16:38:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:01.308500 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d1f9b-7206-420a-be28-59a2887b153c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:01.308781 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d1f9b-7206-420a-be28-59a2887b153c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:01.309051 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51d1f9b-7206-420a-be28-59a2887b153c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:01.326148 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b51d1f9b-7206-420a-be28-59a2887b153c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:01.327276 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b51d1f9b-7206-420a-be28-59a2887b153c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:01.329001 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33699b1f-32a9-48aa-bed0-d31ff8f28686 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:01.372332 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b496a-97e0-4092-b1a6-fb200bcab27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:01.373131 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b496a-97e0-4092-b1a6-fb200bcab27a None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:01.373414 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b496a-97e0-4092-b1a6-fb200bcab27a None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:01.373689 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501b496a-97e0-4092-b1a6-fb200bcab27a None admin] PATH_INFO: `/v3/users/swift` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:01.383196 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b496a-97e0-4092-b1a6-fb200bcab27a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:01.384700 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501b496a-97e0-4092-b1a6-fb200bcab27a None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:01.401734 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-501b496a-97e0-4092-b1a6-fb200bcab27a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 16:38:01.403280 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 419/810] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:38:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:01.404061 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b496a-97e0-4092-b1a6-fb200bcab27a None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:01.411538 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 392/811] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:01.413047 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d1f9b-7206-420a-be28-59a2887b153c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:01.526986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501b496a-97e0-4092-b1a6-fb200bcab27a None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:01.531714 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51d1f9b-7206-420a-be28-59a2887b153c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:01.560830 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37f913-2c13-4924-b825-3d08bae650fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:01.561809 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37f913-2c13-4924-b825-3d08bae650fa None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:01.561918 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37f913-2c13-4924-b825-3d08bae650fa None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:01.562170 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37f913-2c13-4924-b825-3d08bae650fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:01.572433 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37f913-2c13-4924-b825-3d08bae650fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:01.573972 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37f913-2c13-4924-b825-3d08bae650fa None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:01.574734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106abf7-a0e5-4da6-810d-0bafb6bad8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:01.575827 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106abf7-a0e5-4da6-810d-0bafb6bad8b9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:01.576661 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106abf7-a0e5-4da6-810d-0bafb6bad8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:01.577132 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106abf7-a0e5-4da6-810d-0bafb6bad8b9 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:01.578176 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106abf7-a0e5-4da6-810d-0bafb6bad8b9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:01.578706 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106abf7-a0e5-4da6-810d-0bafb6bad8b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:01.580315 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106abf7-a0e5-4da6-810d-0bafb6bad8b9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:01.590903 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-4c37f913-2c13-4924-b825-3d08bae650fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:01.592432 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 420/812] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:01.593365 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37f913-2c13-4924-b825-3d08bae650fa None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:01.600740 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 393/813] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Apr 11 16:38:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:01.601867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106abf7-a0e5-4da6-810d-0bafb6bad8b9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:01.693099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37f913-2c13-4924-b825-3d08bae650fa None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:01.725165 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106abf7-a0e5-4da6-810d-0bafb6bad8b9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:01.732286 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473dfb9-54ae-48ae-8c47-6cb0101c9055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:01.733348 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473dfb9-54ae-48ae-8c47-6cb0101c9055 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:01.734174 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473dfb9-54ae-48ae-8c47-6cb0101c9055 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:01.734650 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473dfb9-54ae-48ae-8c47-6cb0101c9055 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:01.735478 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473dfb9-54ae-48ae-8c47-6cb0101c9055 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:01.737682 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473dfb9-54ae-48ae-8c47-6cb0101c9055 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:01.752456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-7473dfb9-54ae-48ae-8c47-6cb0101c9055 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 11 16:38:01.754506 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 421/814] 10.222.0.73 () {56 vars in 1129 bytes} [Mon Apr 11 16:38:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:01.755513 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473dfb9-54ae-48ae-8c47-6cb0101c9055 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:01.765658 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc4f18-e48b-48bc-89e0-af32424fcc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:01.766563 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc4f18-e48b-48bc-89e0-af32424fcc4b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:01.767043 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc4f18-e48b-48bc-89e0-af32424fcc4b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:01.767487 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc4f18-e48b-48bc-89e0-af32424fcc4b None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:01.768366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc4f18-e48b-48bc-89e0-af32424fcc4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:01.769249 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc4f18-e48b-48bc-89e0-af32424fcc4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:01.770815 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc4f18-e48b-48bc-89e0-af32424fcc4b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:01.786128 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 394/815] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:01.787322 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc4f18-e48b-48bc-89e0-af32424fcc4b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:01.858271 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473dfb9-54ae-48ae-8c47-6cb0101c9055 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:01.897219 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44630693-3be6-4c80-b089-e13f1aee5f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:01.898206 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44630693-3be6-4c80-b089-e13f1aee5f05 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:01.898552 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44630693-3be6-4c80-b089-e13f1aee5f05 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:01.898932 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44630693-3be6-4c80-b089-e13f1aee5f05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:01.910013 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44630693-3be6-4c80-b089-e13f1aee5f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:01.910771 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc4f18-e48b-48bc-89e0-af32424fcc4b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:01.911661 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44630693-3be6-4c80-b089-e13f1aee5f05 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:01.929247 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-44630693-3be6-4c80-b089-e13f1aee5f05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:01.930875 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 422/816] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:01.931820 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44630693-3be6-4c80-b089-e13f1aee5f05 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:01.948932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fce87-5377-46cb-a363-331b1778d815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:01.949899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fce87-5377-46cb-a363-331b1778d815 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:01.950353 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fce87-5377-46cb-a363-331b1778d815 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:01.950827 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0fce87-5377-46cb-a363-331b1778d815 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:01.951692 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fce87-5377-46cb-a363-331b1778d815 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:01.952165 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fce87-5377-46cb-a363-331b1778d815 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:01.954215 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0fce87-5377-46cb-a363-331b1778d815 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:01.959319 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 395/817] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Apr 11 16:38:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:01.960816 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fce87-5377-46cb-a363-331b1778d815 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:02.039241 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44630693-3be6-4c80-b089-e13f1aee5f05 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:02.058741 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0fce87-5377-46cb-a363-331b1778d815 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:02.072838 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac34a49-274f-4b0a-82c8-21aa842b6db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:02.073714 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac34a49-274f-4b0a-82c8-21aa842b6db0 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:02.073994 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac34a49-274f-4b0a-82c8-21aa842b6db0 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:02.074269 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac34a49-274f-4b0a-82c8-21aa842b6db0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:02.081288 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac34a49-274f-4b0a-82c8-21aa842b6db0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:02.082758 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac34a49-274f-4b0a-82c8-21aa842b6db0 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:02.094369 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bc6db-ef94-4602-974b-dd61be70d7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:02.095316 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bc6db-ef94-4602-974b-dd61be70d7f8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:02.095793 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bc6db-ef94-4602-974b-dd61be70d7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:02.096286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bc6db-ef94-4602-974b-dd61be70d7f8 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:02.097189 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bc6db-ef94-4602-974b-dd61be70d7f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:02.097557 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-7ac34a49-274f-4b0a-82c8-21aa842b6db0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:38:02.097905 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bc6db-ef94-4602-974b-dd61be70d7f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:02.099139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 423/818] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:38:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:02.099681 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bc6db-ef94-4602-974b-dd61be70d7f8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:02.099933 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac34a49-274f-4b0a-82c8-21aa842b6db0 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:02.112681 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 396/819] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:02.113804 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bc6db-ef94-4602-974b-dd61be70d7f8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:02.200240 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac34a49-274f-4b0a-82c8-21aa842b6db0 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:02.210876 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bc6db-ef94-4602-974b-dd61be70d7f8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:02.235642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadf178-adc7-4e71-9a63-64af323dc51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:02.236318 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadf178-adc7-4e71-9a63-64af323dc51f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:02.236600 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadf178-adc7-4e71-9a63-64af323dc51f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:02.236875 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadf178-adc7-4e71-9a63-64af323dc51f None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:02.237587 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadf178-adc7-4e71-9a63-64af323dc51f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:02.237883 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadf178-adc7-4e71-9a63-64af323dc51f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:02.239270 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadf178-adc7-4e71-9a63-64af323dc51f None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:02.245516 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 424/820] 10.222.0.73 () {56 vars in 1124 bytes} [Mon Apr 11 16:38:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:02.250679 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadf178-adc7-4e71-9a63-64af323dc51f None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:02.251503 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba9193-5fd9-4d8f-be96-434a80b737bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:02.252417 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba9193-5fd9-4d8f-be96-434a80b737bc None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:02.252939 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba9193-5fd9-4d8f-be96-434a80b737bc None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:02.253401 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba9193-5fd9-4d8f-be96-434a80b737bc None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:02.254379 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba9193-5fd9-4d8f-be96-434a80b737bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:02.254914 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba9193-5fd9-4d8f-be96-434a80b737bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:02.256524 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba9193-5fd9-4d8f-be96-434a80b737bc None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:02.269983 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 397/821] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:38:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:02.271081 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba9193-5fd9-4d8f-be96-434a80b737bc None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:02.359187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadf178-adc7-4e71-9a63-64af323dc51f None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:02.372827 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba9193-5fd9-4d8f-be96-434a80b737bc None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:02.396837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d0291-3782-40ac-bec8-fdfdda32101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:02.398186 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d0291-3782-40ac-bec8-fdfdda32101e None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:02.398713 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d0291-3782-40ac-bec8-fdfdda32101e None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:02.399155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d0291-3782-40ac-bec8-fdfdda32101e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:02.406304 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d0291-3782-40ac-bec8-fdfdda32101e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:02.406624 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4ac9a-5548-490a-8164-b7e25e5d7d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:02.407284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4ac9a-5548-490a-8164-b7e25e5d7d61 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:02.407572 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4ac9a-5548-490a-8164-b7e25e5d7d61 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:02.407851 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4ac9a-5548-490a-8164-b7e25e5d7d61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:02.408565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d0291-3782-40ac-bec8-fdfdda32101e None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:02.408676 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4ac9a-5548-490a-8164-b7e25e5d7d61 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:02.409921 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4ac9a-5548-490a-8164-b7e25e5d7d61 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:02.422535 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-1e5d0291-3782-40ac-bec8-fdfdda32101e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:38:02.423939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 425/822] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:38:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:02.424926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b894c3b-f924-4d0c-8cec-81159c9a0bf1 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:02.425203 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b894c3b-f924-4d0c-8cec-81159c9a0bf1 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:02.425477 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b894c3b-f924-4d0c-8cec-81159c9a0bf1 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:02.430662 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 426/823] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:02.430662 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b894c3b-f924-4d0c-8cec-81159c9a0bf1 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:02.436746 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 398/824] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Apr 11 16:38:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:38:02.437642 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4ac9a-5548-490a-8164-b7e25e5d7d61 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:02.559104 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4ac9a-5548-490a-8164-b7e25e5d7d61 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:02.582325 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b894c3b-f924-4d0c-8cec-81159c9a0bf1 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:02.594240 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfface2-676e-4aaf-9af8-42d7059644ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:02.595224 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfface2-676e-4aaf-9af8-42d7059644ee None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:02.595661 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfface2-676e-4aaf-9af8-42d7059644ee None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:02.596072 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfface2-676e-4aaf-9af8-42d7059644ee None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:02.596999 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfface2-676e-4aaf-9af8-42d7059644ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:02.597479 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfface2-676e-4aaf-9af8-42d7059644ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:02.599029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfface2-676e-4aaf-9af8-42d7059644ee None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:02.612619 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 399/825] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:38:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:02.613971 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d8f83-13c7-4110-9856-c54079a1181a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:02.614267 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d8f83-13c7-4110-9856-c54079a1181a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:02.614561 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d8f83-13c7-4110-9856-c54079a1181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:02.620115 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac483f-f021-4024-b3a8-077094365037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:02.621358 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac483f-f021-4024-b3a8-077094365037 None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:02.621909 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac483f-f021-4024-b3a8-077094365037 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:02.622390 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac483f-f021-4024-b3a8-077094365037 None admin] PATH_INFO: `/v3/projects/c1eb8559ca744abda7039b767af5818f/users/e0653575c0a24603bb9287e6222313de/roles/16dc6f09d53447fd9e4a95fb1df71d9d` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:02.635998 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-718d8f83-13c7-4110-9856-c54079a1181a None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:02.637123 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-718d8f83-13c7-4110-9856-c54079a1181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:02.643731 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac483f-f021-4024-b3a8-077094365037 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1eb8559ca744abda7039b767af5818f, user_id=e0653575c0a24603bb9287e6222313de, role_id=16dc6f09d53447fd9e4a95fb1df71d9d)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:02.645214 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac483f-f021-4024-b3a8-077094365037 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:02.664456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 427/826] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:38:02 2022] PUT /identity/v3/projects/c1eb8559ca744abda7039b767af5818f/users/e0653575c0a24603bb9287e6222313de/roles/16dc6f09d53447fd9e4a95fb1df71d9d => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:38:02.664776 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac483f-f021-4024-b3a8-077094365037 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:02.724404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 400/827] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:02.756258 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d8f83-13c7-4110-9856-c54079a1181a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:02.834092 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac483f-f021-4024-b3a8-077094365037 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:02.882275 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d8f83-13c7-4110-9856-c54079a1181a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:02.887385 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499f401-3507-47eb-8a34-f58ff9649a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:02.888510 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499f401-3507-47eb-8a34-f58ff9649a06 None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:02.888967 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499f401-3507-47eb-8a34-f58ff9649a06 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:02.889278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499f401-3507-47eb-8a34-f58ff9649a06 None admin] PATH_INFO: `/v3/projects/c1eb8559ca744abda7039b767af5818f/users/1f6659c6661840a79ba9ff1c3c9e93c6/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:02.895896 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499f401-3507-47eb-8a34-f58ff9649a06 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1eb8559ca744abda7039b767af5818f, user_id=1f6659c6661840a79ba9ff1c3c9e93c6, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:02.897348 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499f401-3507-47eb-8a34-f58ff9649a06 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:02.917766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 428/828] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:38:02 2022] PUT /identity/v3/projects/c1eb8559ca744abda7039b767af5818f/users/1f6659c6661840a79ba9ff1c3c9e93c6/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:38:02.931210 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09080cbb-7aaf-4998-be2f-40e6b6ddaebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:02.932073 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09080cbb-7aaf-4998-be2f-40e6b6ddaebb None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:02.932363 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09080cbb-7aaf-4998-be2f-40e6b6ddaebb None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:02.932641 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09080cbb-7aaf-4998-be2f-40e6b6ddaebb None admin] PATH_INFO: `/v3/services/network` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:02.933301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09080cbb-7aaf-4998-be2f-40e6b6ddaebb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:02.934770 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09080cbb-7aaf-4998-be2f-40e6b6ddaebb None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:02.953148 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-09080cbb-7aaf-4998-be2f-40e6b6ddaebb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 11 16:38:02.954871 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 401/829] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:38:02 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:02.961357 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499f401-3507-47eb-8a34-f58ff9649a06 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:03.074394 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499f401-3507-47eb-8a34-f58ff9649a06 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:03.110283 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35e97d-1ac1-4fed-9070-b02f82c7db48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:03.111093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35e97d-1ac1-4fed-9070-b02f82c7db48 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:03.111431 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35e97d-1ac1-4fed-9070-b02f82c7db48 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:03.111714 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35e97d-1ac1-4fed-9070-b02f82c7db48 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:03.112434 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35e97d-1ac1-4fed-9070-b02f82c7db48 None admin] RBAC: Adding query filter params (name=network) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:03.112742 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35e97d-1ac1-4fed-9070-b02f82c7db48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:03.114146 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad35e97d-1ac1-4fed-9070-b02f82c7db48 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:03.119806 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 429/830] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Apr 11 16:38:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:03.125530 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09080cbb-7aaf-4998-be2f-40e6b6ddaebb None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:03.253582 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09080cbb-7aaf-4998-be2f-40e6b6ddaebb None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:03.296046 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd33055-4dd2-4299-b104-663df5bba3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:03.297124 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd33055-4dd2-4299-b104-663df5bba3e2 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:03.297633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd33055-4dd2-4299-b104-663df5bba3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:03.298110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd33055-4dd2-4299-b104-663df5bba3e2 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:03.299160 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd33055-4dd2-4299-b104-663df5bba3e2 None admin] RBAC: Adding query filter params (type=network) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:03.299681 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd33055-4dd2-4299-b104-663df5bba3e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:03.301281 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd33055-4dd2-4299-b104-663df5bba3e2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:03.308112 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 402/831] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Apr 11 16:38:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:03.313289 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35e97d-1ac1-4fed-9070-b02f82c7db48 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:03.419289 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35e97d-1ac1-4fed-9070-b02f82c7db48 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:03.453270 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd227689-a717-4e63-94d6-2d5c1407669e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:03.453936 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd227689-a717-4e63-94d6-2d5c1407669e None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:03.454220 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd227689-a717-4e63-94d6-2d5c1407669e None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:03.454497 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd227689-a717-4e63-94d6-2d5c1407669e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:03.455276 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd227689-a717-4e63-94d6-2d5c1407669e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:03.456656 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd227689-a717-4e63-94d6-2d5c1407669e None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:03.477810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 430/832] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Apr 11 16:38:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:38:03.751478 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc4b14-688f-4647-b482-d78d0fff004f None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:03.752195 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc4b14-688f-4647-b482-d78d0fff004f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:03.752687 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc4b14-688f-4647-b482-d78d0fff004f None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:03.754261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 403/833] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:03.760195 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae42e1-7f34-4532-83dd-c8aa3f0190e8 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:03.760642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae42e1-7f34-4532-83dd-c8aa3f0190e8 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:03.760729 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae42e1-7f34-4532-83dd-c8aa3f0190e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:03.778053 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-6dae42e1-7f34-4532-83dd-c8aa3f0190e8 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:03.779314 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-6dae42e1-7f34-4532-83dd-c8aa3f0190e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:03.853106 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 431/834] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:38:03.875686 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc4b14-688f-4647-b482-d78d0fff004f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:03.982402 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc4b14-688f-4647-b482-d78d0fff004f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:04.021081 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb668a-d696-48ac-a7a6-f1bb27cbf954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:04.021852 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb668a-d696-48ac-a7a6-f1bb27cbf954 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:04.022134 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb668a-d696-48ac-a7a6-f1bb27cbf954 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:04.022412 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb668a-d696-48ac-a7a6-f1bb27cbf954 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:04.023711 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb668a-d696-48ac-a7a6-f1bb27cbf954 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:04.025256 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb668a-d696-48ac-a7a6-f1bb27cbf954 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:04.037854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-f1eb668a-d696-48ac-a7a6-f1bb27cbf954 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 11 16:38:04.039428 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 404/835] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Apr 11 16:38:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:04.046527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae42e1-7f34-4532-83dd-c8aa3f0190e8 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:04.159837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae42e1-7f34-4532-83dd-c8aa3f0190e8 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:04.196986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e257d2-e34e-456f-9eed-fb8c704bdce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:04.197647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e257d2-e34e-456f-9eed-fb8c704bdce7 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:04.197933 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e257d2-e34e-456f-9eed-fb8c704bdce7 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:04.198213 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e257d2-e34e-456f-9eed-fb8c704bdce7 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:04.198955 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e257d2-e34e-456f-9eed-fb8c704bdce7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:04.199265 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e257d2-e34e-456f-9eed-fb8c704bdce7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:04.200645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e257d2-e34e-456f-9eed-fb8c704bdce7 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:04.205280 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 432/836] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Apr 11 16:38:04 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:04.211788 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb668a-d696-48ac-a7a6-f1bb27cbf954 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:04.324431 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb668a-d696-48ac-a7a6-f1bb27cbf954 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:04.357874 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3603b4-b6d6-4d0f-9a36-03fbf6e1cd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:04.358538 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3603b4-b6d6-4d0f-9a36-03fbf6e1cd49 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:04.358854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3603b4-b6d6-4d0f-9a36-03fbf6e1cd49 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:04.359130 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3603b4-b6d6-4d0f-9a36-03fbf6e1cd49 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:04.359839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3603b4-b6d6-4d0f-9a36-03fbf6e1cd49 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:04.360146 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3603b4-b6d6-4d0f-9a36-03fbf6e1cd49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:04.361518 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3603b4-b6d6-4d0f-9a36-03fbf6e1cd49 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:04.366508 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 405/837] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Apr 11 16:38:04 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:05.162640 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851ed2d-89c8-4944-9059-ab69d1c341b3 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:05.164164 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851ed2d-89c8-4944-9059-ab69d1c341b3 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:05.164645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e851ed2d-89c8-4944-9059-ab69d1c341b3 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:05.166491 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 433/838] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:05.172289 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052f6a7-1cf2-4aa2-b692-efb7447cdf8e None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:05.173127 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052f6a7-1cf2-4aa2-b692-efb7447cdf8e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:05.173604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052f6a7-1cf2-4aa2-b692-efb7447cdf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:05.190515 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-4052f6a7-1cf2-4aa2-b692-efb7447cdf8e None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:05.192124 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4052f6a7-1cf2-4aa2-b692-efb7447cdf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:05.226847 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1e291-4523-4143-8710-e7c72049fcd7 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:05.227452 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1e291-4523-4143-8710-e7c72049fcd7 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:05.227950 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1e291-4523-4143-8710-e7c72049fcd7 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:05.229585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 434/839] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:05.234848 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a663310-0818-430c-9f08-fd2dfa70d680 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:05.235199 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a663310-0818-430c-9f08-fd2dfa70d680 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:05.235547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a663310-0818-430c-9f08-fd2dfa70d680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:05.253056 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-6a663310-0818-430c-9f08-fd2dfa70d680 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:05.254843 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-6a663310-0818-430c-9f08-fd2dfa70d680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:05.262329 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 406/840] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:05.287282 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052f6a7-1cf2-4aa2-b692-efb7447cdf8e None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:05.342738 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 435/841] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:05.363771 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a663310-0818-430c-9f08-fd2dfa70d680 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:05.421658 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052f6a7-1cf2-4aa2-b692-efb7447cdf8e None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:05.463910 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2bcd2-74b0-4a62-8ee2-ca400b2b54a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:05.465489 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2bcd2-74b0-4a62-8ee2-ca400b2b54a7 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:05.465979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2bcd2-74b0-4a62-8ee2-ca400b2b54a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:05.466459 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2bcd2-74b0-4a62-8ee2-ca400b2b54a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:05.480257 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2bcd2-74b0-4a62-8ee2-ca400b2b54a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:38:05.481278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a663310-0818-430c-9f08-fd2dfa70d680 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:05.489202 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-9cc2bcd2-74b0-4a62-8ee2-ca400b2b54a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:38:05.495527 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 407/842] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:38:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:05.496808 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2bcd2-74b0-4a62-8ee2-ca400b2b54a7 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:05.526870 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23e5db-a240-45c2-a105-7ff575420a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:05.527691 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23e5db-a240-45c2-a105-7ff575420a4f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:05.527972 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23e5db-a240-45c2-a105-7ff575420a4f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:05.528315 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23e5db-a240-45c2-a105-7ff575420a4f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:05.529190 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23e5db-a240-45c2-a105-7ff575420a4f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:05.531403 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23e5db-a240-45c2-a105-7ff575420a4f None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:05.547223 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-bc23e5db-a240-45c2-a105-7ff575420a4f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 11 16:38:05.554613 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 436/843] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:38:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:05.556461 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23e5db-a240-45c2-a105-7ff575420a4f None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:05.610224 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2bcd2-74b0-4a62-8ee2-ca400b2b54a7 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:05.645234 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49f595-9265-48cd-bc27-78c16180635f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:05.645876 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49f595-9265-48cd-bc27-78c16180635f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:05.646159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49f595-9265-48cd-bc27-78c16180635f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:05.646438 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d49f595-9265-48cd-bc27-78c16180635f None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:05.647228 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49f595-9265-48cd-bc27-78c16180635f None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:05.647564 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49f595-9265-48cd-bc27-78c16180635f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:05.649029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d49f595-9265-48cd-bc27-78c16180635f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:05.661476 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23e5db-a240-45c2-a105-7ff575420a4f None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:05.661664 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 408/844] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:38:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:05.662459 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49f595-9265-48cd-bc27-78c16180635f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:05.701450 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6593ed22-2ed4-4654-a410-4a5e894ad0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:05.702116 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593ed22-2ed4-4654-a410-4a5e894ad0e6 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:05.702398 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593ed22-2ed4-4654-a410-4a5e894ad0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:05.702718 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6593ed22-2ed4-4654-a410-4a5e894ad0e6 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:05.703419 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593ed22-2ed4-4654-a410-4a5e894ad0e6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:05.703722 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593ed22-2ed4-4654-a410-4a5e894ad0e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:05.705081 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6593ed22-2ed4-4654-a410-4a5e894ad0e6 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:05.709832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 437/845] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:38:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:05.711637 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84ac65-eb9e-46cc-84e9-cbeb1bcccb89 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:05.711908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84ac65-eb9e-46cc-84e9-cbeb1bcccb89 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:05.712248 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84ac65-eb9e-46cc-84e9-cbeb1bcccb89 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:05.713643 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 438/846] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:05.718033 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84ac65-eb9e-46cc-84e9-cbeb1bcccb89 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:05.767332 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d49f595-9265-48cd-bc27-78c16180635f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:05.799310 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bda90-bf2b-4e77-aa6b-b3dd09c9103f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:05.800096 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bda90-bf2b-4e77-aa6b-b3dd09c9103f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:05.800378 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bda90-bf2b-4e77-aa6b-b3dd09c9103f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:05.800654 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bda90-bf2b-4e77-aa6b-b3dd09c9103f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:05.810577 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bda90-bf2b-4e77-aa6b-b3dd09c9103f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:05.812026 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bda90-bf2b-4e77-aa6b-b3dd09c9103f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:05.817486 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84ac65-eb9e-46cc-84e9-cbeb1bcccb89 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:05.828492 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-e05bda90-bf2b-4e77-aa6b-b3dd09c9103f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:05.829688 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 409/847] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:05.830881 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89681636-6701-47d9-a3d6-0b11ec90e148 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:05.831160 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89681636-6701-47d9-a3d6-0b11ec90e148 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:05.831430 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89681636-6701-47d9-a3d6-0b11ec90e148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:05.847775 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-89681636-6701-47d9-a3d6-0b11ec90e148 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:05.849086 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-89681636-6701-47d9-a3d6-0b11ec90e148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:05.858405 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5e5be-0879-4706-8b6c-f38a395d8e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:05.859104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5e5be-0879-4706-8b6c-f38a395d8e99 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:05.859387 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5e5be-0879-4706-8b6c-f38a395d8e99 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:05.859661 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5e5be-0879-4706-8b6c-f38a395d8e99 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:05.860364 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5e5be-0879-4706-8b6c-f38a395d8e99 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:05.860698 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5e5be-0879-4706-8b6c-f38a395d8e99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:05.862037 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5e5be-0879-4706-8b6c-f38a395d8e99 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:05.867120 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 439/848] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:38:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:05.867917 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5e5be-0879-4706-8b6c-f38a395d8e99 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:05.959714 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 410/849] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:05.986472 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89681636-6701-47d9-a3d6-0b11ec90e148 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:05.987964 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5e5be-0879-4706-8b6c-f38a395d8e99 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:06.034114 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d1f01-a25e-4430-8a9e-9d7cb0fbb183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:06.034875 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d1f01-a25e-4430-8a9e-9d7cb0fbb183 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:06.035157 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d1f01-a25e-4430-8a9e-9d7cb0fbb183 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:06.035506 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d1f01-a25e-4430-8a9e-9d7cb0fbb183 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:06.036246 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d1f01-a25e-4430-8a9e-9d7cb0fbb183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:06.036738 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d1f01-a25e-4430-8a9e-9d7cb0fbb183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:06.038392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d1f01-a25e-4430-8a9e-9d7cb0fbb183 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:06.051560 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 440/850] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:06.057065 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d1f01-a25e-4430-8a9e-9d7cb0fbb183 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:06.108431 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89681636-6701-47d9-a3d6-0b11ec90e148 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:06.152090 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc46c6-9bdb-4474-954d-51e8e1c143e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:06.153152 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc46c6-9bdb-4474-954d-51e8e1c143e9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:06.153431 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc46c6-9bdb-4474-954d-51e8e1c143e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:06.153710 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cc46c6-9bdb-4474-954d-51e8e1c143e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:06.168080 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cc46c6-9bdb-4474-954d-51e8e1c143e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:38:06.169405 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d1f01-a25e-4430-8a9e-9d7cb0fbb183 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:06.176244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-89cc46c6-9bdb-4474-954d-51e8e1c143e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:38:06.178645 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 411/851] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:06.184886 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc46c6-9bdb-4474-954d-51e8e1c143e9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:06.210828 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7fc90-7d96-4e9b-89db-4990bd91ca25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:06.212150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7fc90-7d96-4e9b-89db-4990bd91ca25 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:06.212606 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7fc90-7d96-4e9b-89db-4990bd91ca25 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:06.213074 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7fc90-7d96-4e9b-89db-4990bd91ca25 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:06.221034 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7fc90-7d96-4e9b-89db-4990bd91ca25 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:06.222866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7fc90-7d96-4e9b-89db-4990bd91ca25 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:06.237724 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-05b7fc90-7d96-4e9b-89db-4990bd91ca25 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 16:38:06.239652 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 441/852] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Apr 11 16:38:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:06.245347 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7fc90-7d96-4e9b-89db-4990bd91ca25 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:06.294753 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cc46c6-9bdb-4474-954d-51e8e1c143e9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:06.337985 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c2660-4209-45fc-9d48-d22ec961b15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:06.338993 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c2660-4209-45fc-9d48-d22ec961b15d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:06.339453 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c2660-4209-45fc-9d48-d22ec961b15d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:06.339933 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c2660-4209-45fc-9d48-d22ec961b15d None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:06.340851 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c2660-4209-45fc-9d48-d22ec961b15d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:06.341362 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c2660-4209-45fc-9d48-d22ec961b15d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:06.342956 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c2660-4209-45fc-9d48-d22ec961b15d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:06.347162 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7fc90-7d96-4e9b-89db-4990bd91ca25 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:06.353032 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 412/853] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:38:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:06.361733 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c2660-4209-45fc-9d48-d22ec961b15d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:06.387847 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf65ef-a444-4e68-a074-152d9a7937b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:06.388515 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf65ef-a444-4e68-a074-152d9a7937b6 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:06.388797 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf65ef-a444-4e68-a074-152d9a7937b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:06.389073 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf65ef-a444-4e68-a074-152d9a7937b6 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:06.390215 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf65ef-a444-4e68-a074-152d9a7937b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:06.390524 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf65ef-a444-4e68-a074-152d9a7937b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:06.392003 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf65ef-a444-4e68-a074-152d9a7937b6 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:06.409737 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 442/854] 10.222.0.73 () {56 vars in 1149 bytes} [Mon Apr 11 16:38:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:06.415189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf65ef-a444-4e68-a074-152d9a7937b6 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:06.472411 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c2660-4209-45fc-9d48-d22ec961b15d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:06.506738 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f771e-ba8f-4107-be3c-152c875ef54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:06.508040 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f771e-ba8f-4107-be3c-152c875ef54e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:06.508325 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f771e-ba8f-4107-be3c-152c875ef54e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:06.508603 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f771e-ba8f-4107-be3c-152c875ef54e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:06.513645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf65ef-a444-4e68-a074-152d9a7937b6 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:06.519721 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f771e-ba8f-4107-be3c-152c875ef54e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:06.521212 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f771e-ba8f-4107-be3c-152c875ef54e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:06.539693 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-b10f771e-ba8f-4107-be3c-152c875ef54e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:06.545610 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 413/855] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:06.546931 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f771e-ba8f-4107-be3c-152c875ef54e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:06.547809 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7462e-e0c0-4463-8505-ad53ff8231f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:06.548456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7462e-e0c0-4463-8505-ad53ff8231f3 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:06.548736 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7462e-e0c0-4463-8505-ad53ff8231f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:06.549010 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc7462e-e0c0-4463-8505-ad53ff8231f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:06.615409 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7462e-e0c0-4463-8505-ad53ff8231f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:06.617023 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc7462e-e0c0-4463-8505-ad53ff8231f3 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:06.648890 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f771e-ba8f-4107-be3c-152c875ef54e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:06.683212 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5aa096-3292-48b8-b6d1-5ca4cb5b2bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:06.683880 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aa096-3292-48b8-b6d1-5ca4cb5b2bb3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:06.684164 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aa096-3292-48b8-b6d1-5ca4cb5b2bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:06.684440 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5aa096-3292-48b8-b6d1-5ca4cb5b2bb3 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:06.685159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5aa096-3292-48b8-b6d1-5ca4cb5b2bb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:06.685463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5aa096-3292-48b8-b6d1-5ca4cb5b2bb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:06.686848 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5aa096-3292-48b8-b6d1-5ca4cb5b2bb3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:06.704536 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 414/856] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:06.705842 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5aa096-3292-48b8-b6d1-5ca4cb5b2bb3 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:06.715674 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 443/857] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:38:06 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 16:38:06.720986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7462e-e0c0-4463-8505-ad53ff8231f3 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:06.813499 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5aa096-3292-48b8-b6d1-5ca4cb5b2bb3 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:06.825540 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc7462e-e0c0-4463-8505-ad53ff8231f3 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:06.855871 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a501c253-c536-4634-ba4f-3e0f4ed8efbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:06.856924 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501c253-c536-4634-ba4f-3e0f4ed8efbe None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:06.857398 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501c253-c536-4634-ba4f-3e0f4ed8efbe None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:06.857845 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501c253-c536-4634-ba4f-3e0f4ed8efbe None admin] PATH_INFO: `/v3/users/swift` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:06.858228 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b50a0-db94-4bbb-9102-3d4604780e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:06.859043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b50a0-db94-4bbb-9102-3d4604780e33 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:06.859329 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b50a0-db94-4bbb-9102-3d4604780e33 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:06.859598 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b50a0-db94-4bbb-9102-3d4604780e33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:06.867121 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501c253-c536-4634-ba4f-3e0f4ed8efbe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:06.869407 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a501c253-c536-4634-ba4f-3e0f4ed8efbe None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:06.869726 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b50a0-db94-4bbb-9102-3d4604780e33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:06.871175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b50a0-db94-4bbb-9102-3d4604780e33 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:06.886898 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-a501c253-c536-4634-ba4f-3e0f4ed8efbe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 16:38:06.888363 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-9a2b50a0-db94-4bbb-9102-3d4604780e33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:06.889222 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 415/858] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:38:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:06.890876 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572083b-3aca-4478-a5ef-8a3e6948c372 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:06.891318 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572083b-3aca-4478-a5ef-8a3e6948c372 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:06.891783 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572083b-3aca-4478-a5ef-8a3e6948c372 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:06.897851 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 444/859] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:06.897851 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b50a0-db94-4bbb-9102-3d4604780e33 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:06.898570 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 416/860] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:06.900605 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572083b-3aca-4478-a5ef-8a3e6948c372 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:06.997482 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b50a0-db94-4bbb-9102-3d4604780e33 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:07.011919 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572083b-3aca-4478-a5ef-8a3e6948c372 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:07.031483 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9aa2bc-af86-417f-9be0-8fa5cc8d68f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:07.032144 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9aa2bc-af86-417f-9be0-8fa5cc8d68f6 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:07.032419 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9aa2bc-af86-417f-9be0-8fa5cc8d68f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:07.032687 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9aa2bc-af86-417f-9be0-8fa5cc8d68f6 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:07.033919 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9aa2bc-af86-417f-9be0-8fa5cc8d68f6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:07.034369 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9aa2bc-af86-417f-9be0-8fa5cc8d68f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:07.035846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9aa2bc-af86-417f-9be0-8fa5cc8d68f6 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:07.048751 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba68f4c-1967-498c-a63d-e6f047601c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:07.049462 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba68f4c-1967-498c-a63d-e6f047601c75 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:07.049724 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba68f4c-1967-498c-a63d-e6f047601c75 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:07.050731 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba68f4c-1967-498c-a63d-e6f047601c75 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:07.051504 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba68f4c-1967-498c-a63d-e6f047601c75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:07.052130 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba68f4c-1967-498c-a63d-e6f047601c75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:07.053524 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba68f4c-1967-498c-a63d-e6f047601c75 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:07.054690 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 445/861] 10.222.0.73 () {56 vars in 1135 bytes} [Mon Apr 11 16:38:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:07.055842 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930acb1b-ffe5-486f-92ec-f1cda1bc216c None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:07.056126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930acb1b-ffe5-486f-92ec-f1cda1bc216c None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:07.056399 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930acb1b-ffe5-486f-92ec-f1cda1bc216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:07.071467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 417/862] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:07.072245 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba68f4c-1967-498c-a63d-e6f047601c75 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:07.073537 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-930acb1b-ffe5-486f-92ec-f1cda1bc216c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:07.074795 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-930acb1b-ffe5-486f-92ec-f1cda1bc216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:07.153948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 446/863] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:07.153948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930acb1b-ffe5-486f-92ec-f1cda1bc216c None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:07.195300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba68f4c-1967-498c-a63d-e6f047601c75 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:07.228187 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50be567-6fb8-4625-a055-a90ac4f1ce57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:07.228988 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be567-6fb8-4625-a055-a90ac4f1ce57 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:07.229347 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be567-6fb8-4625-a055-a90ac4f1ce57 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:07.229619 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be567-6fb8-4625-a055-a90ac4f1ce57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:07.240732 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930acb1b-ffe5-486f-92ec-f1cda1bc216c None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:07.277286 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85558ed2-70e3-4fe5-8c22-b288835b9619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:07.278410 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85558ed2-70e3-4fe5-8c22-b288835b9619 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:07.278890 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85558ed2-70e3-4fe5-8c22-b288835b9619 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:07.279319 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85558ed2-70e3-4fe5-8c22-b288835b9619 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:07.286551 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85558ed2-70e3-4fe5-8c22-b288835b9619 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:07.288572 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85558ed2-70e3-4fe5-8c22-b288835b9619 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:07.301398 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-85558ed2-70e3-4fe5-8c22-b288835b9619 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:38:07.307683 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50be567-6fb8-4625-a055-a90ac4f1ce57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:07.307851 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 447/864] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:38:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:07.307851 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85558ed2-70e3-4fe5-8c22-b288835b9619 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:07.308027 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50be567-6fb8-4625-a055-a90ac4f1ce57 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:07.399323 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 418/865] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:38:07 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:38:07.400495 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50be567-6fb8-4625-a055-a90ac4f1ce57 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:07.407775 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85558ed2-70e3-4fe5-8c22-b288835b9619 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:07.443221 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e075d35-f871-4d74-aef5-7a72138321f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:07.444158 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e075d35-f871-4d74-aef5-7a72138321f8 None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:07.445133 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e075d35-f871-4d74-aef5-7a72138321f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:07.445589 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e075d35-f871-4d74-aef5-7a72138321f8 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:07.446532 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e075d35-f871-4d74-aef5-7a72138321f8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:07.448008 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e075d35-f871-4d74-aef5-7a72138321f8 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:07.470618 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 448/866] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Apr 11 16:38:07 2022] POST /identity/v3/services => generated 269 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:38:07.470618 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e075d35-f871-4d74-aef5-7a72138321f8 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:07.516605 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50be567-6fb8-4625-a055-a90ac4f1ce57 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:07.561544 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8428b4-5203-4983-b9fa-f424c16184d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:07.562604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8428b4-5203-4983-b9fa-f424c16184d3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:07.562913 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8428b4-5203-4983-b9fa-f424c16184d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:07.563188 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8428b4-5203-4983-b9fa-f424c16184d3 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:07.564638 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8428b4-5203-4983-b9fa-f424c16184d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:07.564956 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8428b4-5203-4983-b9fa-f424c16184d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:07.567245 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8428b4-5203-4983-b9fa-f424c16184d3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:07.588279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 419/867] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:38:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:07.589608 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8428b4-5203-4983-b9fa-f424c16184d3 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:07.591766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e075d35-f871-4d74-aef5-7a72138321f8 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:07.640865 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321392e-c490-4f08-bef8-ecf687266347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:07.641672 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321392e-c490-4f08-bef8-ecf687266347 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:07.642109 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321392e-c490-4f08-bef8-ecf687266347 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:07.642393 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d321392e-c490-4f08-bef8-ecf687266347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:07.658289 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321392e-c490-4f08-bef8-ecf687266347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:07.659706 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d321392e-c490-4f08-bef8-ecf687266347 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:07.677509 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-d321392e-c490-4f08-bef8-ecf687266347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:07.684367 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 449/868] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:07.685329 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321392e-c490-4f08-bef8-ecf687266347 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:07.702286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8428b4-5203-4983-b9fa-f424c16184d3 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:07.745443 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3073d9a-81d9-4a4f-a89f-1560099a35ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:07.746875 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3073d9a-81d9-4a4f-a89f-1560099a35ab None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:07.747304 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3073d9a-81d9-4a4f-a89f-1560099a35ab None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:07.747967 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3073d9a-81d9-4a4f-a89f-1560099a35ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:07.749101 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3073d9a-81d9-4a4f-a89f-1560099a35ab None admin] RBAC: Adding query filter params (role.id=16dc6f09d53447fd9e4a95fb1df71d9d, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=e0653575c0a24603bb9287e6222313de) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:07.749868 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3073d9a-81d9-4a4f-a89f-1560099a35ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:07.751904 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3073d9a-81d9-4a4f-a89f-1560099a35ab None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:07.759978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 420/869] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:38:07 2022] GET /identity/v3/role_assignments?user.id=e0653575c0a24603bb9287e6222313de&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=16dc6f09d53447fd9e4a95fb1df71d9d => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:07.797600 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d321392e-c490-4f08-bef8-ecf687266347 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:07.836578 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0500f53-f258-4502-afb7-d54700565ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:07.837409 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0500f53-f258-4502-afb7-d54700565ceb None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:07.837791 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0500f53-f258-4502-afb7-d54700565ceb None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:07.838167 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0500f53-f258-4502-afb7-d54700565ceb None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:07.839032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0500f53-f258-4502-afb7-d54700565ceb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:07.839442 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0500f53-f258-4502-afb7-d54700565ceb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:07.840998 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0500f53-f258-4502-afb7-d54700565ceb None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:07.855105 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 450/870] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:07.860872 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3073d9a-81d9-4a4f-a89f-1560099a35ab None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:07.978844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3073d9a-81d9-4a4f-a89f-1560099a35ab None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:08.012038 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148cf68-4e90-4c10-a1ba-8f255a188f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:08.012829 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148cf68-4e90-4c10-a1ba-8f255a188f8e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:08.013107 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148cf68-4e90-4c10-a1ba-8f255a188f8e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:08.013380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148cf68-4e90-4c10-a1ba-8f255a188f8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:08.020289 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148cf68-4e90-4c10-a1ba-8f255a188f8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:08.021719 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a148cf68-4e90-4c10-a1ba-8f255a188f8e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:08.034956 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-a148cf68-4e90-4c10-a1ba-8f255a188f8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:38:08.036597 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 421/871] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:38:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:08.042904 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0500f53-f258-4502-afb7-d54700565ceb None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:08.144532 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0500f53-f258-4502-afb7-d54700565ceb None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:08.178308 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a61c72-5928-4b6a-b152-e6bb4d2d509c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:08.179370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a61c72-5928-4b6a-b152-e6bb4d2d509c None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:08.179863 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a61c72-5928-4b6a-b152-e6bb4d2d509c None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:08.180353 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a61c72-5928-4b6a-b152-e6bb4d2d509c None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:08.181326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a61c72-5928-4b6a-b152-e6bb4d2d509c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:08.181830 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a61c72-5928-4b6a-b152-e6bb4d2d509c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:08.183457 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a61c72-5928-4b6a-b152-e6bb4d2d509c None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:08.196227 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 451/872] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:38:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:08.203687 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148cf68-4e90-4c10-a1ba-8f255a188f8e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:08.268911 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdd048-28e2-454f-96a7-815bcda2ee93 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:08.269415 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdd048-28e2-454f-96a7-815bcda2ee93 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:08.269515 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdd048-28e2-454f-96a7-815bcda2ee93 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:08.271086 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 452/873] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:38:08.279538 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb844279-2c3f-476e-9d3b-7187cfd15659 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:08.279968 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb844279-2c3f-476e-9d3b-7187cfd15659 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:08.280335 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb844279-2c3f-476e-9d3b-7187cfd15659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:08.301209 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-bb844279-2c3f-476e-9d3b-7187cfd15659 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:08.303062 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-bb844279-2c3f-476e-9d3b-7187cfd15659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:08.306960 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148cf68-4e90-4c10-a1ba-8f255a188f8e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:08.350254 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fa00f-aee6-4561-8a4c-10aa3f68f0d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:08.351483 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fa00f-aee6-4561-8a4c-10aa3f68f0d0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:08.351768 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fa00f-aee6-4561-8a4c-10aa3f68f0d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:08.354611 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449fa00f-aee6-4561-8a4c-10aa3f68f0d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:08.354611 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fa00f-aee6-4561-8a4c-10aa3f68f0d0 None admin] RBAC: Adding query filter params (role.id=13de1ce875d44fcc988cc31b3a0639be, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=1f6659c6661840a79ba9ff1c3c9e93c6) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:08.354611 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fa00f-aee6-4561-8a4c-10aa3f68f0d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:08.354611 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449fa00f-aee6-4561-8a4c-10aa3f68f0d0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:08.361005 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 422/874] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:38:08 2022] GET /identity/v3/role_assignments?user.id=1f6659c6661840a79ba9ff1c3c9e93c6&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:08.390768 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 453/875] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:08 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:38:08.407684 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fa00f-aee6-4561-8a4c-10aa3f68f0d0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:08.516852 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449fa00f-aee6-4561-8a4c-10aa3f68f0d0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:08.554129 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6a130-f072-4e68-904c-f08a914236a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:08.555140 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6a130-f072-4e68-904c-f08a914236a3 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:08.555611 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6a130-f072-4e68-904c-f08a914236a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:08.556054 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6a130-f072-4e68-904c-f08a914236a3 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:08.556974 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6a130-f072-4e68-904c-f08a914236a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:08.558506 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6a130-f072-4e68-904c-f08a914236a3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:08.575610 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 423/876] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Apr 11 16:38:08 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:38:09.928391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c048d9f-85c4-49dd-b9ae-a93d790c952a None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:09.928942 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c048d9f-85c4-49dd-b9ae-a93d790c952a None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:09.928942 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c048d9f-85c4-49dd-b9ae-a93d790c952a None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:09.930854 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 454/877] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:09.936268 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078be2d-748b-4d92-aab1-0ca11f0bcc8f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:09.936684 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078be2d-748b-4d92-aab1-0ca11f0bcc8f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:09.936881 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078be2d-748b-4d92-aab1-0ca11f0bcc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:09.955784 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-e078be2d-748b-4d92-aab1-0ca11f0bcc8f None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:09.956969 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e078be2d-748b-4d92-aab1-0ca11f0bcc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:10.031774 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 424/878] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:10.057156 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c048d9f-85c4-49dd-b9ae-a93d790c952a None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:10.161370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c048d9f-85c4-49dd-b9ae-a93d790c952a None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:10.196592 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30781e44-e200-458f-ad87-aa3c7b6b93b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:10.197725 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30781e44-e200-458f-ad87-aa3c7b6b93b2 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:10.198226 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30781e44-e200-458f-ad87-aa3c7b6b93b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:10.198744 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30781e44-e200-458f-ad87-aa3c7b6b93b2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:10.199614 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30781e44-e200-458f-ad87-aa3c7b6b93b2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:10.201207 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30781e44-e200-458f-ad87-aa3c7b6b93b2 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:10.213701 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-30781e44-e200-458f-ad87-aa3c7b6b93b2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 11 16:38:10.215491 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 455/879] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Apr 11 16:38:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:10.221487 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078be2d-748b-4d92-aab1-0ca11f0bcc8f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:10.232755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96df7e-227e-44e9-8557-344323d2dfc3 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:10.232927 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96df7e-227e-44e9-8557-344323d2dfc3 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:10.233140 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96df7e-227e-44e9-8557-344323d2dfc3 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:10.234748 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 456/880] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:10.239624 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6b45b-c911-4e4d-bd88-6fd7e4ec70fd None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:10.239940 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6b45b-c911-4e4d-bd88-6fd7e4ec70fd None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:10.240175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6b45b-c911-4e4d-bd88-6fd7e4ec70fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:10.258094 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-6bb6b45b-c911-4e4d-bd88-6fd7e4ec70fd None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:10.259309 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-6bb6b45b-c911-4e4d-bd88-6fd7e4ec70fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:10.337651 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 457/881] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:38:10.344566 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078be2d-748b-4d92-aab1-0ca11f0bcc8f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:10.361243 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6b45b-c911-4e4d-bd88-6fd7e4ec70fd None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:10.391324 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce37f9-1cc4-4253-90a6-c54741eff5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:10.392917 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce37f9-1cc4-4253-90a6-c54741eff5c8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:10.393492 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce37f9-1cc4-4253-90a6-c54741eff5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:10.393976 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce37f9-1cc4-4253-90a6-c54741eff5c8 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:10.394986 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce37f9-1cc4-4253-90a6-c54741eff5c8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:10.395527 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce37f9-1cc4-4253-90a6-c54741eff5c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:10.398499 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce37f9-1cc4-4253-90a6-c54741eff5c8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:10.405675 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 425/882] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Apr 11 16:38:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:10.412338 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce37f9-1cc4-4253-90a6-c54741eff5c8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:10.483781 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6b45b-c911-4e4d-bd88-6fd7e4ec70fd None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:10.522017 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980dc8d-673d-4189-b059-7eae271ad8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:10.522623 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce37f9-1cc4-4253-90a6-c54741eff5c8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:10.523166 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980dc8d-673d-4189-b059-7eae271ad8e6 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:10.523515 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980dc8d-673d-4189-b059-7eae271ad8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:10.523859 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980dc8d-673d-4189-b059-7eae271ad8e6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:10.538481 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1980dc8d-673d-4189-b059-7eae271ad8e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:38:10.546793 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-1980dc8d-673d-4189-b059-7eae271ad8e6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 16:38:10.553667 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 458/883] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Apr 11 16:38:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:10.555008 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980dc8d-673d-4189-b059-7eae271ad8e6 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:10.565022 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d094b-946e-4099-98dc-3511d85cf43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:10.566008 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d094b-946e-4099-98dc-3511d85cf43c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:10.566998 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d094b-946e-4099-98dc-3511d85cf43c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:10.567284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d094b-946e-4099-98dc-3511d85cf43c None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:10.568041 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d094b-946e-4099-98dc-3511d85cf43c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:10.568356 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d094b-946e-4099-98dc-3511d85cf43c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:10.570287 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d094b-946e-4099-98dc-3511d85cf43c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:10.578925 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 426/884] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Apr 11 16:38:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:10.581483 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d094b-946e-4099-98dc-3511d85cf43c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:10.680826 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d094b-946e-4099-98dc-3511d85cf43c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:10.681601 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980dc8d-673d-4189-b059-7eae271ad8e6 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:10.715344 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3fe4d-d541-4296-a7e4-1bfcec474331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:10.715568 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe286c-ee6a-4d1a-9df7-2008e8477b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:10.716220 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe286c-ee6a-4d1a-9df7-2008e8477b11 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:10.716512 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe286c-ee6a-4d1a-9df7-2008e8477b11 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:10.716789 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe286c-ee6a-4d1a-9df7-2008e8477b11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:10.717159 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3fe4d-d541-4296-a7e4-1bfcec474331 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:10.717569 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe286c-ee6a-4d1a-9df7-2008e8477b11 None admin] RBAC: Adding query filter params (interface=public, service_id=fc30f15d362a4d0c87a50ee49d8bfa0d, region_id=RegionOne) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:10.717838 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3fe4d-d541-4296-a7e4-1bfcec474331 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:10.717945 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe286c-ee6a-4d1a-9df7-2008e8477b11 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:10.718407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3fe4d-d541-4296-a7e4-1bfcec474331 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:10.719264 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafe286c-ee6a-4d1a-9df7-2008e8477b11 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:10.719604 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3fe4d-d541-4296-a7e4-1bfcec474331 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:10.720112 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3fe4d-d541-4296-a7e4-1bfcec474331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:10.721660 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf3fe4d-d541-4296-a7e4-1bfcec474331 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:10.729097 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 427/885] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Apr 11 16:38:10 2022] GET /identity/v3/endpoints?service_id=fc30f15d362a4d0c87a50ee49d8bfa0d&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:10.729990 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe286c-ee6a-4d1a-9df7-2008e8477b11 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:10.730963 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 459/886] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Apr 11 16:38:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:10.739635 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3fe4d-d541-4296-a7e4-1bfcec474331 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:10.839994 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe286c-ee6a-4d1a-9df7-2008e8477b11 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:10.845755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3fe4d-d541-4296-a7e4-1bfcec474331 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:10.875114 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe5e9c8-d5b4-4c14-a4c7-c9f101ba381a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:10.875780 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5e9c8-d5b4-4c14-a4c7-c9f101ba381a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:10.876067 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5e9c8-d5b4-4c14-a4c7-c9f101ba381a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:10.876348 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe5e9c8-d5b4-4c14-a4c7-c9f101ba381a None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:10.877028 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5e9c8-d5b4-4c14-a4c7-c9f101ba381a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:10.878393 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe5e9c8-d5b4-4c14-a4c7-c9f101ba381a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:10.878502 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d46529a-6409-4e16-a33e-fae09b05a8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:10.879241 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46529a-6409-4e16-a33e-fae09b05a8bc None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:10.879519 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46529a-6409-4e16-a33e-fae09b05a8bc None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:10.879789 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d46529a-6409-4e16-a33e-fae09b05a8bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:10.894618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 428/887] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Apr 11 16:38:10 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:38:10.894618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627e68d-c2f8-4eb2-bc2f-fca0f7350f8c None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:10.894618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627e68d-c2f8-4eb2-bc2f-fca0f7350f8c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:10.894618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627e68d-c2f8-4eb2-bc2f-fca0f7350f8c None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:10.894618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 429/888] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:10.895136 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecf580-9e39-4122-9978-1167ffd527ee None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:10.895136 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecf580-9e39-4122-9978-1167ffd527ee None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:10.895298 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecf580-9e39-4122-9978-1167ffd527ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:10.907506 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46529a-6409-4e16-a33e-fae09b05a8bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:10.908996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d46529a-6409-4e16-a33e-fae09b05a8bc None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:10.916011 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b3ecf580-9e39-4122-9978-1167ffd527ee None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:10.917228 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b3ecf580-9e39-4122-9978-1167ffd527ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:10.927533 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-9d46529a-6409-4e16-a33e-fae09b05a8bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:10.929360 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 460/889] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:10.930926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f8b5a-ed80-45aa-b94b-4184c30e7149 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:10.931218 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f8b5a-ed80-45aa-b94b-4184c30e7149 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:10.931499 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f8b5a-ed80-45aa-b94b-4184c30e7149 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:10.933296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 461/890] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:10.936748 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f8b5a-ed80-45aa-b94b-4184c30e7149 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:11.007090 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 430/891] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:38:11.007090 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fd0c6-6009-436c-bf88-4634069b4ec9 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:11.007090 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fd0c6-6009-436c-bf88-4634069b4ec9 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:11.007090 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fd0c6-6009-436c-bf88-4634069b4ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:11.024465 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f57fd0c6-6009-436c-bf88-4634069b4ec9 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:11.025656 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f57fd0c6-6009-436c-bf88-4634069b4ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:11.045338 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f8b5a-ed80-45aa-b94b-4184c30e7149 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:11.081019 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade083a-a2f7-4e72-be59-7e8e9c435220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:11.082119 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade083a-a2f7-4e72-be59-7e8e9c435220 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:11.082119 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade083a-a2f7-4e72-be59-7e8e9c435220 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:11.082285 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade083a-a2f7-4e72-be59-7e8e9c435220 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:11.082947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade083a-a2f7-4e72-be59-7e8e9c435220 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:11.083257 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade083a-a2f7-4e72-be59-7e8e9c435220 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:11.084840 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade083a-a2f7-4e72-be59-7e8e9c435220 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:11.099279 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 462/892] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:11.100857 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade083a-a2f7-4e72-be59-7e8e9c435220 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:11.100971 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 431/893] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:11.106082 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fd0c6-6009-436c-bf88-4634069b4ec9 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:11.200029 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade083a-a2f7-4e72-be59-7e8e9c435220 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:11.206162 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fd0c6-6009-436c-bf88-4634069b4ec9 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:11.232982 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d3614-d08b-48d1-aed8-6c225f934235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:11.233784 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d3614-d08b-48d1-aed8-6c225f934235 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:11.234061 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d3614-d08b-48d1-aed8-6c225f934235 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:11.234340 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d3614-d08b-48d1-aed8-6c225f934235 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:11.235104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d3614-d08b-48d1-aed8-6c225f934235 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:11.236568 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d3614-d08b-48d1-aed8-6c225f934235 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:11.239953 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901acd40-e834-47e1-9eb4-416e13c72961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:11.241026 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901acd40-e834-47e1-9eb4-416e13c72961 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:11.241468 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901acd40-e834-47e1-9eb4-416e13c72961 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:11.241883 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901acd40-e834-47e1-9eb4-416e13c72961 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:11.248947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-e44d3614-d08b-48d1-aed8-6c225f934235 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 16:38:11.249323 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901acd40-e834-47e1-9eb4-416e13c72961 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:11.250235 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 463/894] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Apr 11 16:38:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:11.251037 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d3614-d08b-48d1-aed8-6c225f934235 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:11.251426 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901acd40-e834-47e1-9eb4-416e13c72961 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:11.270648 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-901acd40-e834-47e1-9eb4-416e13c72961 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 16:38:11.272281 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 432/895] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Apr 11 16:38:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:11.275499 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901acd40-e834-47e1-9eb4-416e13c72961 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:11.351769 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d3614-d08b-48d1-aed8-6c225f934235 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:11.376056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901acd40-e834-47e1-9eb4-416e13c72961 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:11.384528 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc6ce2-2516-4794-aa28-a13e9b6f657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:11.385349 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc6ce2-2516-4794-aa28-a13e9b6f657e None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:11.385629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc6ce2-2516-4794-aa28-a13e9b6f657e None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:11.385904 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc6ce2-2516-4794-aa28-a13e9b6f657e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:11.386570 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc6ce2-2516-4794-aa28-a13e9b6f657e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:11.387965 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc6ce2-2516-4794-aa28-a13e9b6f657e None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:11.398882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-facc6ce2-2516-4794-aa28-a13e9b6f657e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 11 16:38:11.400040 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 464/896] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:38:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:11.400842 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc6ce2-2516-4794-aa28-a13e9b6f657e None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:11.415250 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb76c7-4584-4123-b55b-ebfd834a5226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:11.416167 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb76c7-4584-4123-b55b-ebfd834a5226 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:11.416713 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb76c7-4584-4123-b55b-ebfd834a5226 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:11.417159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb76c7-4584-4123-b55b-ebfd834a5226 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:11.418079 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb76c7-4584-4123-b55b-ebfd834a5226 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:11.418551 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb76c7-4584-4123-b55b-ebfd834a5226 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:11.420155 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb76c7-4584-4123-b55b-ebfd834a5226 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:11.426157 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 433/897] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Apr 11 16:38:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:11.427076 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb76c7-4584-4123-b55b-ebfd834a5226 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:11.500155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc6ce2-2516-4794-aa28-a13e9b6f657e None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:11.525196 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb76c7-4584-4123-b55b-ebfd834a5226 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:11.531899 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c33f5a-2548-4e01-833d-b3f2a8a9dfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:11.532552 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c33f5a-2548-4e01-833d-b3f2a8a9dfeb None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:11.532827 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c33f5a-2548-4e01-833d-b3f2a8a9dfeb None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:11.533097 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c33f5a-2548-4e01-833d-b3f2a8a9dfeb None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:11.533911 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c33f5a-2548-4e01-833d-b3f2a8a9dfeb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:11.534214 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c33f5a-2548-4e01-833d-b3f2a8a9dfeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:11.535654 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c33f5a-2548-4e01-833d-b3f2a8a9dfeb None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:11.554646 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 465/898] 10.222.0.73 () {56 vars in 1149 bytes} [Mon Apr 11 16:38:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:11.554646 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c33f5a-2548-4e01-833d-b3f2a8a9dfeb None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:11.563389 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaaca9-3bb3-4270-aa46-9f7e41404436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:11.564044 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaaca9-3bb3-4270-aa46-9f7e41404436 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:11.564325 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaaca9-3bb3-4270-aa46-9f7e41404436 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:11.564598 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aaaca9-3bb3-4270-aa46-9f7e41404436 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:11.565286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aaaca9-3bb3-4270-aa46-9f7e41404436 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:11.565588 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aaaca9-3bb3-4270-aa46-9f7e41404436 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:11.566970 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aaaca9-3bb3-4270-aa46-9f7e41404436 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:11.575861 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 434/899] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:38:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:11.575861 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaaca9-3bb3-4270-aa46-9f7e41404436 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:11.651522 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c33f5a-2548-4e01-833d-b3f2a8a9dfeb None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:11.672852 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aaaca9-3bb3-4270-aa46-9f7e41404436 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:11.688554 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d39689-e00c-4eff-b2e8-008028219d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:11.689495 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d39689-e00c-4eff-b2e8-008028219d0e None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:11.689965 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d39689-e00c-4eff-b2e8-008028219d0e None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:11.690438 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d39689-e00c-4eff-b2e8-008028219d0e None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:11.691330 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d39689-e00c-4eff-b2e8-008028219d0e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:11.691839 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d39689-e00c-4eff-b2e8-008028219d0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:11.693206 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d39689-e00c-4eff-b2e8-008028219d0e None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:11.702914 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 466/900] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Apr 11 16:38:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:11.704165 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d39689-e00c-4eff-b2e8-008028219d0e None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:11.713952 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58671178-c2b0-4208-9eb5-4582f48ef4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:11.714651 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58671178-c2b0-4208-9eb5-4582f48ef4d8 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:11.716940 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58671178-c2b0-4208-9eb5-4582f48ef4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:11.716940 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58671178-c2b0-4208-9eb5-4582f48ef4d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:11.811412 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58671178-c2b0-4208-9eb5-4582f48ef4d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:11.813250 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58671178-c2b0-4208-9eb5-4582f48ef4d8 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:11.823402 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d39689-e00c-4eff-b2e8-008028219d0e None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:11.858673 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5263c-b777-494f-a2cc-b0bf4b6332fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:11.859352 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5263c-b777-494f-a2cc-b0bf4b6332fd None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:11.859633 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5263c-b777-494f-a2cc-b0bf4b6332fd None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:11.859909 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f5263c-b777-494f-a2cc-b0bf4b6332fd None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:11.860626 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5263c-b777-494f-a2cc-b0bf4b6332fd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:11.860932 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5263c-b777-494f-a2cc-b0bf4b6332fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:11.862338 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f5263c-b777-494f-a2cc-b0bf4b6332fd None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:11.868471 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 467/901] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:38:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:11.875091 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5263c-b777-494f-a2cc-b0bf4b6332fd None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:11.938657 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 435/902] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:38:11 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:38:11.946313 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58671178-c2b0-4208-9eb5-4582f48ef4d8 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:11.992298 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f5263c-b777-494f-a2cc-b0bf4b6332fd None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:12.028666 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aaa40c-0b7a-49db-98e5-f899932c9eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:12.029593 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aaa40c-0b7a-49db-98e5-f899932c9eee None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:12.029877 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aaa40c-0b7a-49db-98e5-f899932c9eee None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:12.030155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aaa40c-0b7a-49db-98e5-f899932c9eee None admin] PATH_INFO: `/v3/endpoints` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:12.031126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aaa40c-0b7a-49db-98e5-f899932c9eee None admin] RBAC: Adding query filter params (interface=public, service_id=7c3c5e04badc4d4185bb0a4aae073f68, region_id=RegionOne) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:12.031438 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aaa40c-0b7a-49db-98e5-f899932c9eee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:12.033133 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aaa40c-0b7a-49db-98e5-f899932c9eee None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:12.046762 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 468/903] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Apr 11 16:38:11 2022] GET /identity/v3/endpoints?service_id=7c3c5e04badc4d4185bb0a4aae073f68&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:12.049333 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aaa40c-0b7a-49db-98e5-f899932c9eee None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:12.052098 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58671178-c2b0-4208-9eb5-4582f48ef4d8 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:12.090078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc428fcd-7bed-4c95-a81d-32df43b06baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:12.090797 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc428fcd-7bed-4c95-a81d-32df43b06baa None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:12.091082 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc428fcd-7bed-4c95-a81d-32df43b06baa None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:12.091360 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc428fcd-7bed-4c95-a81d-32df43b06baa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:12.101757 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc428fcd-7bed-4c95-a81d-32df43b06baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:12.103604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc428fcd-7bed-4c95-a81d-32df43b06baa None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:12.121163 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-cc428fcd-7bed-4c95-a81d-32df43b06baa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:12.127443 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 436/904] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:12.128468 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc428fcd-7bed-4c95-a81d-32df43b06baa None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:12.169909 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aaa40c-0b7a-49db-98e5-f899932c9eee None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:12.202957 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bb6ef-afad-46e4-ba38-8fb29be65311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:12.203891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bb6ef-afad-46e4-ba38-8fb29be65311 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:12.204021 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bb6ef-afad-46e4-ba38-8fb29be65311 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:12.204368 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bb6ef-afad-46e4-ba38-8fb29be65311 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:12.205172 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bb6ef-afad-46e4-ba38-8fb29be65311 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:12.206661 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bb6ef-afad-46e4-ba38-8fb29be65311 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:12.218618 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 469/905] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Apr 11 16:38:12 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:38:12.250821 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc428fcd-7bed-4c95-a81d-32df43b06baa None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:12.286569 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f2f20-0b90-41c9-abce-2c5d5b9c83c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:12.287272 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f2f20-0b90-41c9-abce-2c5d5b9c83c1 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:12.287558 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f2f20-0b90-41c9-abce-2c5d5b9c83c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:12.287908 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f2f20-0b90-41c9-abce-2c5d5b9c83c1 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:12.288648 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f2f20-0b90-41c9-abce-2c5d5b9c83c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:12.288959 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f2f20-0b90-41c9-abce-2c5d5b9c83c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:12.290529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f2f20-0b90-41c9-abce-2c5d5b9c83c1 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:12.303887 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 437/906] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:12.309643 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bb6ef-afad-46e4-ba38-8fb29be65311 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:12.425390 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bb6ef-afad-46e4-ba38-8fb29be65311 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:12.460618 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cf2d7-8aa0-4a7f-b951-9785d2d6a90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:12.461782 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cf2d7-8aa0-4a7f-b951-9785d2d6a90b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:12.462267 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cf2d7-8aa0-4a7f-b951-9785d2d6a90b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:12.462796 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cf2d7-8aa0-4a7f-b951-9785d2d6a90b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:12.470135 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cf2d7-8aa0-4a7f-b951-9785d2d6a90b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:12.471907 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cf2d7-8aa0-4a7f-b951-9785d2d6a90b None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:12.486425 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-786cf2d7-8aa0-4a7f-b951-9785d2d6a90b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:38:12.488248 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 470/907] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:38:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:12.493850 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f2f20-0b90-41c9-abce-2c5d5b9c83c1 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:12.596948 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f2f20-0b90-41c9-abce-2c5d5b9c83c1 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:12.630698 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b28f88-3d6c-40a8-b412-ac83af880369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:12.631875 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b28f88-3d6c-40a8-b412-ac83af880369 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:12.632203 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b28f88-3d6c-40a8-b412-ac83af880369 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:12.632478 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b28f88-3d6c-40a8-b412-ac83af880369 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:12.633269 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b28f88-3d6c-40a8-b412-ac83af880369 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:12.633576 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b28f88-3d6c-40a8-b412-ac83af880369 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:12.635029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b28f88-3d6c-40a8-b412-ac83af880369 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:12.647730 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 438/908] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:38:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:12.653340 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cf2d7-8aa0-4a7f-b951-9785d2d6a90b None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:12.754111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cf2d7-8aa0-4a7f-b951-9785d2d6a90b None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:12.789317 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b1e58-af60-467d-82ce-9d17b188c7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:12.789976 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b1e58-af60-467d-82ce-9d17b188c7a5 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:12.790259 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b1e58-af60-467d-82ce-9d17b188c7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:12.790536 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b1e58-af60-467d-82ce-9d17b188c7a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:12.791381 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b1e58-af60-467d-82ce-9d17b188c7a5 None admin] RBAC: Adding query filter params (role.id=3ff1752e60db4b41898fc8faf026d448, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=e0653575c0a24603bb9287e6222313de) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:12.791693 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b1e58-af60-467d-82ce-9d17b188c7a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:12.793113 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b1e58-af60-467d-82ce-9d17b188c7a5 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:12.802992 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 471/909] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:38:12 2022] GET /identity/v3/role_assignments?user.id=e0653575c0a24603bb9287e6222313de&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=3ff1752e60db4b41898fc8faf026d448 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:13.280471 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3064ef4-83ae-474b-83d3-eb0e23efac1d None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:13.281511 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3064ef4-83ae-474b-83d3-eb0e23efac1d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:13.282002 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3064ef4-83ae-474b-83d3-eb0e23efac1d None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:13.283835 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 439/910] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:13.289869 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01fc95-f346-473b-ba1e-e16f7f8ddcf5 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:13.290711 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01fc95-f346-473b-ba1e-e16f7f8ddcf5 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:13.291191 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01fc95-f346-473b-ba1e-e16f7f8ddcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:13.308103 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-4f01fc95-f346-473b-ba1e-e16f7f8ddcf5 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:13.309619 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4f01fc95-f346-473b-ba1e-e16f7f8ddcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:13.375728 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 472/911] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:38:13.401213 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3064ef4-83ae-474b-83d3-eb0e23efac1d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:13.505633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3064ef4-83ae-474b-83d3-eb0e23efac1d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:13.541720 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d107d4-0082-4d53-a1f0-1e051b9ebb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:13.542901 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d107d4-0082-4d53-a1f0-1e051b9ebb37 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:13.543387 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d107d4-0082-4d53-a1f0-1e051b9ebb37 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:13.543860 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d107d4-0082-4d53-a1f0-1e051b9ebb37 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:13.544722 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d107d4-0082-4d53-a1f0-1e051b9ebb37 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:13.546273 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d107d4-0082-4d53-a1f0-1e051b9ebb37 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:13.558223 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-b2d107d4-0082-4d53-a1f0-1e051b9ebb37 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 11 16:38:13.559951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 440/912] 10.222.0.73 () {56 vars in 1132 bytes} [Mon Apr 11 16:38:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:13.566005 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01fc95-f346-473b-ba1e-e16f7f8ddcf5 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:13.663092 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01fc95-f346-473b-ba1e-e16f7f8ddcf5 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:13.702364 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63483f0-5eda-4d45-b78e-e041c76d5875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:13.703059 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63483f0-5eda-4d45-b78e-e041c76d5875 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:13.703344 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63483f0-5eda-4d45-b78e-e041c76d5875 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:13.703619 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63483f0-5eda-4d45-b78e-e041c76d5875 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:13.704327 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63483f0-5eda-4d45-b78e-e041c76d5875 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:13.704632 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63483f0-5eda-4d45-b78e-e041c76d5875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:13.706013 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63483f0-5eda-4d45-b78e-e041c76d5875 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:13.711661 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 473/913] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Apr 11 16:38:13 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:13.717266 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d107d4-0082-4d53-a1f0-1e051b9ebb37 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:13.819809 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d107d4-0082-4d53-a1f0-1e051b9ebb37 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:13.854855 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f84f444-19be-488a-aa39-3f6f2bd18bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:13.855930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84f444-19be-488a-aa39-3f6f2bd18bf4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:13.856443 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84f444-19be-488a-aa39-3f6f2bd18bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:13.856914 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84f444-19be-488a-aa39-3f6f2bd18bf4 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:13.857843 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84f444-19be-488a-aa39-3f6f2bd18bf4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:13.858347 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84f444-19be-488a-aa39-3f6f2bd18bf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:13.860071 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f84f444-19be-488a-aa39-3f6f2bd18bf4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:13.866218 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 441/914] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Apr 11 16:38:13 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:13.872144 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63483f0-5eda-4d45-b78e-e041c76d5875 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:13.972917 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63483f0-5eda-4d45-b78e-e041c76d5875 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:14.005710 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac54040-00a6-403c-ba4d-261172394df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:14.006933 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac54040-00a6-403c-ba4d-261172394df7 None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:14.007218 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac54040-00a6-403c-ba4d-261172394df7 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:14.007492 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac54040-00a6-403c-ba4d-261172394df7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:14.008266 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac54040-00a6-403c-ba4d-261172394df7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:14.009711 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac54040-00a6-403c-ba4d-261172394df7 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:14.036317 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 474/915] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Apr 11 16:38:13 2022] POST /identity/v3/endpoints => generated 347 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:38:14.073531 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666ff87-4895-4d81-b720-abe843a2f0bc None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:14.074154 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666ff87-4895-4d81-b720-abe843a2f0bc None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:14.074672 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666ff87-4895-4d81-b720-abe843a2f0bc None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:14.077732 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 442/916] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:14.082774 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d87594-61fe-49fe-8d72-bfdbc4eed7ad None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:14.083065 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d87594-61fe-49fe-8d72-bfdbc4eed7ad None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:14.083403 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d87594-61fe-49fe-8d72-bfdbc4eed7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:14.103784 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-b8d87594-61fe-49fe-8d72-bfdbc4eed7ad None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:14.105152 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b8d87594-61fe-49fe-8d72-bfdbc4eed7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:14.187569 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 475/917] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:14.211937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666ff87-4895-4d81-b720-abe843a2f0bc None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:14.323208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666ff87-4895-4d81-b720-abe843a2f0bc None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:14.357993 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908432a-dc4f-44ca-916e-1979760db160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:14.358996 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908432a-dc4f-44ca-916e-1979760db160 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:14.359494 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908432a-dc4f-44ca-916e-1979760db160 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:14.359978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908432a-dc4f-44ca-916e-1979760db160 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:14.360892 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908432a-dc4f-44ca-916e-1979760db160 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:14.362467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908432a-dc4f-44ca-916e-1979760db160 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:14.382707 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 443/918] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Apr 11 16:38:14 2022] POST /identity/v3/services => generated 241 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:38:14.642562 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c189bd-ed1d-400d-9614-37ffd1f04a24 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:14.643074 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c189bd-ed1d-400d-9614-37ffd1f04a24 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:14.643149 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c189bd-ed1d-400d-9614-37ffd1f04a24 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:14.644755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 476/919] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:14.650419 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428da4df-5775-42fb-91dc-dfaedc617217 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:14.650732 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428da4df-5775-42fb-91dc-dfaedc617217 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:14.651004 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428da4df-5775-42fb-91dc-dfaedc617217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:14.668529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-428da4df-5775-42fb-91dc-dfaedc617217 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:14.669679 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-428da4df-5775-42fb-91dc-dfaedc617217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:14.742242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 444/920] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:14.766633 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c189bd-ed1d-400d-9614-37ffd1f04a24 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:14.873572 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c189bd-ed1d-400d-9614-37ffd1f04a24 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:14.910497 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d3e2b-8285-46c3-8b1b-2bde29ed8227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:14.911552 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d3e2b-8285-46c3-8b1b-2bde29ed8227 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:14.911978 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d3e2b-8285-46c3-8b1b-2bde29ed8227 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:14.912391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d3e2b-8285-46c3-8b1b-2bde29ed8227 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:14.913716 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d3e2b-8285-46c3-8b1b-2bde29ed8227 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:14.915259 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d3e2b-8285-46c3-8b1b-2bde29ed8227 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:14.926518 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-2e6d3e2b-8285-46c3-8b1b-2bde29ed8227 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 11 16:38:14.928231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 477/921] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:38:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:14.934159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428da4df-5775-42fb-91dc-dfaedc617217 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:15.038223 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428da4df-5775-42fb-91dc-dfaedc617217 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:15.071841 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329138f7-6687-4877-9647-ea56debd9cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:15.072867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329138f7-6687-4877-9647-ea56debd9cd4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:15.073342 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329138f7-6687-4877-9647-ea56debd9cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:15.073802 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329138f7-6687-4877-9647-ea56debd9cd4 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:15.074737 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329138f7-6687-4877-9647-ea56debd9cd4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:15.075256 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329138f7-6687-4877-9647-ea56debd9cd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:15.076815 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329138f7-6687-4877-9647-ea56debd9cd4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:15.082476 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 445/922] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:38:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:15.090617 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d3e2b-8285-46c3-8b1b-2bde29ed8227 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:15.190557 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d3e2b-8285-46c3-8b1b-2bde29ed8227 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:15.225547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b098fa-5ea6-4335-a89c-e81206b7fd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:15.226251 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b098fa-5ea6-4335-a89c-e81206b7fd8a None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:15.226534 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b098fa-5ea6-4335-a89c-e81206b7fd8a None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:15.226847 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b098fa-5ea6-4335-a89c-e81206b7fd8a None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:15.227581 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b098fa-5ea6-4335-a89c-e81206b7fd8a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:15.227886 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b098fa-5ea6-4335-a89c-e81206b7fd8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:15.229397 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b098fa-5ea6-4335-a89c-e81206b7fd8a None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:15.230521 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeec677-b312-4c20-95a3-5e2a3a90cda2 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:15.230832 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeec677-b312-4c20-95a3-5e2a3a90cda2 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:15.231111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeec677-b312-4c20-95a3-5e2a3a90cda2 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:15.232689 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 446/923] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:38:15.237076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 478/924] 10.222.0.73 () {56 vars in 1114 bytes} [Mon Apr 11 16:38:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:15.238715 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c997d06-0674-4b3d-a5c4-50cecc4bd72d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:15.239210 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c997d06-0674-4b3d-a5c4-50cecc4bd72d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:15.239685 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c997d06-0674-4b3d-a5c4-50cecc4bd72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:15.242888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b098fa-5ea6-4335-a89c-e81206b7fd8a None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:15.259067 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3c997d06-0674-4b3d-a5c4-50cecc4bd72d None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:15.260966 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3c997d06-0674-4b3d-a5c4-50cecc4bd72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:15.346940 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 447/925] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:38:15.348669 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b098fa-5ea6-4335-a89c-e81206b7fd8a None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:15.364857 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c997d06-0674-4b3d-a5c4-50cecc4bd72d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:15.386685 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dcbd7-656a-444a-8ae7-f82ef4777e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:15.387393 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dcbd7-656a-444a-8ae7-f82ef4777e2e None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:15.387940 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dcbd7-656a-444a-8ae7-f82ef4777e2e None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:15.388221 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dcbd7-656a-444a-8ae7-f82ef4777e2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:15.389015 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5dcbd7-656a-444a-8ae7-f82ef4777e2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:15.391421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5dcbd7-656a-444a-8ae7-f82ef4777e2e None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:15.417381 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 479/926] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Apr 11 16:38:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:38:15.475171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c997d06-0674-4b3d-a5c4-50cecc4bd72d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:15.520762 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147005f-db18-4670-94d5-b877ae8ef4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:15.522314 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147005f-db18-4670-94d5-b877ae8ef4ae None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:15.522870 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147005f-db18-4670-94d5-b877ae8ef4ae None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:15.523340 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147005f-db18-4670-94d5-b877ae8ef4ae None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:15.535543 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147005f-db18-4670-94d5-b877ae8ef4ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:38:15.544447 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-9147005f-db18-4670-94d5-b877ae8ef4ae None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 16:38:15.546536 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 448/927] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Apr 11 16:38:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:15.552887 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dcbd7-656a-444a-8ae7-f82ef4777e2e None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:15.663478 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5dcbd7-656a-444a-8ae7-f82ef4777e2e None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:15.698044 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f8486-c671-4985-af0a-90c94ae20829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:15.699099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f8486-c671-4985-af0a-90c94ae20829 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:15.699680 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f8486-c671-4985-af0a-90c94ae20829 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:15.700145 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f8486-c671-4985-af0a-90c94ae20829 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:15.701073 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f8486-c671-4985-af0a-90c94ae20829 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:15.701575 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f8486-c671-4985-af0a-90c94ae20829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:15.703169 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f8486-c671-4985-af0a-90c94ae20829 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:15.711763 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 480/928] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Apr 11 16:38:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:15.718952 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147005f-db18-4670-94d5-b877ae8ef4ae None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:15.819990 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147005f-db18-4670-94d5-b877ae8ef4ae None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:15.854081 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfd60d-4364-4289-8988-ad4a1e474b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:15.855254 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfd60d-4364-4289-8988-ad4a1e474b73 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:15.855762 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfd60d-4364-4289-8988-ad4a1e474b73 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:15.856233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dfd60d-4364-4289-8988-ad4a1e474b73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:15.867297 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfd60d-4364-4289-8988-ad4a1e474b73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:15.869009 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dfd60d-4364-4289-8988-ad4a1e474b73 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:15.885458 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-a9dfd60d-4364-4289-8988-ad4a1e474b73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:15.887463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 449/929] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:15.894445 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f8486-c671-4985-af0a-90c94ae20829 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:15.993253 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f8486-c671-4985-af0a-90c94ae20829 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:16.027040 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e05d71-504a-4330-a3cb-748aa9405255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:16.027719 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e05d71-504a-4330-a3cb-748aa9405255 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:16.027998 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e05d71-504a-4330-a3cb-748aa9405255 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:16.028268 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e05d71-504a-4330-a3cb-748aa9405255 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:16.028996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e05d71-504a-4330-a3cb-748aa9405255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:16.029301 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e05d71-504a-4330-a3cb-748aa9405255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:16.030754 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e05d71-504a-4330-a3cb-748aa9405255 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:16.045305 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 481/930] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:16.051106 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfd60d-4364-4289-8988-ad4a1e474b73 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:16.160880 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dfd60d-4364-4289-8988-ad4a1e474b73 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:16.195545 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dadb4b-a08d-4e28-ab0e-a4eec14b425d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:16.196743 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dadb4b-a08d-4e28-ab0e-a4eec14b425d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:16.197243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dadb4b-a08d-4e28-ab0e-a4eec14b425d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:16.197712 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dadb4b-a08d-4e28-ab0e-a4eec14b425d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:16.205991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dadb4b-a08d-4e28-ab0e-a4eec14b425d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:16.207804 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dadb4b-a08d-4e28-ab0e-a4eec14b425d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:16.221980 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-d7dadb4b-a08d-4e28-ab0e-a4eec14b425d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 16:38:16.223746 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 450/931] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Apr 11 16:38:16 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:16.230107 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e05d71-504a-4330-a3cb-748aa9405255 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:16.331395 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e05d71-504a-4330-a3cb-748aa9405255 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:16.365256 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f923372-59a4-4cae-a054-41012ff27042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:16.366379 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f923372-59a4-4cae-a054-41012ff27042 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:16.366883 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f923372-59a4-4cae-a054-41012ff27042 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:16.367361 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f923372-59a4-4cae-a054-41012ff27042 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:16.368379 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f923372-59a4-4cae-a054-41012ff27042 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:16.368880 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f923372-59a4-4cae-a054-41012ff27042 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:16.370500 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f923372-59a4-4cae-a054-41012ff27042 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:16.390141 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 482/932] 10.222.0.73 () {56 vars in 1149 bytes} [Mon Apr 11 16:38:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:16.396429 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dadb4b-a08d-4e28-ab0e-a4eec14b425d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:16.416526 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456cda6-893c-48d0-af91-c78dec3273a8 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:16.416813 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456cda6-893c-48d0-af91-c78dec3273a8 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:16.417010 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456cda6-893c-48d0-af91-c78dec3273a8 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:16.418816 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 483/933] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:38:16.423856 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2deede-ddb0-4155-87b9-34a625201c3f None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:16.424139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2deede-ddb0-4155-87b9-34a625201c3f None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:16.424415 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2deede-ddb0-4155-87b9-34a625201c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:16.443223 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-2e2deede-ddb0-4155-87b9-34a625201c3f None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:16.444937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-2e2deede-ddb0-4155-87b9-34a625201c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:16.503806 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dadb4b-a08d-4e28-ab0e-a4eec14b425d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:16.516295 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 484/934] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:38:16.543875 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2deede-ddb0-4155-87b9-34a625201c3f None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:16.545581 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0495b7-028c-430e-8375-1f257e22ce68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:16.546696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0495b7-028c-430e-8375-1f257e22ce68 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:16.547146 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0495b7-028c-430e-8375-1f257e22ce68 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:16.547422 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0495b7-028c-430e-8375-1f257e22ce68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:16.560937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0495b7-028c-430e-8375-1f257e22ce68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:16.562376 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0495b7-028c-430e-8375-1f257e22ce68 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:16.579582 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-9e0495b7-028c-430e-8375-1f257e22ce68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:16.581060 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 451/935] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:16.586693 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0495b7-028c-430e-8375-1f257e22ce68 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:16.659726 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2deede-ddb0-4155-87b9-34a625201c3f None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:16.695194 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf993a-5c66-4a14-90bb-2ec0d3382244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:16.695958 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf993a-5c66-4a14-90bb-2ec0d3382244 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:16.696213 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf993a-5c66-4a14-90bb-2ec0d3382244 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:16.696483 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf993a-5c66-4a14-90bb-2ec0d3382244 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:16.697135 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf993a-5c66-4a14-90bb-2ec0d3382244 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:16.698688 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edf993a-5c66-4a14-90bb-2ec0d3382244 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:16.707882 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0495b7-028c-430e-8375-1f257e22ce68 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:16.710377 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-2edf993a-5c66-4a14-90bb-2ec0d3382244 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 11 16:38:16.716939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 485/936] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:38:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:16.720417 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf993a-5c66-4a14-90bb-2ec0d3382244 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:16.748328 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78991c4c-9aa2-43bf-9ea9-4b24c7427770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:16.749058 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78991c4c-9aa2-43bf-9ea9-4b24c7427770 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:16.749588 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78991c4c-9aa2-43bf-9ea9-4b24c7427770 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:16.749874 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78991c4c-9aa2-43bf-9ea9-4b24c7427770 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:16.750618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78991c4c-9aa2-43bf-9ea9-4b24c7427770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:16.751081 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78991c4c-9aa2-43bf-9ea9-4b24c7427770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:16.753294 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78991c4c-9aa2-43bf-9ea9-4b24c7427770 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:16.773184 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 452/937] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:16.778335 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78991c4c-9aa2-43bf-9ea9-4b24c7427770 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:16.827555 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf993a-5c66-4a14-90bb-2ec0d3382244 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:16.860092 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd21c50-311e-47d5-99b3-775437fdbf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:16.860755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd21c50-311e-47d5-99b3-775437fdbf55 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:16.861036 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd21c50-311e-47d5-99b3-775437fdbf55 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:16.861312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd21c50-311e-47d5-99b3-775437fdbf55 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:16.862005 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd21c50-311e-47d5-99b3-775437fdbf55 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:16.862313 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd21c50-311e-47d5-99b3-775437fdbf55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:16.863775 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd21c50-311e-47d5-99b3-775437fdbf55 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:16.873252 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 486/938] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Apr 11 16:38:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:16.873252 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba652fe1-7023-4241-9bd0-0279d9681a57 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:16.873252 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba652fe1-7023-4241-9bd0-0279d9681a57 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:16.873252 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba652fe1-7023-4241-9bd0-0279d9681a57 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:16.873252 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 487/939] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:16.876629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba652fe1-7023-4241-9bd0-0279d9681a57 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:16.879609 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78991c4c-9aa2-43bf-9ea9-4b24c7427770 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:16.917773 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ca3b2-eb2e-46b1-a50c-3ee94b4aef7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:16.918572 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ca3b2-eb2e-46b1-a50c-3ee94b4aef7a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:16.918881 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ca3b2-eb2e-46b1-a50c-3ee94b4aef7a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:16.919153 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ca3b2-eb2e-46b1-a50c-3ee94b4aef7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:16.925645 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ca3b2-eb2e-46b1-a50c-3ee94b4aef7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:16.927109 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ca3b2-eb2e-46b1-a50c-3ee94b4aef7a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:16.940429 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-494ca3b2-eb2e-46b1-a50c-3ee94b4aef7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:38:16.941842 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 453/940] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:38:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:16.947647 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bce56-f487-41c0-9e39-2f7a134ee513 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:16.947877 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bce56-f487-41c0-9e39-2f7a134ee513 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:16.948094 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70bce56-f487-41c0-9e39-2f7a134ee513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:16.964722 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c70bce56-f487-41c0-9e39-2f7a134ee513 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:16.965971 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c70bce56-f487-41c0-9e39-2f7a134ee513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:16.986074 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba652fe1-7023-4241-9bd0-0279d9681a57 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:17.018738 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037622b4-302d-4b81-872a-7a2d6f6886f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:17.019392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037622b4-302d-4b81-872a-7a2d6f6886f1 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:17.019667 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037622b4-302d-4b81-872a-7a2d6f6886f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:17.019937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037622b4-302d-4b81-872a-7a2d6f6886f1 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:17.020633 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037622b4-302d-4b81-872a-7a2d6f6886f1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:17.020930 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037622b4-302d-4b81-872a-7a2d6f6886f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:17.022849 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037622b4-302d-4b81-872a-7a2d6f6886f1 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:17.027153 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 488/941] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Apr 11 16:38:16 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:17.027912 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037622b4-302d-4b81-872a-7a2d6f6886f1 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:17.059078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 454/942] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:17.075844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bce56-f487-41c0-9e39-2f7a134ee513 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:17.155426 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037622b4-302d-4b81-872a-7a2d6f6886f1 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:17.184097 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70bce56-f487-41c0-9e39-2f7a134ee513 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:17.204278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0eba1-9355-4940-82cf-b7c0cd8fd3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:17.205182 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0eba1-9355-4940-82cf-b7c0cd8fd3c4 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:17.205624 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0eba1-9355-4940-82cf-b7c0cd8fd3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:17.206556 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0eba1-9355-4940-82cf-b7c0cd8fd3c4 None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:17.207831 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0eba1-9355-4940-82cf-b7c0cd8fd3c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:17.208308 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0eba1-9355-4940-82cf-b7c0cd8fd3c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:17.210785 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0eba1-9355-4940-82cf-b7c0cd8fd3c4 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:17.225558 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93511dae-c5ce-4c6c-9ade-3a92baad481a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:17.226368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93511dae-c5ce-4c6c-9ade-3a92baad481a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:17.226906 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93511dae-c5ce-4c6c-9ade-3a92baad481a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:17.227010 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 489/943] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:38:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:17.227087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93511dae-c5ce-4c6c-9ade-3a92baad481a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:17.227616 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93511dae-c5ce-4c6c-9ade-3a92baad481a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:17.228951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93511dae-c5ce-4c6c-9ade-3a92baad481a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:17.233093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0eba1-9355-4940-82cf-b7c0cd8fd3c4 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:17.245382 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-93511dae-c5ce-4c6c-9ade-3a92baad481a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 16:38:17.247646 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 455/944] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Apr 11 16:38:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:17.253448 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93511dae-c5ce-4c6c-9ade-3a92baad481a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:17.336129 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0eba1-9355-4940-82cf-b7c0cd8fd3c4 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:17.370304 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf3cd4-43f3-4369-bbdf-25f12aced8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:17.371268 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf3cd4-43f3-4369-bbdf-25f12aced8d0 None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:17.371553 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf3cd4-43f3-4369-bbdf-25f12aced8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:17.371828 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf3cd4-43f3-4369-bbdf-25f12aced8d0 None admin] PATH_INFO: `/v3/projects/c1eb8559ca744abda7039b767af5818f/users/e0653575c0a24603bb9287e6222313de/roles/3ff1752e60db4b41898fc8faf026d448` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:17.374068 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf3cd4-43f3-4369-bbdf-25f12aced8d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1eb8559ca744abda7039b767af5818f, user_id=e0653575c0a24603bb9287e6222313de, role_id=3ff1752e60db4b41898fc8faf026d448)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:17.375535 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf3cd4-43f3-4369-bbdf-25f12aced8d0 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:17.379466 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93511dae-c5ce-4c6c-9ade-3a92baad481a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:17.398615 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 490/945] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:38:17 2022] PUT /identity/v3/projects/c1eb8559ca744abda7039b767af5818f/users/e0653575c0a24603bb9287e6222313de/roles/3ff1752e60db4b41898fc8faf026d448 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:38:17.425028 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a4bd8-d5ef-4105-8b51-e905ae27ccf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:17.425799 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a4bd8-d5ef-4105-8b51-e905ae27ccf7 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:17.425988 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a4bd8-d5ef-4105-8b51-e905ae27ccf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:17.426267 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a4bd8-d5ef-4105-8b51-e905ae27ccf7 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:17.427036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a4bd8-d5ef-4105-8b51-e905ae27ccf7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:17.427348 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a4bd8-d5ef-4105-8b51-e905ae27ccf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:17.429397 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a4bd8-d5ef-4105-8b51-e905ae27ccf7 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:17.435437 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 456/946] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Apr 11 16:38:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:17.440866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf3cd4-43f3-4369-bbdf-25f12aced8d0 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:17.561008 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf3cd4-43f3-4369-bbdf-25f12aced8d0 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:17.597883 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d22ba3-c3be-484d-a39b-9af80c14ecdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:17.598970 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d22ba3-c3be-484d-a39b-9af80c14ecdb None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:17.599495 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d22ba3-c3be-484d-a39b-9af80c14ecdb None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:17.600033 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d22ba3-c3be-484d-a39b-9af80c14ecdb None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:17.600939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d22ba3-c3be-484d-a39b-9af80c14ecdb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:17.601445 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d22ba3-c3be-484d-a39b-9af80c14ecdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:17.603074 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d22ba3-c3be-484d-a39b-9af80c14ecdb None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:17.608640 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 491/947] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Apr 11 16:38:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:17.614228 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a4bd8-d5ef-4105-8b51-e905ae27ccf7 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:17.720622 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a4bd8-d5ef-4105-8b51-e905ae27ccf7 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:17.754300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814cacbb-1e67-497c-a7a3-6eed9a610de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:17.755046 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cacbb-1e67-497c-a7a3-6eed9a610de3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:17.755330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cacbb-1e67-497c-a7a3-6eed9a610de3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:17.755603 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814cacbb-1e67-497c-a7a3-6eed9a610de3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:17.756933 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814cacbb-1e67-497c-a7a3-6eed9a610de3 None admin] RBAC: Adding query filter params (interface=public, service_id=ea3d57a8b56f46c49bb8609acea597cf, region_id=RegionOne) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:17.757239 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814cacbb-1e67-497c-a7a3-6eed9a610de3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:17.758599 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814cacbb-1e67-497c-a7a3-6eed9a610de3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:17.764135 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 457/948] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Apr 11 16:38:17 2022] GET /identity/v3/endpoints?service_id=ea3d57a8b56f46c49bb8609acea597cf&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:17.769931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d22ba3-c3be-484d-a39b-9af80c14ecdb None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:17.874792 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d22ba3-c3be-484d-a39b-9af80c14ecdb None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:17.899622 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b3b88-60cf-41f5-a001-87711f1952f4 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:17.899950 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b3b88-60cf-41f5-a001-87711f1952f4 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:17.900185 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910b3b88-60cf-41f5-a001-87711f1952f4 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:17.901767 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 458/949] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:17.906973 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0a639-87b6-45c8-a6dc-2ae82a162e3b None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:17.907522 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0a639-87b6-45c8-a6dc-2ae82a162e3b None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:17.908022 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0a639-87b6-45c8-a6dc-2ae82a162e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:17.913528 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1903c-381c-430a-ac2b-9f7dc22afbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:17.914195 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1903c-381c-430a-ac2b-9f7dc22afbda None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:17.914481 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1903c-381c-430a-ac2b-9f7dc22afbda None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:17.914806 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb1903c-381c-430a-ac2b-9f7dc22afbda None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:17.915471 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1903c-381c-430a-ac2b-9f7dc22afbda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:17.916849 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb1903c-381c-430a-ac2b-9f7dc22afbda None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:17.926637 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 492/950] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Apr 11 16:38:17 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:38:17.935789 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-fec0a639-87b6-45c8-a6dc-2ae82a162e3b None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:17.942032 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-fec0a639-87b6-45c8-a6dc-2ae82a162e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:18.015542 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 459/951] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:18.040583 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1903c-381c-430a-ac2b-9f7dc22afbda None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:18.149602 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb1903c-381c-430a-ac2b-9f7dc22afbda None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:18.183102 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd14cce-8024-4b27-867b-d93da15e5d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:18.183760 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd14cce-8024-4b27-867b-d93da15e5d77 None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:18.184039 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd14cce-8024-4b27-867b-d93da15e5d77 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:18.184309 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd14cce-8024-4b27-867b-d93da15e5d77 None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:18.185012 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd14cce-8024-4b27-867b-d93da15e5d77 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:18.186436 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd14cce-8024-4b27-867b-d93da15e5d77 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:18.187832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.common [None req-bbd14cce-8024-4b27-867b-d93da15e5d77 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 11 16:38:18.205296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.sql.core [None req-bbd14cce-8024-4b27-867b-d93da15e5d77 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 11 16:38:18.205296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 11 16:38:18.205296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [parameters: {'id': '7079af0bc34441f6b15f2a0d80d8f37c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 11 16:38:18.205296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86346) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 11 16:38:18.221607 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-bbd14cce-8024-4b27-867b-d93da15e5d77 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7079af0bc34441f6b15f2a0d80d8f37c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7079af0bc34441f6b15f2a0d80d8f37c. Apr 11 16:38:18.223577 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 493/952] 10.222.0.73 () {60 vars in 1140 bytes} [Mon Apr 11 16:38:18 2022] POST /identity/v3/projects => generated 262 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:18.229330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0a639-87b6-45c8-a6dc-2ae82a162e3b None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:18.329344 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0a639-87b6-45c8-a6dc-2ae82a162e3b None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:18.362932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ab7299-e5c6-416b-89db-1390485f927f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:18.363722 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab7299-e5c6-416b-89db-1390485f927f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:18.364002 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab7299-e5c6-416b-89db-1390485f927f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:18.364272 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ab7299-e5c6-416b-89db-1390485f927f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:18.371438 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab7299-e5c6-416b-89db-1390485f927f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:18.372856 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ab7299-e5c6-416b-89db-1390485f927f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:18.385485 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-f7ab7299-e5c6-416b-89db-1390485f927f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:38:18.386671 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 460/953] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:38:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:18.393188 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd14cce-8024-4b27-867b-d93da15e5d77 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:18.501404 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd14cce-8024-4b27-867b-d93da15e5d77 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:18.533936 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c681e7e-4c77-4308-8a25-b701ddebfe27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:18.535077 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c681e7e-4c77-4308-8a25-b701ddebfe27 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:18.535629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c681e7e-4c77-4308-8a25-b701ddebfe27 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:18.536103 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c681e7e-4c77-4308-8a25-b701ddebfe27 None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:18.537062 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c681e7e-4c77-4308-8a25-b701ddebfe27 None admin] RBAC: Adding query filter params (name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:18.538144 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c681e7e-4c77-4308-8a25-b701ddebfe27 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:18.540040 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c681e7e-4c77-4308-8a25-b701ddebfe27 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:18.560651 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 494/954] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Apr 11 16:38:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:19.500539 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3f49f-f965-43bb-9e14-f577f64b6920 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:19.501055 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3f49f-f965-43bb-9e14-f577f64b6920 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:19.501055 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3f49f-f965-43bb-9e14-f577f64b6920 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:19.502720 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 461/955] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:19.507952 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7c618-3a7b-410a-b5c8-93c8ce23d7e9 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:19.508352 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7c618-3a7b-410a-b5c8-93c8ce23d7e9 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:19.508519 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f7c618-3a7b-410a-b5c8-93c8ce23d7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:19.526278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-36f7c618-3a7b-410a-b5c8-93c8ce23d7e9 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:19.527783 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-36f7c618-3a7b-410a-b5c8-93c8ce23d7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:19.600460 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 495/956] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:19.624063 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3f49f-f965-43bb-9e14-f577f64b6920 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:19.725420 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3f49f-f965-43bb-9e14-f577f64b6920 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:19.760244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6d585-4faa-44ec-839d-1327f8094b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:19.760833 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6d585-4faa-44ec-839d-1327f8094b89 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:19.761156 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6d585-4faa-44ec-839d-1327f8094b89 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:19.761437 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6d585-4faa-44ec-839d-1327f8094b89 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:19.762170 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6d585-4faa-44ec-839d-1327f8094b89 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:19.763575 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6d585-4faa-44ec-839d-1327f8094b89 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:19.780045 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 462/957] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Apr 11 16:38:19 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:38:19.828432 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbe9f0-5aa2-46c0-95a6-92af21f52696 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:19.828779 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbe9f0-5aa2-46c0-95a6-92af21f52696 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:19.829004 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fbe9f0-5aa2-46c0-95a6-92af21f52696 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:19.830745 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 496/958] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:19.836385 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94da888-a8f2-4171-9101-63263b88873a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:19.836675 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94da888-a8f2-4171-9101-63263b88873a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:19.836957 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94da888-a8f2-4171-9101-63263b88873a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:19.855718 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-e94da888-a8f2-4171-9101-63263b88873a None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:19.856989 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e94da888-a8f2-4171-9101-63263b88873a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:19.935674 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 463/959] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:19.962770 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbe9f0-5aa2-46c0-95a6-92af21f52696 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:20.067443 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fbe9f0-5aa2-46c0-95a6-92af21f52696 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:20.101111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c804c-5f1a-42ec-8943-8e159fb01d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:20.101979 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c804c-5f1a-42ec-8943-8e159fb01d1f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:20.102263 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c804c-5f1a-42ec-8943-8e159fb01d1f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:20.102578 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17c804c-5f1a-42ec-8943-8e159fb01d1f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:20.112709 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17c804c-5f1a-42ec-8943-8e159fb01d1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:38:20.120691 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-a17c804c-5f1a-42ec-8943-8e159fb01d1f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 16:38:20.122253 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 497/960] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Apr 11 16:38:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:20.128218 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94da888-a8f2-4171-9101-63263b88873a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:20.226763 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94da888-a8f2-4171-9101-63263b88873a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:20.260552 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381060c1-428a-484d-9ceb-d986aac0a7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:20.261225 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381060c1-428a-484d-9ceb-d986aac0a7a7 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:20.261507 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381060c1-428a-484d-9ceb-d986aac0a7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:20.261783 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381060c1-428a-484d-9ceb-d986aac0a7a7 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:20.262530 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381060c1-428a-484d-9ceb-d986aac0a7a7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:20.262866 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381060c1-428a-484d-9ceb-d986aac0a7a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:20.264482 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381060c1-428a-484d-9ceb-d986aac0a7a7 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:20.277557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 464/961] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Apr 11 16:38:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:20.282844 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c804c-5f1a-42ec-8943-8e159fb01d1f None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:20.353167 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17641314-401f-465c-a121-d865fd4c2c0f None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:20.353775 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17641314-401f-465c-a121-d865fd4c2c0f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:20.354253 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17641314-401f-465c-a121-d865fd4c2c0f None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:20.356149 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 465/962] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:38:20.361323 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24563e65-8995-4d89-8b93-a050f2a86a26 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:20.361839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24563e65-8995-4d89-8b93-a050f2a86a26 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:20.362341 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24563e65-8995-4d89-8b93-a050f2a86a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:20.379283 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-24563e65-8995-4d89-8b93-a050f2a86a26 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:20.380766 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-24563e65-8995-4d89-8b93-a050f2a86a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:20.385611 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17c804c-5f1a-42ec-8943-8e159fb01d1f None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:20.427946 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43250b-c13f-4c45-8252-b159119a33be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:20.429106 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43250b-c13f-4c45-8252-b159119a33be None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:20.429465 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43250b-c13f-4c45-8252-b159119a33be None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:20.429751 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43250b-c13f-4c45-8252-b159119a33be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:20.442672 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43250b-c13f-4c45-8252-b159119a33be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:20.444842 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43250b-c13f-4c45-8252-b159119a33be None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:20.459141 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 466/963] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:20.464650 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-7f43250b-c13f-4c45-8252-b159119a33be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:20.466133 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 498/964] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:20.471918 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24563e65-8995-4d89-8b93-a050f2a86a26 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:20.485043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43250b-c13f-4c45-8252-b159119a33be None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:20.593399 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43250b-c13f-4c45-8252-b159119a33be None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:20.596374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24563e65-8995-4d89-8b93-a050f2a86a26 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:20.632414 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2c8e5-6c14-4488-8e45-4bd8bb6860a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:20.633621 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2c8e5-6c14-4488-8e45-4bd8bb6860a0 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:20.634104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2c8e5-6c14-4488-8e45-4bd8bb6860a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:20.634576 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e2c8e5-6c14-4488-8e45-4bd8bb6860a0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:20.635585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2c8e5-6c14-4488-8e45-4bd8bb6860a0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:20.637235 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e2c8e5-6c14-4488-8e45-4bd8bb6860a0 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:20.641606 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e12a3-d547-4cef-9603-1400f7c1dc8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:20.642277 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e12a3-d547-4cef-9603-1400f7c1dc8c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:20.642561 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e12a3-d547-4cef-9603-1400f7c1dc8c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:20.642861 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e12a3-d547-4cef-9603-1400f7c1dc8c None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:20.643585 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e12a3-d547-4cef-9603-1400f7c1dc8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:20.643892 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e12a3-d547-4cef-9603-1400f7c1dc8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:20.645249 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e12a3-d547-4cef-9603-1400f7c1dc8c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:20.650949 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-13e2c8e5-6c14-4488-8e45-4bd8bb6860a0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 16:38:20.652690 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 499/965] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Apr 11 16:38:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:20.658476 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 467/966] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:20.663716 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2c8e5-6c14-4488-8e45-4bd8bb6860a0 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:20.663975 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e12a3-d547-4cef-9603-1400f7c1dc8c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:20.767936 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e12a3-d547-4cef-9603-1400f7c1dc8c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:20.780986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e2c8e5-6c14-4488-8e45-4bd8bb6860a0 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:20.803057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b47643-4c95-469c-b568-9006518a5e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:20.803939 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b47643-4c95-469c-b568-9006518a5e63 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:20.804220 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b47643-4c95-469c-b568-9006518a5e63 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:20.804463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b47643-4c95-469c-b568-9006518a5e63 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:20.812460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b47643-4c95-469c-b568-9006518a5e63 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:20.813734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b47643-4c95-469c-b568-9006518a5e63 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:20.817631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece4c24-848d-4875-9abf-0f2ae3e9d464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:20.818560 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece4c24-848d-4875-9abf-0f2ae3e9d464 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:20.819065 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece4c24-848d-4875-9abf-0f2ae3e9d464 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:20.819554 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece4c24-848d-4875-9abf-0f2ae3e9d464 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:20.820469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece4c24-848d-4875-9abf-0f2ae3e9d464 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:20.820974 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece4c24-848d-4875-9abf-0f2ae3e9d464 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:20.822521 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece4c24-848d-4875-9abf-0f2ae3e9d464 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:20.832212 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-c1b47643-4c95-469c-b568-9006518a5e63 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 16:38:20.832793 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 500/967] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Apr 11 16:38:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:20.833804 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 468/968] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Apr 11 16:38:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:20.834923 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece4c24-848d-4875-9abf-0f2ae3e9d464 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:20.835360 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b47643-4c95-469c-b568-9006518a5e63 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:20.935995 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece4c24-848d-4875-9abf-0f2ae3e9d464 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:20.937376 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b47643-4c95-469c-b568-9006518a5e63 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:20.971720 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e5d08-2611-44c3-a35c-94602f16c189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:20.972376 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e5d08-2611-44c3-a35c-94602f16c189 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:20.972649 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e5d08-2611-44c3-a35c-94602f16c189 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:20.972927 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e5d08-2611-44c3-a35c-94602f16c189 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:20.973759 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e5d08-2611-44c3-a35c-94602f16c189 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:20.974070 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e5d08-2611-44c3-a35c-94602f16c189 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:20.974739 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfd99d-825f-430d-8241-fef130a10991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:20.975615 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfd99d-825f-430d-8241-fef130a10991 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:20.975733 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e5d08-2611-44c3-a35c-94602f16c189 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:20.976221 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfd99d-825f-430d-8241-fef130a10991 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:20.976705 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfd99d-825f-430d-8241-fef130a10991 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:20.977593 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfd99d-825f-430d-8241-fef130a10991 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:20.978094 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfd99d-825f-430d-8241-fef130a10991 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:20.979684 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfd99d-825f-430d-8241-fef130a10991 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:20.985261 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 501/969] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Apr 11 16:38:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:20.986808 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10f037-9f5f-42d2-b93f-cac340b992f9 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:20.987297 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10f037-9f5f-42d2-b93f-cac340b992f9 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:20.987773 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d10f037-9f5f-42d2-b93f-cac340b992f9 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:20.989420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 502/970] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:20.994703 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10f037-9f5f-42d2-b93f-cac340b992f9 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:20.998622 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 469/971] 10.222.0.73 () {56 vars in 1149 bytes} [Mon Apr 11 16:38:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:20.998622 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a1b0c-2070-433d-87c9-64a842bdc327 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:20.998622 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a1b0c-2070-433d-87c9-64a842bdc327 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:20.998622 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a1b0c-2070-433d-87c9-64a842bdc327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:21.014430 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c94a1b0c-2070-433d-87c9-64a842bdc327 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:21.015608 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c94a1b0c-2070-433d-87c9-64a842bdc327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:21.086380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 470/972] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:20 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:21.087180 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a1b0c-2070-433d-87c9-64a842bdc327 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:21.102296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d10f037-9f5f-42d2-b93f-cac340b992f9 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:21.136166 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29329327-5b6d-4c28-9743-c6236d8ae272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:21.136819 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29329327-5b6d-4c28-9743-c6236d8ae272 None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:21.137138 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29329327-5b6d-4c28-9743-c6236d8ae272 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:21.137367 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29329327-5b6d-4c28-9743-c6236d8ae272 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:21.138104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29329327-5b6d-4c28-9743-c6236d8ae272 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:21.139763 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29329327-5b6d-4c28-9743-c6236d8ae272 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:21.157621 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 503/973] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Apr 11 16:38:20 2022] POST /identity/v3/endpoints => generated 349 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:38:21.158391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29329327-5b6d-4c28-9743-c6236d8ae272 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:21.213234 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a1b0c-2070-433d-87c9-64a842bdc327 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:21.268423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dc6f8-c0d0-4340-92ee-92b42d9c4924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:21.269099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dc6f8-c0d0-4340-92ee-92b42d9c4924 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:21.269385 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dc6f8-c0d0-4340-92ee-92b42d9c4924 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:21.269662 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dc6f8-c0d0-4340-92ee-92b42d9c4924 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:21.275552 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29329327-5b6d-4c28-9743-c6236d8ae272 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:21.314450 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da63ce-6246-49a7-8216-9d0327cc85c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:21.315540 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da63ce-6246-49a7-8216-9d0327cc85c0 None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:21.316029 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da63ce-6246-49a7-8216-9d0327cc85c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:21.316515 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da63ce-6246-49a7-8216-9d0327cc85c0 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:21.317418 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da63ce-6246-49a7-8216-9d0327cc85c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:21.319674 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da63ce-6246-49a7-8216-9d0327cc85c0 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:21.333342 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.sql.core [None req-b0da63ce-6246-49a7-8216-9d0327cc85c0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 11 16:38:21.333342 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 11 16:38:21.333342 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [parameters: {'user_id': '11a88999c4db445bbbc7e7880a1b728a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 11 16:38:21.333342 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86346) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 11 16:38:21.341720 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-b0da63ce-6246-49a7-8216-9d0327cc85c0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 11 16:38:21.348669 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 504/974] 10.222.0.73 () {60 vars in 1131 bytes} [Mon Apr 11 16:38:21 2022] POST /identity/v3/users => generated 160 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:21.350303 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da63ce-6246-49a7-8216-9d0327cc85c0 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:21.356089 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dc6f8-c0d0-4340-92ee-92b42d9c4924 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:21.357803 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dc6f8-c0d0-4340-92ee-92b42d9c4924 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:21.472357 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da63ce-6246-49a7-8216-9d0327cc85c0 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:21.473255 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 471/975] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:38:21 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:38:21.478575 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dc6f8-c0d0-4340-92ee-92b42d9c4924 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:21.515674 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767f601-95f3-45de-b42c-3eb0ea34ff7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:21.516500 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767f601-95f3-45de-b42c-3eb0ea34ff7d None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:21.516783 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767f601-95f3-45de-b42c-3eb0ea34ff7d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:21.517053 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4767f601-95f3-45de-b42c-3eb0ea34ff7d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:21.525546 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767f601-95f3-45de-b42c-3eb0ea34ff7d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:21.527261 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4767f601-95f3-45de-b42c-3eb0ea34ff7d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:21.541676 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-4767f601-95f3-45de-b42c-3eb0ea34ff7d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 16:38:21.543301 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 505/976] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:38:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:21.548907 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767f601-95f3-45de-b42c-3eb0ea34ff7d None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:21.581174 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dc6f8-c0d0-4340-92ee-92b42d9c4924 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:21.614984 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4378-586d-4b05-a3f6-20aec803d050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:21.616313 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4378-586d-4b05-a3f6-20aec803d050 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:21.616596 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4378-586d-4b05-a3f6-20aec803d050 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:21.617248 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d4378-586d-4b05-a3f6-20aec803d050 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:21.627189 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d4378-586d-4b05-a3f6-20aec803d050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:21.628724 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d4378-586d-4b05-a3f6-20aec803d050 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:21.647269 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-fc9d4378-586d-4b05-a3f6-20aec803d050 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:21.648771 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 472/977] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:21.650762 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4767f601-95f3-45de-b42c-3eb0ea34ff7d None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:21.654275 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4378-586d-4b05-a3f6-20aec803d050 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:21.684568 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ad3b6-fddb-4a1f-831d-b419a9bd3628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:21.685238 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ad3b6-fddb-4a1f-831d-b419a9bd3628 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:21.685522 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ad3b6-fddb-4a1f-831d-b419a9bd3628 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:21.685797 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ad3b6-fddb-4a1f-831d-b419a9bd3628 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:21.686619 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ad3b6-fddb-4a1f-831d-b419a9bd3628 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:21.686941 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ad3b6-fddb-4a1f-831d-b419a9bd3628 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:21.688367 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ad3b6-fddb-4a1f-831d-b419a9bd3628 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:21.734783 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 506/978] 10.222.0.73 () {56 vars in 1101 bytes} [Mon Apr 11 16:38:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:21.756268 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d4378-586d-4b05-a3f6-20aec803d050 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:21.793879 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d20a59-bb36-4415-9de5-c7194626f44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:21.794645 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d20a59-bb36-4415-9de5-c7194626f44f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:21.794932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d20a59-bb36-4415-9de5-c7194626f44f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:21.795207 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d20a59-bb36-4415-9de5-c7194626f44f None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:21.795950 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d20a59-bb36-4415-9de5-c7194626f44f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:21.796256 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d20a59-bb36-4415-9de5-c7194626f44f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:21.797671 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d20a59-bb36-4415-9de5-c7194626f44f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:21.811516 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 473/979] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:21.817299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ad3b6-fddb-4a1f-831d-b419a9bd3628 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:21.934318 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ad3b6-fddb-4a1f-831d-b419a9bd3628 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:21.970230 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df855f72-8c81-45af-8187-060f6b917c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:21.971072 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df855f72-8c81-45af-8187-060f6b917c65 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:21.971355 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df855f72-8c81-45af-8187-060f6b917c65 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:21.971631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df855f72-8c81-45af-8187-060f6b917c65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:21.978867 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df855f72-8c81-45af-8187-060f6b917c65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:21.980335 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df855f72-8c81-45af-8187-060f6b917c65 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:21.994050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-df855f72-8c81-45af-8187-060f6b917c65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:38:21.995550 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 507/980] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:38:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:22.001356 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d20a59-bb36-4415-9de5-c7194626f44f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:22.104380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d20a59-bb36-4415-9de5-c7194626f44f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:22.136441 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ace943-08a9-41a5-83c2-eb7ca0151577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:22.137095 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ace943-08a9-41a5-83c2-eb7ca0151577 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:22.137378 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ace943-08a9-41a5-83c2-eb7ca0151577 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:22.137654 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ace943-08a9-41a5-83c2-eb7ca0151577 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:22.138432 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ace943-08a9-41a5-83c2-eb7ca0151577 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:22.138771 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ace943-08a9-41a5-83c2-eb7ca0151577 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:22.140445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ace943-08a9-41a5-83c2-eb7ca0151577 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:22.152171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 474/981] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:38:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:22.157972 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df855f72-8c81-45af-8187-060f6b917c65 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:22.252852 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df855f72-8c81-45af-8187-060f6b917c65 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:22.271313 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcc8d5-38d2-4584-82b7-cd0c7f574c38 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:22.272124 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcc8d5-38d2-4584-82b7-cd0c7f574c38 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:22.272404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcc8d5-38d2-4584-82b7-cd0c7f574c38 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:22.273990 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 475/982] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:38:22.278614 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8378869-01e1-42a3-a3f6-c9d728f92806 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:22.278952 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8378869-01e1-42a3-a3f6-c9d728f92806 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:22.279291 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8378869-01e1-42a3-a3f6-c9d728f92806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:22.287757 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d6024-4c5d-4eb1-b77b-9722be21c774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:22.288628 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d6024-4c5d-4eb1-b77b-9722be21c774 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:22.289054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d6024-4c5d-4eb1-b77b-9722be21c774 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:22.289472 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d6024-4c5d-4eb1-b77b-9722be21c774 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:22.290432 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d6024-4c5d-4eb1-b77b-9722be21c774 None admin] RBAC: Adding query filter params (role.id=3ff1752e60db4b41898fc8faf026d448, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=e0653575c0a24603bb9287e6222313de) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:22.290911 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d6024-4c5d-4eb1-b77b-9722be21c774 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:22.292509 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d6024-4c5d-4eb1-b77b-9722be21c774 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:22.296126 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-e8378869-01e1-42a3-a3f6-c9d728f92806 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:22.297284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e8378869-01e1-42a3-a3f6-c9d728f92806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:22.299035 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 508/983] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:38:22 2022] GET /identity/v3/role_assignments?user.id=e0653575c0a24603bb9287e6222313de&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=3ff1752e60db4b41898fc8faf026d448 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:22.371516 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 476/984] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:22 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:38:22.395451 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d6024-4c5d-4eb1-b77b-9722be21c774 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:22.498744 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d6024-4c5d-4eb1-b77b-9722be21c774 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:22.532715 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62823dd6-49b4-4ccb-89f9-0909330c63f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:22.533430 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62823dd6-49b4-4ccb-89f9-0909330c63f9 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:22.533711 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62823dd6-49b4-4ccb-89f9-0909330c63f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:22.533987 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62823dd6-49b4-4ccb-89f9-0909330c63f9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:22.534660 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62823dd6-49b4-4ccb-89f9-0909330c63f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:22.536043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62823dd6-49b4-4ccb-89f9-0909330c63f9 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:22.547567 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-62823dd6-49b4-4ccb-89f9-0909330c63f9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 11 16:38:22.549056 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 509/985] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:38:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:22.554917 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8378869-01e1-42a3-a3f6-c9d728f92806 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:22.648655 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8378869-01e1-42a3-a3f6-c9d728f92806 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:22.681008 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8802b2-122a-408f-acca-736c9548c9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:22.681670 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8802b2-122a-408f-acca-736c9548c9d9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:22.681955 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8802b2-122a-408f-acca-736c9548c9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:22.682232 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8802b2-122a-408f-acca-736c9548c9d9 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:22.682963 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8802b2-122a-408f-acca-736c9548c9d9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:22.683272 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8802b2-122a-408f-acca-736c9548c9d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:22.684637 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8802b2-122a-408f-acca-736c9548c9d9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:22.689499 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 477/986] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Apr 11 16:38:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:22.695477 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62823dd6-49b4-4ccb-89f9-0909330c63f9 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:22.790803 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62823dd6-49b4-4ccb-89f9-0909330c63f9 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:22.822989 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a01e8-ada2-4697-8edc-2cf82396857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:22.823704 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a01e8-ada2-4697-8edc-2cf82396857d None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:22.824001 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a01e8-ada2-4697-8edc-2cf82396857d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:22.824254 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a01e8-ada2-4697-8edc-2cf82396857d None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:22.825011 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a01e8-ada2-4697-8edc-2cf82396857d None admin] RBAC: Adding query filter params (type=compute) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:22.825322 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a01e8-ada2-4697-8edc-2cf82396857d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:22.826722 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a01e8-ada2-4697-8edc-2cf82396857d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:22.836335 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 510/987] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Apr 11 16:38:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:22.837517 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8802b2-122a-408f-acca-736c9548c9d9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:22.942498 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8802b2-122a-408f-acca-736c9548c9d9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:22.974415 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c969f4-ee2b-4b05-adbf-4604f29bdd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:22.975629 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c969f4-ee2b-4b05-adbf-4604f29bdd8d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:22.975915 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c969f4-ee2b-4b05-adbf-4604f29bdd8d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:22.976190 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c969f4-ee2b-4b05-adbf-4604f29bdd8d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:22.976966 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c969f4-ee2b-4b05-adbf-4604f29bdd8d None admin] RBAC: Adding query filter params (interface=public, service_id=9308c98beba24fbd8d8c3ade0f18703c, region_id=RegionOne) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:22.977278 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c969f4-ee2b-4b05-adbf-4604f29bdd8d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:22.978678 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c969f4-ee2b-4b05-adbf-4604f29bdd8d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:22.988188 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 478/988] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Apr 11 16:38:22 2022] GET /identity/v3/endpoints?service_id=9308c98beba24fbd8d8c3ade0f18703c&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:22.989465 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a01e8-ada2-4697-8edc-2cf82396857d None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:23.084394 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a01e8-ada2-4697-8edc-2cf82396857d None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:23.116479 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176d605-7381-4c7e-933c-43ec853c7e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:23.117141 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176d605-7381-4c7e-933c-43ec853c7e17 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:23.117421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176d605-7381-4c7e-933c-43ec853c7e17 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:23.117694 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176d605-7381-4c7e-933c-43ec853c7e17 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:23.118376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176d605-7381-4c7e-933c-43ec853c7e17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:23.119777 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176d605-7381-4c7e-933c-43ec853c7e17 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:23.130314 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 511/989] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Apr 11 16:38:22 2022] GET /identity/v3/services => generated 1727 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:38:23.561811 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380402e-c468-4396-af05-92eafcc8349e None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:23.562139 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380402e-c468-4396-af05-92eafcc8349e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:23.562373 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380402e-c468-4396-af05-92eafcc8349e None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:23.563914 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 479/990] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:23.569477 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1d672-75b1-48d1-9c90-ac65cc2b9b98 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:23.569828 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1d672-75b1-48d1-9c90-ac65cc2b9b98 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:23.570170 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1d672-75b1-48d1-9c90-ac65cc2b9b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:23.587336 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-85a1d672-75b1-48d1-9c90-ac65cc2b9b98 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:23.588812 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-85a1d672-75b1-48d1-9c90-ac65cc2b9b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:23.651231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 512/991] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:23.675059 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380402e-c468-4396-af05-92eafcc8349e None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:23.772251 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380402e-c468-4396-af05-92eafcc8349e None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:23.804545 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3cfe8-387d-4f07-b94b-a075db849902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:23.805343 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3cfe8-387d-4f07-b94b-a075db849902 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:23.805620 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3cfe8-387d-4f07-b94b-a075db849902 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:23.805890 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3cfe8-387d-4f07-b94b-a075db849902 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:23.806527 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3cfe8-387d-4f07-b94b-a075db849902 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:23.807912 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3cfe8-387d-4f07-b94b-a075db849902 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:23.819029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-11d3cfe8-387d-4f07-b94b-a075db849902 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 16:38:23.820324 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 480/992] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Apr 11 16:38:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:23.826087 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1d672-75b1-48d1-9c90-ac65cc2b9b98 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:23.923134 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1d672-75b1-48d1-9c90-ac65cc2b9b98 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:23.960757 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be181ae1-e551-4079-9330-e28458f75544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:23.961414 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be181ae1-e551-4079-9330-e28458f75544 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:23.961687 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be181ae1-e551-4079-9330-e28458f75544 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:23.961954 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be181ae1-e551-4079-9330-e28458f75544 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:23.962668 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be181ae1-e551-4079-9330-e28458f75544 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:23.962971 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be181ae1-e551-4079-9330-e28458f75544 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:23.964333 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be181ae1-e551-4079-9330-e28458f75544 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:23.973555 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 513/993] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Apr 11 16:38:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:23.974694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3cfe8-387d-4f07-b94b-a075db849902 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:24.067473 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3cfe8-387d-4f07-b94b-a075db849902 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:24.099365 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529e28a-6146-4078-9af7-507e866c621e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:24.099999 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529e28a-6146-4078-9af7-507e866c621e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:24.100268 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529e28a-6146-4078-9af7-507e866c621e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:24.100540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529e28a-6146-4078-9af7-507e866c621e None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:24.101233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529e28a-6146-4078-9af7-507e866c621e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:24.101533 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529e28a-6146-4078-9af7-507e866c621e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:24.102899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529e28a-6146-4078-9af7-507e866c621e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:24.107719 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 481/994] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Apr 11 16:38:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:24.113488 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be181ae1-e551-4079-9330-e28458f75544 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:24.206474 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be181ae1-e551-4079-9330-e28458f75544 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:24.238159 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ad179-ac98-4c18-9a90-b77e1c0f8360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:24.238852 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ad179-ac98-4c18-9a90-b77e1c0f8360 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:24.239130 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ad179-ac98-4c18-9a90-b77e1c0f8360 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:24.239398 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ad179-ac98-4c18-9a90-b77e1c0f8360 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:24.240243 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ad179-ac98-4c18-9a90-b77e1c0f8360 None admin] RBAC: Adding query filter params (interface=admin, service_id=ea3d57a8b56f46c49bb8609acea597cf, region_id=RegionOne) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:24.240556 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ad179-ac98-4c18-9a90-b77e1c0f8360 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:24.241981 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ad179-ac98-4c18-9a90-b77e1c0f8360 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:24.252555 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 514/995] 10.222.0.73 () {56 vars in 1249 bytes} [Mon Apr 11 16:38:24 2022] GET /identity/v3/endpoints?service_id=ea3d57a8b56f46c49bb8609acea597cf&interface=admin®ion_id=RegionOne => generated 193 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:24.254108 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529e28a-6146-4078-9af7-507e866c621e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:24.351806 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529e28a-6146-4078-9af7-507e866c621e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:24.382752 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ac70b-dff5-46fa-86d7-59246e578571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:24.383404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ac70b-dff5-46fa-86d7-59246e578571 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:24.383681 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ac70b-dff5-46fa-86d7-59246e578571 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:24.383957 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ac70b-dff5-46fa-86d7-59246e578571 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:24.384621 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ac70b-dff5-46fa-86d7-59246e578571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:24.385960 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ac70b-dff5-46fa-86d7-59246e578571 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:24.392331 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 482/996] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Apr 11 16:38:24 2022] GET /identity/v3/services => generated 1727 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:38:24.653778 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33418632-5687-4b8d-bf49-873fcc4e90d2 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:24.654145 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33418632-5687-4b8d-bf49-873fcc4e90d2 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:24.654327 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33418632-5687-4b8d-bf49-873fcc4e90d2 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:24.655878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 515/997] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:24.660836 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26bedb-86d5-4680-9786-f6830dadc927 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:24.661140 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26bedb-86d5-4680-9786-f6830dadc927 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:24.661417 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26bedb-86d5-4680-9786-f6830dadc927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:24.678779 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-7f26bedb-86d5-4680-9786-f6830dadc927 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:24.679961 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7f26bedb-86d5-4680-9786-f6830dadc927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:24.744187 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 483/998] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:24.766947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33418632-5687-4b8d-bf49-873fcc4e90d2 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:24.863074 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33418632-5687-4b8d-bf49-873fcc4e90d2 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:24.896401 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5deb4-2c66-4648-9774-ea3fbd44482a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:24.897188 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5deb4-2c66-4648-9774-ea3fbd44482a None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:24.897468 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5deb4-2c66-4648-9774-ea3fbd44482a None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:24.897739 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5deb4-2c66-4648-9774-ea3fbd44482a None admin] PATH_INFO: `/v3/services/image` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:24.898379 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5deb4-2c66-4648-9774-ea3fbd44482a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:24.899784 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5deb4-2c66-4648-9774-ea3fbd44482a None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:24.910700 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-9fc5deb4-2c66-4648-9774-ea3fbd44482a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 11 16:38:24.918452 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 516/999] 10.222.0.73 () {56 vars in 1105 bytes} [Mon Apr 11 16:38:24 2022] GET /identity/v3/services/image => generated 86 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:24.920138 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26bedb-86d5-4680-9786-f6830dadc927 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:25.015963 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26bedb-86d5-4680-9786-f6830dadc927 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:25.048150 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd0dc0-d22e-49f6-8f3f-2e49f6280f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:25.048831 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0dc0-d22e-49f6-8f3f-2e49f6280f24 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:25.049111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0dc0-d22e-49f6-8f3f-2e49f6280f24 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:25.049384 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0dc0-d22e-49f6-8f3f-2e49f6280f24 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:25.050100 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd0dc0-d22e-49f6-8f3f-2e49f6280f24 None admin] RBAC: Adding query filter params (name=image) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:25.050408 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd0dc0-d22e-49f6-8f3f-2e49f6280f24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:25.051854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd0dc0-d22e-49f6-8f3f-2e49f6280f24 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:25.062060 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 484/1000] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:25.063537 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5deb4-2c66-4648-9774-ea3fbd44482a None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:25.159882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5deb4-2c66-4648-9774-ea3fbd44482a None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:25.192099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b5a07-6cfe-4583-ac98-230abe8f0a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:25.192681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b5a07-6cfe-4583-ac98-230abe8f0a50 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:25.192960 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b5a07-6cfe-4583-ac98-230abe8f0a50 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:25.193266 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b5a07-6cfe-4583-ac98-230abe8f0a50 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:25.193962 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b5a07-6cfe-4583-ac98-230abe8f0a50 None admin] RBAC: Adding query filter params (type=image) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:25.194264 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b5a07-6cfe-4583-ac98-230abe8f0a50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:25.195664 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b5a07-6cfe-4583-ac98-230abe8f0a50 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:25.200362 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 517/1001] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:25 2022] GET /identity/v3/services?type=image => generated 122 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:25.437413 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2a370-2eb7-480b-8309-d1c39d67ad12 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:25.437780 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2a370-2eb7-480b-8309-d1c39d67ad12 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:25.437975 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c2a370-2eb7-480b-8309-d1c39d67ad12 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:25.439506 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 485/1002] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:25.444524 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959e6b2-885c-4656-a745-bdd6b6496078 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:25.444758 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959e6b2-885c-4656-a745-bdd6b6496078 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:25.445031 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1959e6b2-885c-4656-a745-bdd6b6496078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:25.461659 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-1959e6b2-885c-4656-a745-bdd6b6496078 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:25.462854 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-1959e6b2-885c-4656-a745-bdd6b6496078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:25.527397 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 518/1003] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:25 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:25.551792 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2a370-2eb7-480b-8309-d1c39d67ad12 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:25.648230 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c2a370-2eb7-480b-8309-d1c39d67ad12 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:25.680571 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74716e4a-896e-4a4b-b273-8c073723306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:25.681419 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74716e4a-896e-4a4b-b273-8c073723306d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:25.681701 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74716e4a-896e-4a4b-b273-8c073723306d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:25.682029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74716e4a-896e-4a4b-b273-8c073723306d None admin] PATH_INFO: `/v3/services/compute` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:25.682703 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74716e4a-896e-4a4b-b273-8c073723306d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:25.684071 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74716e4a-896e-4a4b-b273-8c073723306d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:25.695525 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-74716e4a-896e-4a4b-b273-8c073723306d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 11 16:38:25.696837 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 486/1004] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:38:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:25.702720 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959e6b2-885c-4656-a745-bdd6b6496078 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:25.795502 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1959e6b2-885c-4656-a745-bdd6b6496078 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:25.827192 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45525cfa-fe1c-4eee-b002-4064f50f2319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:25.827899 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45525cfa-fe1c-4eee-b002-4064f50f2319 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:25.828187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45525cfa-fe1c-4eee-b002-4064f50f2319 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:25.828463 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45525cfa-fe1c-4eee-b002-4064f50f2319 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:25.829160 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45525cfa-fe1c-4eee-b002-4064f50f2319 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:25.829464 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45525cfa-fe1c-4eee-b002-4064f50f2319 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:25.830868 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45525cfa-fe1c-4eee-b002-4064f50f2319 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:25.840394 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 519/1005] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Apr 11 16:38:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:25.842035 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74716e4a-896e-4a4b-b273-8c073723306d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:25.942522 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74716e4a-896e-4a4b-b273-8c073723306d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:25.975068 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1138e04a-dd94-4219-9eb8-b1167e8379f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:25.975653 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138e04a-dd94-4219-9eb8-b1167e8379f5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:25.975935 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138e04a-dd94-4219-9eb8-b1167e8379f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:25.976208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1138e04a-dd94-4219-9eb8-b1167e8379f5 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:25.976906 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138e04a-dd94-4219-9eb8-b1167e8379f5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:25.977209 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138e04a-dd94-4219-9eb8-b1167e8379f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:25.978571 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1138e04a-dd94-4219-9eb8-b1167e8379f5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:25.983609 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 487/1006] 10.222.0.73 () {56 vars in 1112 bytes} [Mon Apr 11 16:38:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:25.988991 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45525cfa-fe1c-4eee-b002-4064f50f2319 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:26.082188 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45525cfa-fe1c-4eee-b002-4064f50f2319 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:26.114081 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562bfcf-3888-4b30-a04d-63991de7239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:26.114759 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562bfcf-3888-4b30-a04d-63991de7239a None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:26.115565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562bfcf-3888-4b30-a04d-63991de7239a None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:26.115837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562bfcf-3888-4b30-a04d-63991de7239a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:26.116567 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562bfcf-3888-4b30-a04d-63991de7239a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:26.117929 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562bfcf-3888-4b30-a04d-63991de7239a None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:26.137075 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 520/1007] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Apr 11 16:38:25 2022] POST /identity/v3/endpoints => generated 334 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:38:26.733435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e13f07-6d9a-49fa-9333-289b1c10658d None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:26.733945 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e13f07-6d9a-49fa-9333-289b1c10658d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:26.734022 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e13f07-6d9a-49fa-9333-289b1c10658d None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:26.735541 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 488/1008] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:26.741284 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4019b-0bd6-4b4c-8d75-2fce6ae639a6 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:26.741571 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4019b-0bd6-4b4c-8d75-2fce6ae639a6 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:26.741849 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4019b-0bd6-4b4c-8d75-2fce6ae639a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:26.758515 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-fff4019b-0bd6-4b4c-8d75-2fce6ae639a6 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:26.759723 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-fff4019b-0bd6-4b4c-8d75-2fce6ae639a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:26.831453 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 521/1009] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:26 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:26.856719 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e13f07-6d9a-49fa-9333-289b1c10658d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:26.956386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e13f07-6d9a-49fa-9333-289b1c10658d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:26.988855 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65769da6-36d5-47b5-b0d2-3d7c153e30ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:26.989577 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65769da6-36d5-47b5-b0d2-3d7c153e30ce None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:26.989859 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65769da6-36d5-47b5-b0d2-3d7c153e30ce None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:26.991927 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65769da6-36d5-47b5-b0d2-3d7c153e30ce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:26.991927 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65769da6-36d5-47b5-b0d2-3d7c153e30ce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:26.993905 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65769da6-36d5-47b5-b0d2-3d7c153e30ce None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:27.004922 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-65769da6-36d5-47b5-b0d2-3d7c153e30ce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 16:38:27.006834 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 489/1010] 10.222.0.73 () {56 vars in 1126 bytes} [Mon Apr 11 16:38:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:27.012743 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4019b-0bd6-4b4c-8d75-2fce6ae639a6 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:27.107846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4019b-0bd6-4b4c-8d75-2fce6ae639a6 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:27.143263 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d42b8-58a7-49df-9d38-1e65c5ac81b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:27.143936 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d42b8-58a7-49df-9d38-1e65c5ac81b0 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:27.144213 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d42b8-58a7-49df-9d38-1e65c5ac81b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:27.144483 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d42b8-58a7-49df-9d38-1e65c5ac81b0 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:27.145183 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d42b8-58a7-49df-9d38-1e65c5ac81b0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:27.145483 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d42b8-58a7-49df-9d38-1e65c5ac81b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:27.146928 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62d42b8-58a7-49df-9d38-1e65c5ac81b0 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:27.156714 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 522/1011] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Apr 11 16:38:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:27.158279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65769da6-36d5-47b5-b0d2-3d7c153e30ce None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:27.253447 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65769da6-36d5-47b5-b0d2-3d7c153e30ce None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:27.285689 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ff035-08b8-4050-bc3f-e3e35d7200a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:27.286345 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ff035-08b8-4050-bc3f-e3e35d7200a4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:27.286651 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ff035-08b8-4050-bc3f-e3e35d7200a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:27.286955 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ff035-08b8-4050-bc3f-e3e35d7200a4 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:27.287647 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ff035-08b8-4050-bc3f-e3e35d7200a4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:27.287949 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ff035-08b8-4050-bc3f-e3e35d7200a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:27.289292 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ff035-08b8-4050-bc3f-e3e35d7200a4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:27.294107 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 490/1012] 10.222.0.73 () {56 vars in 1122 bytes} [Mon Apr 11 16:38:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:27.299519 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d42b8-58a7-49df-9d38-1e65c5ac81b0 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:27.395826 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d42b8-58a7-49df-9d38-1e65c5ac81b0 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:27.428080 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966865fc-cf8d-4f6f-8ace-dcefafa20674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:27.428730 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966865fc-cf8d-4f6f-8ace-dcefafa20674 None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:27.429008 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966865fc-cf8d-4f6f-8ace-dcefafa20674 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:27.429279 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966865fc-cf8d-4f6f-8ace-dcefafa20674 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:27.430010 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966865fc-cf8d-4f6f-8ace-dcefafa20674 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:27.431389 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966865fc-cf8d-4f6f-8ace-dcefafa20674 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:27.454627 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 523/1013] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Apr 11 16:38:27 2022] POST /identity/v3/endpoints => generated 325 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:38:27.520441 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe6111-f1ca-4e8a-b3fe-c7c64c8e991d None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:27.520647 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe6111-f1ca-4e8a-b3fe-c7c64c8e991d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:27.520895 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe6111-f1ca-4e8a-b3fe-c7c64c8e991d None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:27.523160 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 491/1014] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:27.528993 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80a8a8-5a4d-4dcc-8bc8-e111898eab29 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:27.529270 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80a8a8-5a4d-4dcc-8bc8-e111898eab29 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:27.529574 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c80a8a8-5a4d-4dcc-8bc8-e111898eab29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:27.548111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-5c80a8a8-5a4d-4dcc-8bc8-e111898eab29 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:27.549328 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-5c80a8a8-5a4d-4dcc-8bc8-e111898eab29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:27.624694 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 524/1015] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:27 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:27.649546 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe6111-f1ca-4e8a-b3fe-c7c64c8e991d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:27.748390 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe6111-f1ca-4e8a-b3fe-c7c64c8e991d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:27.782385 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed981a-771d-4e29-aee0-f269b87274c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:27.783338 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed981a-771d-4e29-aee0-f269b87274c0 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:27.783818 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed981a-771d-4e29-aee0-f269b87274c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:27.784264 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed981a-771d-4e29-aee0-f269b87274c0 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:27.785138 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed981a-771d-4e29-aee0-f269b87274c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:27.786711 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed981a-771d-4e29-aee0-f269b87274c0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:27.801608 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 492/1016] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Apr 11 16:38:27 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:38:28.550986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5589e4-7adb-49cc-a598-784815034b99 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:28.551503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5589e4-7adb-49cc-a598-784815034b99 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:28.551503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5589e4-7adb-49cc-a598-784815034b99 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:28.553563 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 525/1017] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:28.558514 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12afa3f-731a-4b2d-ac2a-5d4385e41564 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:28.558837 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12afa3f-731a-4b2d-ac2a-5d4385e41564 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:28.559117 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12afa3f-731a-4b2d-ac2a-5d4385e41564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:28.576199 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-d12afa3f-731a-4b2d-ac2a-5d4385e41564 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:28.577380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d12afa3f-731a-4b2d-ac2a-5d4385e41564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:28.651067 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 493/1018] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:28 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:28.675935 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5589e4-7adb-49cc-a598-784815034b99 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:28.770984 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5589e4-7adb-49cc-a598-784815034b99 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:28.802932 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0c5fe-3745-4fa4-b8e2-fa7428031f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:28.804026 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0c5fe-3745-4fa4-b8e2-fa7428031f5f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:28.804449 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0c5fe-3745-4fa4-b8e2-fa7428031f5f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:28.804820 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0c5fe-3745-4fa4-b8e2-fa7428031f5f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:28.814862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0c5fe-3745-4fa4-b8e2-fa7428031f5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:38:28.823070 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-92f0c5fe-3745-4fa4-b8e2-fa7428031f5f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 16:38:28.824433 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 526/1019] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Apr 11 16:38:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:28.830131 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12afa3f-731a-4b2d-ac2a-5d4385e41564 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:28.928920 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12afa3f-731a-4b2d-ac2a-5d4385e41564 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:28.963383 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009b9d8-d94d-4159-bb94-395f79dc9f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:28.964053 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009b9d8-d94d-4159-bb94-395f79dc9f3f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:28.964332 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009b9d8-d94d-4159-bb94-395f79dc9f3f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:28.964603 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6009b9d8-d94d-4159-bb94-395f79dc9f3f None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:28.965339 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009b9d8-d94d-4159-bb94-395f79dc9f3f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:28.965642 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009b9d8-d94d-4159-bb94-395f79dc9f3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:28.967034 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6009b9d8-d94d-4159-bb94-395f79dc9f3f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:28.980321 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 494/1020] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Apr 11 16:38:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:28.981530 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0c5fe-3745-4fa4-b8e2-fa7428031f5f None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:29.076219 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0c5fe-3745-4fa4-b8e2-fa7428031f5f None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:29.108077 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4f640-3972-4b72-9539-e8373bbecb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:29.108859 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4f640-3972-4b72-9539-e8373bbecb8b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:29.109139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4f640-3972-4b72-9539-e8373bbecb8b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:29.109412 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b4f640-3972-4b72-9539-e8373bbecb8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:29.120775 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4f640-3972-4b72-9539-e8373bbecb8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:29.122224 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b4f640-3972-4b72-9539-e8373bbecb8b None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:29.137858 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-d3b4f640-3972-4b72-9539-e8373bbecb8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:29.139479 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 527/1021] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:29.144999 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009b9d8-d94d-4159-bb94-395f79dc9f3f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:29.241625 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6009b9d8-d94d-4159-bb94-395f79dc9f3f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:29.273586 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5afbb2-5d92-43be-933f-2b984e601434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:29.274243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5afbb2-5d92-43be-933f-2b984e601434 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:29.274525 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5afbb2-5d92-43be-933f-2b984e601434 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:29.274824 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5afbb2-5d92-43be-933f-2b984e601434 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:29.275533 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5afbb2-5d92-43be-933f-2b984e601434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:29.275838 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5afbb2-5d92-43be-933f-2b984e601434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:29.277182 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5afbb2-5d92-43be-933f-2b984e601434 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:29.288646 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 495/1022] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:29.294000 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4f640-3972-4b72-9539-e8373bbecb8b None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:29.390640 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b4f640-3972-4b72-9539-e8373bbecb8b None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:29.426399 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79e0fc-7524-4965-a121-73de929cbf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:29.427212 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79e0fc-7524-4965-a121-73de929cbf0c None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:29.427552 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79e0fc-7524-4965-a121-73de929cbf0c None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:29.427825 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79e0fc-7524-4965-a121-73de929cbf0c None admin] PATH_INFO: `/v3/users/nova` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:29.435246 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79e0fc-7524-4965-a121-73de929cbf0c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:29.436691 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da79e0fc-7524-4965-a121-73de929cbf0c None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:29.450294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-da79e0fc-7524-4965-a121-73de929cbf0c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 16:38:29.451740 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 528/1023] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Apr 11 16:38:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:29.457264 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5afbb2-5d92-43be-933f-2b984e601434 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:29.551644 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5afbb2-5d92-43be-933f-2b984e601434 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:29.583481 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947bbc2e-f410-4f53-822c-eb627643834a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:29.584173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bbc2e-f410-4f53-822c-eb627643834a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:29.584453 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bbc2e-f410-4f53-822c-eb627643834a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:29.584726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947bbc2e-f410-4f53-822c-eb627643834a None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:29.585546 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bbc2e-f410-4f53-822c-eb627643834a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:29.585852 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bbc2e-f410-4f53-822c-eb627643834a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:29.587280 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947bbc2e-f410-4f53-822c-eb627643834a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:29.608822 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 496/1024] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Apr 11 16:38:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:29.610296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79e0fc-7524-4965-a121-73de929cbf0c None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:29.705717 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79e0fc-7524-4965-a121-73de929cbf0c None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:29.737885 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f1bd5-b769-43b9-bd2a-87be11460cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:29.738529 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f1bd5-b769-43b9-bd2a-87be11460cd0 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:29.738833 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f1bd5-b769-43b9-bd2a-87be11460cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:29.739102 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f1bd5-b769-43b9-bd2a-87be11460cd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:29.771798 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0ac0b-645a-4b4e-be98-09d1db7b3555 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:29.772133 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0ac0b-645a-4b4e-be98-09d1db7b3555 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:29.772357 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0ac0b-645a-4b4e-be98-09d1db7b3555 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:29.778061 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 497/1025] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:38:29.779952 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a491ea-1d4b-4c40-b5c9-0456b6165306 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:29.780243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a491ea-1d4b-4c40-b5c9-0456b6165306 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:29.780524 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a491ea-1d4b-4c40-b5c9-0456b6165306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:29.796907 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-00a491ea-1d4b-4c40-b5c9-0456b6165306 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:29.798069 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-00a491ea-1d4b-4c40-b5c9-0456b6165306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:29.808709 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f1bd5-b769-43b9-bd2a-87be11460cd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:29.810169 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f1bd5-b769-43b9-bd2a-87be11460cd0 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:29.862840 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 498/1026] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:29.887528 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a491ea-1d4b-4c40-b5c9-0456b6165306 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:29.906965 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 529/1027] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:38:29 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 16:38:29.912856 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f1bd5-b769-43b9-bd2a-87be11460cd0 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:29.985149 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a491ea-1d4b-4c40-b5c9-0456b6165306 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:30.006908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f1bd5-b769-43b9-bd2a-87be11460cd0 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:30.018904 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5de65-7e6c-460f-b661-7a3620a19f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:30.019692 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5de65-7e6c-460f-b661-7a3620a19f40 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:30.019969 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5de65-7e6c-460f-b661-7a3620a19f40 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:30.020240 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5de65-7e6c-460f-b661-7a3620a19f40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:30.021990 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5de65-7e6c-460f-b661-7a3620a19f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:30.023435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5de65-7e6c-460f-b661-7a3620a19f40 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:30.025189 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 499/1028] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:30.030705 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5de65-7e6c-460f-b661-7a3620a19f40 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:30.040795 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecec718-9115-473e-97b9-b4999bb26c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:30.041583 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecec718-9115-473e-97b9-b4999bb26c73 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:30.041864 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecec718-9115-473e-97b9-b4999bb26c73 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:30.042141 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecec718-9115-473e-97b9-b4999bb26c73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:30.052814 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecec718-9115-473e-97b9-b4999bb26c73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:30.054248 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecec718-9115-473e-97b9-b4999bb26c73 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:30.070876 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-9ecec718-9115-473e-97b9-b4999bb26c73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:30.072122 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 530/1029] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:30.077619 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecec718-9115-473e-97b9-b4999bb26c73 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:30.129122 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5de65-7e6c-460f-b661-7a3620a19f40 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:30.161417 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c90233-6440-44c9-99b9-935e9b095e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:30.162617 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c90233-6440-44c9-99b9-935e9b095e35 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:30.162901 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c90233-6440-44c9-99b9-935e9b095e35 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:30.163168 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c90233-6440-44c9-99b9-935e9b095e35 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:30.163868 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c90233-6440-44c9-99b9-935e9b095e35 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:30.165283 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c90233-6440-44c9-99b9-935e9b095e35 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:30.171299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecec718-9115-473e-97b9-b4999bb26c73 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:30.198916 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 500/1030] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Apr 11 16:38:30 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:38:30.198916 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa6c24-d4b6-4190-89ec-2a70d5a402d2 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:30.198916 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa6c24-d4b6-4190-89ec-2a70d5a402d2 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:30.198916 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa6c24-d4b6-4190-89ec-2a70d5a402d2 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:30.198916 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 501/1031] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:30.198916 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e123643-a6df-421e-98ab-2e50f7066e40 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:30.198916 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e123643-a6df-421e-98ab-2e50f7066e40 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:30.199591 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e123643-a6df-421e-98ab-2e50f7066e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:30.206914 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c758bf1-0047-44ec-9169-eb70e542c775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:30.207728 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c758bf1-0047-44ec-9169-eb70e542c775 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:30.208077 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c758bf1-0047-44ec-9169-eb70e542c775 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:30.208441 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c758bf1-0047-44ec-9169-eb70e542c775 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:30.209277 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c758bf1-0047-44ec-9169-eb70e542c775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:30.209650 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c758bf1-0047-44ec-9169-eb70e542c775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:30.211213 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c758bf1-0047-44ec-9169-eb70e542c775 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:30.216021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-0e123643-a6df-421e-98ab-2e50f7066e40 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:30.217233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0e123643-a6df-421e-98ab-2e50f7066e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:30.229966 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 531/1032] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:30.231105 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c758bf1-0047-44ec-9169-eb70e542c775 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:30.294915 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 502/1033] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:38:30.319864 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e123643-a6df-421e-98ab-2e50f7066e40 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:30.422743 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e123643-a6df-421e-98ab-2e50f7066e40 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:30.456591 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2cc7c-5ffa-4ce0-8ddb-6dbd7fa85722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:30.457377 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2cc7c-5ffa-4ce0-8ddb-6dbd7fa85722 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:30.457652 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2cc7c-5ffa-4ce0-8ddb-6dbd7fa85722 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:30.457923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2cc7c-5ffa-4ce0-8ddb-6dbd7fa85722 None admin] PATH_INFO: `/v3/services/image` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:30.458576 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2cc7c-5ffa-4ce0-8ddb-6dbd7fa85722 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:30.459726 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c758bf1-0047-44ec-9169-eb70e542c775 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:30.459954 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2cc7c-5ffa-4ce0-8ddb-6dbd7fa85722 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:30.470539 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-b8c2cc7c-5ffa-4ce0-8ddb-6dbd7fa85722 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 11 16:38:30.471747 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 503/1034] 10.222.0.73 () {56 vars in 1105 bytes} [Mon Apr 11 16:38:30 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:30.477683 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2cc7c-5ffa-4ce0-8ddb-6dbd7fa85722 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:30.492948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57807841-08e6-40fc-95a0-6f6ab6e7f67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:30.493737 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57807841-08e6-40fc-95a0-6f6ab6e7f67b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:30.494016 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57807841-08e6-40fc-95a0-6f6ab6e7f67b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:30.494283 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57807841-08e6-40fc-95a0-6f6ab6e7f67b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:30.500813 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57807841-08e6-40fc-95a0-6f6ab6e7f67b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:30.502262 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57807841-08e6-40fc-95a0-6f6ab6e7f67b None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:30.516645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-57807841-08e6-40fc-95a0-6f6ab6e7f67b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:38:30.518138 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 532/1035] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:38:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:30.523756 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57807841-08e6-40fc-95a0-6f6ab6e7f67b None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:30.576444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2cc7c-5ffa-4ce0-8ddb-6dbd7fa85722 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:30.610857 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ad318-6aa9-4531-b024-4fefc22fdb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:30.611574 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ad318-6aa9-4531-b024-4fefc22fdb47 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:30.611868 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ad318-6aa9-4531-b024-4fefc22fdb47 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:30.612146 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ad318-6aa9-4531-b024-4fefc22fdb47 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:30.612852 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ad318-6aa9-4531-b024-4fefc22fdb47 None admin] RBAC: Adding query filter params (name=image) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:30.613162 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ad318-6aa9-4531-b024-4fefc22fdb47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:30.614519 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0ad318-6aa9-4531-b024-4fefc22fdb47 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:30.619902 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 504/1036] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:30.625199 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ad318-6aa9-4531-b024-4fefc22fdb47 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:30.631505 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57807841-08e6-40fc-95a0-6f6ab6e7f67b None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:30.668117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12fe78-3332-4664-a7a4-123039eb4e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:30.668772 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12fe78-3332-4664-a7a4-123039eb4e61 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:30.669049 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12fe78-3332-4664-a7a4-123039eb4e61 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:30.669326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12fe78-3332-4664-a7a4-123039eb4e61 None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:30.670104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12fe78-3332-4664-a7a4-123039eb4e61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:30.670406 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12fe78-3332-4664-a7a4-123039eb4e61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:30.671871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12fe78-3332-4664-a7a4-123039eb4e61 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:30.683216 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 533/1037] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:38:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:30.688877 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12fe78-3332-4664-a7a4-123039eb4e61 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:30.726570 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ad318-6aa9-4531-b024-4fefc22fdb47 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:30.759111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24cbe9-ce94-4a60-8b4e-504b98d49e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:30.759982 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24cbe9-ce94-4a60-8b4e-504b98d49e17 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:30.760426 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24cbe9-ce94-4a60-8b4e-504b98d49e17 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:30.760696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce24cbe9-ce94-4a60-8b4e-504b98d49e17 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:30.761395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24cbe9-ce94-4a60-8b4e-504b98d49e17 None admin] RBAC: Adding query filter params (type=image) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:30.761701 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24cbe9-ce94-4a60-8b4e-504b98d49e17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:30.763086 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce24cbe9-ce94-4a60-8b4e-504b98d49e17 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:30.768140 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 505/1038] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:30.775233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24cbe9-ce94-4a60-8b4e-504b98d49e17 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:30.789156 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12fe78-3332-4664-a7a4-123039eb4e61 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:30.822031 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e6420-bdb3-4911-9fe0-881c9cc48041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:30.822706 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e6420-bdb3-4911-9fe0-881c9cc48041 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:30.822993 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e6420-bdb3-4911-9fe0-881c9cc48041 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:30.823276 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e6420-bdb3-4911-9fe0-881c9cc48041 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:30.824088 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e6420-bdb3-4911-9fe0-881c9cc48041 None admin] RBAC: Adding query filter params (role.id=3ff1752e60db4b41898fc8faf026d448, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=ba3665d046864985916fdd6c4a4edcd1) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:30.824392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e6420-bdb3-4911-9fe0-881c9cc48041 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:30.825813 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2e6420-bdb3-4911-9fe0-881c9cc48041 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:30.831717 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 534/1039] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:38:30 2022] GET /identity/v3/role_assignments?user.id=ba3665d046864985916fdd6c4a4edcd1&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=3ff1752e60db4b41898fc8faf026d448 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:30.874431 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce24cbe9-ce94-4a60-8b4e-504b98d49e17 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:30.911149 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3646c6-0ab2-4f95-8e7a-8ea10c1c0b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:30.912351 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3646c6-0ab2-4f95-8e7a-8ea10c1c0b1f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:30.912633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3646c6-0ab2-4f95-8e7a-8ea10c1c0b1f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:30.912905 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3646c6-0ab2-4f95-8e7a-8ea10c1c0b1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:30.913695 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3646c6-0ab2-4f95-8e7a-8ea10c1c0b1f None admin] RBAC: Adding query filter params (interface=public, service_id=bfec6c5d28f642b881de679898cf6605, region_id=RegionOne) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:30.914007 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3646c6-0ab2-4f95-8e7a-8ea10c1c0b1f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:30.915426 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3646c6-0ab2-4f95-8e7a-8ea10c1c0b1f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:30.925532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 506/1040] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Apr 11 16:38:30 2022] GET /identity/v3/endpoints?service_id=bfec6c5d28f642b881de679898cf6605&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:30.929734 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e6420-bdb3-4911-9fe0-881c9cc48041 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:31.032516 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e6420-bdb3-4911-9fe0-881c9cc48041 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:31.066256 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55698a9d-5d33-4425-a9b4-aab082874e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:31.066948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55698a9d-5d33-4425-a9b4-aab082874e2f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:31.067228 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55698a9d-5d33-4425-a9b4-aab082874e2f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:31.067499 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55698a9d-5d33-4425-a9b4-aab082874e2f None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:31.068202 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55698a9d-5d33-4425-a9b4-aab082874e2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:31.069577 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55698a9d-5d33-4425-a9b4-aab082874e2f None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:31.076190 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 535/1041] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Apr 11 16:38:30 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:38:32.562007 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691605c0-1b0c-4637-980e-f3233e49102f None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:32.562566 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691605c0-1b0c-4637-980e-f3233e49102f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:32.562566 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691605c0-1b0c-4637-980e-f3233e49102f None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:32.563947 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 507/1042] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:32.569269 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e9048-11c3-44e1-a010-4a055ddfd571 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:32.569683 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e9048-11c3-44e1-a010-4a055ddfd571 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:32.569866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e9048-11c3-44e1-a010-4a055ddfd571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:32.586090 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-bc2e9048-11c3-44e1-a010-4a055ddfd571 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:32.587273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-bc2e9048-11c3-44e1-a010-4a055ddfd571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:32.657962 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 536/1043] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:32.684579 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691605c0-1b0c-4637-980e-f3233e49102f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:32.784699 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691605c0-1b0c-4637-980e-f3233e49102f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:32.816910 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81bb3a-31a2-4858-98cd-61b57b002a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:32.817622 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81bb3a-31a2-4858-98cd-61b57b002a3e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:32.817963 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81bb3a-31a2-4858-98cd-61b57b002a3e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:32.818236 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81bb3a-31a2-4858-98cd-61b57b002a3e None admin] PATH_INFO: `/v3/domains/default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:32.819428 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81bb3a-31a2-4858-98cd-61b57b002a3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:32.820834 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81bb3a-31a2-4858-98cd-61b57b002a3e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:32.822582 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 508/1044] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:32.828037 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e9048-11c3-44e1-a010-4a055ddfd571 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:32.927077 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e9048-11c3-44e1-a010-4a055ddfd571 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:32.960216 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4383f-aeda-4a10-94fa-a9ff3351b23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:32.960888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4383f-aeda-4a10-94fa-a9ff3351b23e None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:32.961175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4383f-aeda-4a10-94fa-a9ff3351b23e None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:32.961452 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4383f-aeda-4a10-94fa-a9ff3351b23e None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:32.962168 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4383f-aeda-4a10-94fa-a9ff3351b23e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:32.963697 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4383f-aeda-4a10-94fa-a9ff3351b23e None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:32.984517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 537/1045] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Apr 11 16:38:32 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:38:33.139837 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88306da1-0588-4c54-afe4-43b8c55e4fb1 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:33.140125 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88306da1-0588-4c54-afe4-43b8c55e4fb1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:33.140613 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88306da1-0588-4c54-afe4-43b8c55e4fb1 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:33.142158 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 509/1046] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:33.148065 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6529f4e-c17b-4f1d-8beb-c098960c574e None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:33.148574 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6529f4e-c17b-4f1d-8beb-c098960c574e None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:33.148997 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6529f4e-c17b-4f1d-8beb-c098960c574e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:33.167299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-f6529f4e-c17b-4f1d-8beb-c098960c574e None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:33.168486 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f6529f4e-c17b-4f1d-8beb-c098960c574e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:33.235234 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 538/1047] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:33.258501 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88306da1-0588-4c54-afe4-43b8c55e4fb1 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:33.356884 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88306da1-0588-4c54-afe4-43b8c55e4fb1 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:33.390319 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5e13d-8ab1-4ff9-89f0-720134fd53ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:33.391139 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5e13d-8ab1-4ff9-89f0-720134fd53ec None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:33.391430 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5e13d-8ab1-4ff9-89f0-720134fd53ec None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:33.391707 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf5e13d-8ab1-4ff9-89f0-720134fd53ec None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:33.398530 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda2234-2746-4627-bf85-b9706acd04de None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:33.399099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda2234-2746-4627-bf85-b9706acd04de None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:33.399456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda2234-2746-4627-bf85-b9706acd04de None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:33.400900 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 539/1048] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:38:33.402174 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf5e13d-8ab1-4ff9-89f0-720134fd53ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:38:33.406053 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f043a2-369d-4300-936f-fce114ef04fc None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:33.406339 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f043a2-369d-4300-936f-fce114ef04fc None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:33.406626 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f043a2-369d-4300-936f-fce114ef04fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:33.409728 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-1cf5e13d-8ab1-4ff9-89f0-720134fd53ec None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 16:38:33.417726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 510/1049] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Apr 11 16:38:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:33.418761 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5e13d-8ab1-4ff9-89f0-720134fd53ec None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:33.424073 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-43f043a2-369d-4300-936f-fce114ef04fc None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:33.425252 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-43f043a2-369d-4300-936f-fce114ef04fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:33.490959 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 540/1050] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:38:33.513557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf5e13d-8ab1-4ff9-89f0-720134fd53ec None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:33.515134 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f043a2-369d-4300-936f-fce114ef04fc None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:33.547182 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d045c8f-72af-48b5-b9e3-f5e6e106729b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:33.548085 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d045c8f-72af-48b5-b9e3-f5e6e106729b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:33.548363 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d045c8f-72af-48b5-b9e3-f5e6e106729b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:33.548789 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d045c8f-72af-48b5-b9e3-f5e6e106729b None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:33.549667 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d045c8f-72af-48b5-b9e3-f5e6e106729b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:33.550153 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d045c8f-72af-48b5-b9e3-f5e6e106729b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:33.551675 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d045c8f-72af-48b5-b9e3-f5e6e106729b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:33.560421 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 511/1051] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Apr 11 16:38:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:33.565732 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d045c8f-72af-48b5-b9e3-f5e6e106729b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:33.609585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f043a2-369d-4300-936f-fce114ef04fc None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:33.643397 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac25e99-1314-4ffe-abcd-13a047772616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:33.644389 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac25e99-1314-4ffe-abcd-13a047772616 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:33.644815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac25e99-1314-4ffe-abcd-13a047772616 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:33.645230 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac25e99-1314-4ffe-abcd-13a047772616 None admin] PATH_INFO: `/v3/services/image` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:33.646033 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac25e99-1314-4ffe-abcd-13a047772616 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:33.647580 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac25e99-1314-4ffe-abcd-13a047772616 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:33.658253 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-aac25e99-1314-4ffe-abcd-13a047772616 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 11 16:38:33.664381 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 541/1052] 10.222.0.73 () {56 vars in 1105 bytes} [Mon Apr 11 16:38:33 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:33.664535 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d045c8f-72af-48b5-b9e3-f5e6e106729b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:33.665926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac25e99-1314-4ffe-abcd-13a047772616 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:33.698828 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f307fc5-f8eb-4436-9d08-213f97084d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:33.699620 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f307fc5-f8eb-4436-9d08-213f97084d38 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:33.699901 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f307fc5-f8eb-4436-9d08-213f97084d38 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:33.700171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f307fc5-f8eb-4436-9d08-213f97084d38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:33.713204 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f307fc5-f8eb-4436-9d08-213f97084d38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:33.714719 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f307fc5-f8eb-4436-9d08-213f97084d38 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:33.731435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-1f307fc5-f8eb-4436-9d08-213f97084d38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:33.737449 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 512/1053] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:33.740079 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f307fc5-f8eb-4436-9d08-213f97084d38 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:33.764046 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac25e99-1314-4ffe-abcd-13a047772616 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:33.798957 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e5381-b58e-4de5-a204-e9efb4da527b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:33.799616 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e5381-b58e-4de5-a204-e9efb4da527b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:33.799890 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e5381-b58e-4de5-a204-e9efb4da527b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:33.800159 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561e5381-b58e-4de5-a204-e9efb4da527b None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:33.800849 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e5381-b58e-4de5-a204-e9efb4da527b None admin] RBAC: Adding query filter params (name=image) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:33.801152 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e5381-b58e-4de5-a204-e9efb4da527b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:33.803074 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561e5381-b58e-4de5-a204-e9efb4da527b None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:33.808640 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 542/1054] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:33.814355 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e5381-b58e-4de5-a204-e9efb4da527b None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:33.842237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f307fc5-f8eb-4436-9d08-213f97084d38 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:33.875889 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a44e7-7adc-4d28-bd01-6b63f9e7f1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:33.876553 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a44e7-7adc-4d28-bd01-6b63f9e7f1e4 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:33.876839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a44e7-7adc-4d28-bd01-6b63f9e7f1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:33.877121 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246a44e7-7adc-4d28-bd01-6b63f9e7f1e4 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:33.877835 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a44e7-7adc-4d28-bd01-6b63f9e7f1e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:33.878142 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a44e7-7adc-4d28-bd01-6b63f9e7f1e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:33.879538 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246a44e7-7adc-4d28-bd01-6b63f9e7f1e4 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:33.893195 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 513/1055] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:33.899047 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a44e7-7adc-4d28-bd01-6b63f9e7f1e4 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:33.920447 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561e5381-b58e-4de5-a204-e9efb4da527b None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:33.954476 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ff552-5667-40a5-a056-7d2e768ed17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:33.955170 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ff552-5667-40a5-a056-7d2e768ed17d None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:33.955445 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ff552-5667-40a5-a056-7d2e768ed17d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:33.955716 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ff552-5667-40a5-a056-7d2e768ed17d None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:33.956409 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ff552-5667-40a5-a056-7d2e768ed17d None admin] RBAC: Adding query filter params (type=image) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:33.956711 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ff552-5667-40a5-a056-7d2e768ed17d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:33.958163 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ff552-5667-40a5-a056-7d2e768ed17d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:33.963401 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 543/1056] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:33 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:33.968877 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ff552-5667-40a5-a056-7d2e768ed17d None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:34.000865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246a44e7-7adc-4d28-bd01-6b63f9e7f1e4 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:34.034580 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54865cb9-f79b-4b85-a8d9-b6757a36831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:34.035405 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54865cb9-f79b-4b85-a8d9-b6757a36831a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:34.035688 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54865cb9-f79b-4b85-a8d9-b6757a36831a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:34.035966 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54865cb9-f79b-4b85-a8d9-b6757a36831a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:34.043703 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54865cb9-f79b-4b85-a8d9-b6757a36831a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:34.045146 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54865cb9-f79b-4b85-a8d9-b6757a36831a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:34.058708 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-54865cb9-f79b-4b85-a8d9-b6757a36831a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 16:38:34.059906 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 514/1057] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Apr 11 16:38:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:34.065456 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54865cb9-f79b-4b85-a8d9-b6757a36831a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:34.071061 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ff552-5667-40a5-a056-7d2e768ed17d None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:34.106114 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fee864-0e82-47d2-ad1f-21fa8265a985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:34.107047 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fee864-0e82-47d2-ad1f-21fa8265a985 None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:34.107474 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fee864-0e82-47d2-ad1f-21fa8265a985 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:34.107894 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fee864-0e82-47d2-ad1f-21fa8265a985 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:34.108816 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fee864-0e82-47d2-ad1f-21fa8265a985 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:34.110194 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fee864-0e82-47d2-ad1f-21fa8265a985 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:34.138617 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 544/1058] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Apr 11 16:38:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:38:34.178693 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54865cb9-f79b-4b85-a8d9-b6757a36831a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:34.221430 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c4b0f-e21d-4a06-a9d3-49dab84e65ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:34.222104 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c4b0f-e21d-4a06-a9d3-49dab84e65ed None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:34.222387 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c4b0f-e21d-4a06-a9d3-49dab84e65ed None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:34.222756 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c4b0f-e21d-4a06-a9d3-49dab84e65ed None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:34.223602 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c4b0f-e21d-4a06-a9d3-49dab84e65ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:34.224458 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c4b0f-e21d-4a06-a9d3-49dab84e65ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:34.225895 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c4b0f-e21d-4a06-a9d3-49dab84e65ed None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:34.245175 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 515/1059] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Apr 11 16:38:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:34.250690 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fee864-0e82-47d2-ad1f-21fa8265a985 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:34.352829 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fee864-0e82-47d2-ad1f-21fa8265a985 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:34.386774 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a3d9a-94dd-420e-a207-ff67c9bbbd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:34.387564 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a3d9a-94dd-420e-a207-ff67c9bbbd9f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:34.387837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a3d9a-94dd-420e-a207-ff67c9bbbd9f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:34.388108 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a3d9a-94dd-420e-a207-ff67c9bbbd9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:34.398525 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a3d9a-94dd-420e-a207-ff67c9bbbd9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:34.399997 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a3d9a-94dd-420e-a207-ff67c9bbbd9f None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:34.415794 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-a37a3d9a-94dd-420e-a207-ff67c9bbbd9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:34.417174 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 545/1060] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:34.422704 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c4b0f-e21d-4a06-a9d3-49dab84e65ed None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:34.517146 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c4b0f-e21d-4a06-a9d3-49dab84e65ed None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:34.550030 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c9574-d009-4eb6-bc57-a328b9323db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:34.550722 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c9574-d009-4eb6-bc57-a328b9323db6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:34.551006 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c9574-d009-4eb6-bc57-a328b9323db6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:34.551279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c9574-d009-4eb6-bc57-a328b9323db6 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:34.552508 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c9574-d009-4eb6-bc57-a328b9323db6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:34.552812 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c9574-d009-4eb6-bc57-a328b9323db6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:34.554160 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906c9574-d009-4eb6-bc57-a328b9323db6 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:34.570186 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 516/1061] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:34.572222 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a3d9a-94dd-420e-a207-ff67c9bbbd9f None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:34.677684 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a3d9a-94dd-420e-a207-ff67c9bbbd9f None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:34.708954 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5548f8-eb8b-4b00-be7e-f522c0e5f895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:34.709743 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5548f8-eb8b-4b00-be7e-f522c0e5f895 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:34.710025 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5548f8-eb8b-4b00-be7e-f522c0e5f895 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:34.710302 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5548f8-eb8b-4b00-be7e-f522c0e5f895 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:34.716684 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5548f8-eb8b-4b00-be7e-f522c0e5f895 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:34.718119 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5548f8-eb8b-4b00-be7e-f522c0e5f895 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:34.731772 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-7f5548f8-eb8b-4b00-be7e-f522c0e5f895 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:38:34.733139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 546/1062] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:38:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:34.738769 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c9574-d009-4eb6-bc57-a328b9323db6 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:34.834500 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906c9574-d009-4eb6-bc57-a328b9323db6 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:34.867531 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099458cb-9de4-4868-a366-7edd9cd32ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:34.868193 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099458cb-9de4-4868-a366-7edd9cd32ffe None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:34.868479 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099458cb-9de4-4868-a366-7edd9cd32ffe None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:34.868757 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099458cb-9de4-4868-a366-7edd9cd32ffe None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:34.869540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099458cb-9de4-4868-a366-7edd9cd32ffe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:34.869850 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099458cb-9de4-4868-a366-7edd9cd32ffe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:34.871343 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099458cb-9de4-4868-a366-7edd9cd32ffe None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:34.884386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 517/1063] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:38:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:34.891197 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5548f8-eb8b-4b00-be7e-f522c0e5f895 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:34.991518 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5548f8-eb8b-4b00-be7e-f522c0e5f895 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:35.026000 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab84f6d-89cf-4927-964d-7af1a648737d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:35.026915 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab84f6d-89cf-4927-964d-7af1a648737d None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:35.027199 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab84f6d-89cf-4927-964d-7af1a648737d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:35.027476 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab84f6d-89cf-4927-964d-7af1a648737d None admin] PATH_INFO: `/v3/projects/c1eb8559ca744abda7039b767af5818f/users/ba3665d046864985916fdd6c4a4edcd1/roles/3ff1752e60db4b41898fc8faf026d448` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:35.029653 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab84f6d-89cf-4927-964d-7af1a648737d None admin] RBAC: Authorizing `identity:create_grant(project_id=c1eb8559ca744abda7039b767af5818f, user_id=ba3665d046864985916fdd6c4a4edcd1, role_id=3ff1752e60db4b41898fc8faf026d448)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:35.031133 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab84f6d-89cf-4927-964d-7af1a648737d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:35.046085 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 547/1064] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:38:34 2022] PUT /identity/v3/projects/c1eb8559ca744abda7039b767af5818f/users/ba3665d046864985916fdd6c4a4edcd1/roles/3ff1752e60db4b41898fc8faf026d448 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:38:35.365293 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5bb47-b784-4a4b-a93c-bb9801d4075a None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:35.365629 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5bb47-b784-4a4b-a93c-bb9801d4075a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:35.365943 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b5bb47-b784-4a4b-a93c-bb9801d4075a None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:35.367402 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 518/1065] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:35.372800 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832760d-3476-401f-aded-95edb797aa55 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:35.373089 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832760d-3476-401f-aded-95edb797aa55 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:35.373360 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832760d-3476-401f-aded-95edb797aa55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:35.390004 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-5832760d-3476-401f-aded-95edb797aa55 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:35.391291 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-5832760d-3476-401f-aded-95edb797aa55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:35.453825 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 548/1066] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:35.478442 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5bb47-b784-4a4b-a93c-bb9801d4075a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:35.575992 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b5bb47-b784-4a4b-a93c-bb9801d4075a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:35.607663 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6a789-8be1-4360-b266-4298a89f0810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:35.608458 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6a789-8be1-4360-b266-4298a89f0810 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:35.608748 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6a789-8be1-4360-b266-4298a89f0810 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:35.609024 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6a789-8be1-4360-b266-4298a89f0810 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:35.618817 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6a789-8be1-4360-b266-4298a89f0810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:38:35.625650 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-44b6a789-8be1-4360-b266-4298a89f0810 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:38:35.627071 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 519/1067] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:38:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:35.633347 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832760d-3476-401f-aded-95edb797aa55 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:35.727200 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832760d-3476-401f-aded-95edb797aa55 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:35.760398 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963952e-9a61-46ba-a370-c176751d7fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:35.761064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963952e-9a61-46ba-a370-c176751d7fbf None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:35.761347 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963952e-9a61-46ba-a370-c176751d7fbf None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:35.761621 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963952e-9a61-46ba-a370-c176751d7fbf None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:35.762359 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963952e-9a61-46ba-a370-c176751d7fbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:35.762700 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963952e-9a61-46ba-a370-c176751d7fbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:35.764309 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963952e-9a61-46ba-a370-c176751d7fbf None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:35.772505 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 549/1068] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:38:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:35.778033 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6a789-8be1-4360-b266-4298a89f0810 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:35.873979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6a789-8be1-4360-b266-4298a89f0810 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:35.909982 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7e782-f282-4140-998a-f2b11a9bc6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:35.910888 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7e782-f282-4140-998a-f2b11a9bc6a9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:35.911176 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7e782-f282-4140-998a-f2b11a9bc6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:35.911514 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f7e782-f282-4140-998a-f2b11a9bc6a9 None admin] PATH_INFO: `/v3/users/bd73609b0ae242fe955820dfedf33257` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:35.924991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7e782-f282-4140-998a-f2b11a9bc6a9 None admin] RBAC: Authorizing `identity:get_user(user_id=bd73609b0ae242fe955820dfedf33257)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:35.926454 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f7e782-f282-4140-998a-f2b11a9bc6a9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:35.928914 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 520/1069] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:38:35 2022] GET /identity/v3/users/bd73609b0ae242fe955820dfedf33257 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:35.934383 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963952e-9a61-46ba-a370-c176751d7fbf None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:36.031045 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963952e-9a61-46ba-a370-c176751d7fbf None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:36.063566 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f4d61-85be-4513-b062-33c0364eb268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:36.064211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f4d61-85be-4513-b062-33c0364eb268 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:36.064494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f4d61-85be-4513-b062-33c0364eb268 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:36.064769 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f4d61-85be-4513-b062-33c0364eb268 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:36.133669 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f4d61-85be-4513-b062-33c0364eb268 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:36.135677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4f4d61-85be-4513-b062-33c0364eb268 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:36.231964 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 550/1070] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:38:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:38:36.237436 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7e782-f282-4140-998a-f2b11a9bc6a9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:36.330780 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f7e782-f282-4140-998a-f2b11a9bc6a9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:36.362929 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da7763-e53e-4862-a566-f10f317bc9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:36.363785 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da7763-e53e-4862-a566-f10f317bc9f6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:36.364061 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da7763-e53e-4862-a566-f10f317bc9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:36.364385 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da7763-e53e-4862-a566-f10f317bc9f6 None admin] PATH_INFO: `/v3/projects/6865c37dd5b6408cb074997dab9c8a4e` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:36.365565 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da7763-e53e-4862-a566-f10f317bc9f6 None admin] RBAC: Authorizing `identity:get_project(project_id=6865c37dd5b6408cb074997dab9c8a4e)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:36.367022 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da7763-e53e-4862-a566-f10f317bc9f6 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:36.368975 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 521/1071] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:38:36 2022] GET /identity/v3/projects/6865c37dd5b6408cb074997dab9c8a4e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:36.374996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f4d61-85be-4513-b062-33c0364eb268 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:36.468989 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f4d61-85be-4513-b062-33c0364eb268 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:36.472615 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d0364-88f4-4a5f-aa44-94ffc9e3cab3 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:36.472900 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d0364-88f4-4a5f-aa44-94ffc9e3cab3 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:36.473173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d0364-88f4-4a5f-aa44-94ffc9e3cab3 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:36.478398 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 522/1072] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:36.479804 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a127729-7ccc-4194-86f9-4d12539544ff None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:36.480088 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a127729-7ccc-4194-86f9-4d12539544ff None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:36.480365 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a127729-7ccc-4194-86f9-4d12539544ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:36.497190 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-2a127729-7ccc-4194-86f9-4d12539544ff None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:36.498380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2a127729-7ccc-4194-86f9-4d12539544ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:36.504049 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd2eec-e70c-47f7-8f08-880c0a381dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:36.504697 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd2eec-e70c-47f7-8f08-880c0a381dd5 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:36.504999 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd2eec-e70c-47f7-8f08-880c0a381dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:36.505791 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd2eec-e70c-47f7-8f08-880c0a381dd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:36.506618 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd2eec-e70c-47f7-8f08-880c0a381dd5 None admin] RBAC: Adding query filter params (role.id=13de1ce875d44fcc988cc31b3a0639be, scope.project.id=6865c37dd5b6408cb074997dab9c8a4e, user.id=bd73609b0ae242fe955820dfedf33257) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:36.506940 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd2eec-e70c-47f7-8f08-880c0a381dd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:36.508347 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd2eec-e70c-47f7-8f08-880c0a381dd5 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:36.522674 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 551/1073] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:38:36 2022] GET /identity/v3/role_assignments?user.id=bd73609b0ae242fe955820dfedf33257&scope.project.id=6865c37dd5b6408cb074997dab9c8a4e&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:36.568176 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 523/1074] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:36.590632 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd2eec-e70c-47f7-8f08-880c0a381dd5 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:36.703128 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd2eec-e70c-47f7-8f08-880c0a381dd5 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:36.737170 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8c133-b3d8-47fa-bc10-235f859b0163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:36.738456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8c133-b3d8-47fa-bc10-235f859b0163 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:36.738899 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8c133-b3d8-47fa-bc10-235f859b0163 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:36.739376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa8c133-b3d8-47fa-bc10-235f859b0163 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:36.803543 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8c133-b3d8-47fa-bc10-235f859b0163 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:36.805206 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa8c133-b3d8-47fa-bc10-235f859b0163 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:36.902312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 552/1075] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:38:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:38:36.912579 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a127729-7ccc-4194-86f9-4d12539544ff None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:37.014300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a127729-7ccc-4194-86f9-4d12539544ff None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:37.046271 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899bdad-3674-4c60-be4f-5ac48b04ec8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:37.047084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899bdad-3674-4c60-be4f-5ac48b04ec8a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:37.047366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899bdad-3674-4c60-be4f-5ac48b04ec8a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:37.047640 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899bdad-3674-4c60-be4f-5ac48b04ec8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:37.058122 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899bdad-3674-4c60-be4f-5ac48b04ec8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:37.059569 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899bdad-3674-4c60-be4f-5ac48b04ec8a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:37.077191 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-5899bdad-3674-4c60-be4f-5ac48b04ec8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:37.078538 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 524/1076] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:37.084768 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8c133-b3d8-47fa-bc10-235f859b0163 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:37.179236 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa8c133-b3d8-47fa-bc10-235f859b0163 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:37.211894 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c784cf-4964-4cb1-88ad-f63cdb36133e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:37.212547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c784cf-4964-4cb1-88ad-f63cdb36133e None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:37.212823 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c784cf-4964-4cb1-88ad-f63cdb36133e None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:37.213092 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c784cf-4964-4cb1-88ad-f63cdb36133e None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:37.213798 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c784cf-4964-4cb1-88ad-f63cdb36133e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:37.214098 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c784cf-4964-4cb1-88ad-f63cdb36133e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:37.215478 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c784cf-4964-4cb1-88ad-f63cdb36133e None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:37.234642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 553/1077] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:37.340628 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba65c7-a106-40ed-8a8c-27503c69019c None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:37.340934 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba65c7-a106-40ed-8a8c-27503c69019c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:37.341102 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba65c7-a106-40ed-8a8c-27503c69019c None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:37.342692 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 525/1078] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:38:37.348043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00690c-5b04-4d48-b76a-2e83b8362831 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:37.348335 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00690c-5b04-4d48-b76a-2e83b8362831 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:37.348624 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00690c-5b04-4d48-b76a-2e83b8362831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:37.366409 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-ec00690c-5b04-4d48-b76a-2e83b8362831 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:37.367645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-ec00690c-5b04-4d48-b76a-2e83b8362831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:37.436189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 554/1079] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:37.461350 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba65c7-a106-40ed-8a8c-27503c69019c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:37.565108 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba65c7-a106-40ed-8a8c-27503c69019c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:37.597795 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf720c-12c4-4acb-955d-f39192880402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:37.598523 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf720c-12c4-4acb-955d-f39192880402 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:37.599419 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf720c-12c4-4acb-955d-f39192880402 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:37.599696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf720c-12c4-4acb-955d-f39192880402 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:37.609425 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf720c-12c4-4acb-955d-f39192880402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:38:37.616874 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-7adf720c-12c4-4acb-955d-f39192880402 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 16:38:37.618071 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 526/1080] 10.222.0.73 () {56 vars in 1120 bytes} [Mon Apr 11 16:38:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:37.623978 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00690c-5b04-4d48-b76a-2e83b8362831 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:37.721909 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00690c-5b04-4d48-b76a-2e83b8362831 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:37.754737 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c28a51-dc28-453b-8f70-5e203195e50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:37.755472 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28a51-dc28-453b-8f70-5e203195e50a None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:37.755752 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28a51-dc28-453b-8f70-5e203195e50a None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:37.756026 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28a51-dc28-453b-8f70-5e203195e50a None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:37.756768 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c28a51-dc28-453b-8f70-5e203195e50a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:37.757072 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c28a51-dc28-453b-8f70-5e203195e50a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:37.758430 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c28a51-dc28-453b-8f70-5e203195e50a None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:37.766360 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 555/1081] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Apr 11 16:38:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:37.772013 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf720c-12c4-4acb-955d-f39192880402 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:37.864112 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf720c-12c4-4acb-955d-f39192880402 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:37.897088 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b36a30-6dc1-4cb7-b80b-8fa070864e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:37.897856 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b36a30-6dc1-4cb7-b80b-8fa070864e47 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:37.898131 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b36a30-6dc1-4cb7-b80b-8fa070864e47 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:37.898401 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b36a30-6dc1-4cb7-b80b-8fa070864e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:37.908685 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b36a30-6dc1-4cb7-b80b-8fa070864e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:37.910125 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b36a30-6dc1-4cb7-b80b-8fa070864e47 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:37.925837 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-25b36a30-6dc1-4cb7-b80b-8fa070864e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:37.927259 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 527/1082] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:37.932665 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c28a51-dc28-453b-8f70-5e203195e50a None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:38.029426 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c28a51-dc28-453b-8f70-5e203195e50a None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:38.061287 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682dc4c-072e-45ac-bf70-8edbf069e7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:38.061936 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682dc4c-072e-45ac-bf70-8edbf069e7fc None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:38.062211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682dc4c-072e-45ac-bf70-8edbf069e7fc None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:38.062482 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1682dc4c-072e-45ac-bf70-8edbf069e7fc None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:38.063216 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682dc4c-072e-45ac-bf70-8edbf069e7fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:38.063514 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682dc4c-072e-45ac-bf70-8edbf069e7fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:38.064859 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1682dc4c-072e-45ac-bf70-8edbf069e7fc None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:38.076099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 556/1083] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:38.081751 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b36a30-6dc1-4cb7-b80b-8fa070864e47 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:38.175864 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b36a30-6dc1-4cb7-b80b-8fa070864e47 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:38.206837 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa39c1-95d7-46db-bbc2-1aafb8b969a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:38.207612 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa39c1-95d7-46db-bbc2-1aafb8b969a7 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:38.207893 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa39c1-95d7-46db-bbc2-1aafb8b969a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:38.208682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa39c1-95d7-46db-bbc2-1aafb8b969a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:38.215829 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa39c1-95d7-46db-bbc2-1aafb8b969a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:38.217248 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa39c1-95d7-46db-bbc2-1aafb8b969a7 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:38.230051 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-eaaa39c1-95d7-46db-bbc2-1aafb8b969a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 16:38:38.231274 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 528/1084] 10.222.0.73 () {56 vars in 1093 bytes} [Mon Apr 11 16:38:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:38.237160 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682dc4c-072e-45ac-bf70-8edbf069e7fc None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:38.331577 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1682dc4c-072e-45ac-bf70-8edbf069e7fc None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:38.363452 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3cb1e-2b12-47d9-9bff-c3e32133b676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:38.364114 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3cb1e-2b12-47d9-9bff-c3e32133b676 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:38.364888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3cb1e-2b12-47d9-9bff-c3e32133b676 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:38.365162 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3cb1e-2b12-47d9-9bff-c3e32133b676 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:38.365988 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3cb1e-2b12-47d9-9bff-c3e32133b676 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:38.366296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3cb1e-2b12-47d9-9bff-c3e32133b676 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:38.367799 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3cb1e-2b12-47d9-9bff-c3e32133b676 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:38.389923 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 557/1085] 10.222.0.73 () {56 vars in 1133 bytes} [Mon Apr 11 16:38:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:38.391521 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa39c1-95d7-46db-bbc2-1aafb8b969a7 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:38.490692 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa39c1-95d7-46db-bbc2-1aafb8b969a7 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:38.522041 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba536c-abde-415b-99b4-6a8e9d0d1a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:38.522716 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba536c-abde-415b-99b4-6a8e9d0d1a9c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:38.523004 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba536c-abde-415b-99b4-6a8e9d0d1a9c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:38.523282 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba536c-abde-415b-99b4-6a8e9d0d1a9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:38.586233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba536c-abde-415b-99b4-6a8e9d0d1a9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:38.587715 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba536c-abde-415b-99b4-6a8e9d0d1a9c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:38.803959 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 529/1086] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:38:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 16:38:38.809644 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3cb1e-2b12-47d9-9bff-c3e32133b676 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:38.827620 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d28c9-f835-4700-bf7a-830b02128b9c None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:38.827907 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d28c9-f835-4700-bf7a-830b02128b9c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:38.828226 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d28c9-f835-4700-bf7a-830b02128b9c None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:38.829548 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 530/1087] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:38:38.834770 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d27eca-b625-4cb0-ae31-309088904dac None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:38.834966 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d27eca-b625-4cb0-ae31-309088904dac None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:38.835241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d27eca-b625-4cb0-ae31-309088904dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:38.851311 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-e1d27eca-b625-4cb0-ae31-309088904dac None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:38.852489 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e1d27eca-b625-4cb0-ae31-309088904dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:38.906754 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3cb1e-2b12-47d9-9bff-c3e32133b676 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:38.915718 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 531/1088] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:38:38.938414 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d27eca-b625-4cb0-ae31-309088904dac None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:38.943310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b35f7-f698-4359-aa4f-c7ae171169d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:38.943883 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b35f7-f698-4359-aa4f-c7ae171169d7 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:38.944164 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b35f7-f698-4359-aa4f-c7ae171169d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:38.944436 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b35f7-f698-4359-aa4f-c7ae171169d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:38.954349 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b35f7-f698-4359-aa4f-c7ae171169d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:38.955882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b35f7-f698-4359-aa4f-c7ae171169d7 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:38.971835 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-183b35f7-f698-4359-aa4f-c7ae171169d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:38:38.973008 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 558/1089] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:38.978641 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b35f7-f698-4359-aa4f-c7ae171169d7 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:39.030834 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d27eca-b625-4cb0-ae31-309088904dac None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:39.062233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1193fc6-dafb-494b-8518-0a98fdf3ba09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:39.062977 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1193fc6-dafb-494b-8518-0a98fdf3ba09 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:39.063273 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1193fc6-dafb-494b-8518-0a98fdf3ba09 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:39.063532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1193fc6-dafb-494b-8518-0a98fdf3ba09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:39.070583 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b35f7-f698-4359-aa4f-c7ae171169d7 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:39.073643 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1193fc6-dafb-494b-8518-0a98fdf3ba09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:38:39.080433 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-d1193fc6-dafb-494b-8518-0a98fdf3ba09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:38:39.081630 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 532/1090] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:38:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:39.089452 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1193fc6-dafb-494b-8518-0a98fdf3ba09 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:39.104493 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5000fd-58f1-4443-bdbb-6ddbb392761c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:39.105152 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5000fd-58f1-4443-bdbb-6ddbb392761c None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:39.105433 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5000fd-58f1-4443-bdbb-6ddbb392761c None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:39.105708 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5000fd-58f1-4443-bdbb-6ddbb392761c None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:39.106419 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5000fd-58f1-4443-bdbb-6ddbb392761c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:39.106752 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5000fd-58f1-4443-bdbb-6ddbb392761c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:39.108120 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5000fd-58f1-4443-bdbb-6ddbb392761c None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:39.118831 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 559/1091] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:39.124262 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5000fd-58f1-4443-bdbb-6ddbb392761c None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:39.184296 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1193fc6-dafb-494b-8518-0a98fdf3ba09 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:39.214973 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd433af-5463-4875-ac59-9578c9bc442b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:39.215628 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd433af-5463-4875-ac59-9578c9bc442b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:39.215908 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd433af-5463-4875-ac59-9578c9bc442b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:39.216184 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd433af-5463-4875-ac59-9578c9bc442b None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:39.216915 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd433af-5463-4875-ac59-9578c9bc442b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:39.217219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd433af-5463-4875-ac59-9578c9bc442b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:39.218112 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5000fd-58f1-4443-bdbb-6ddbb392761c None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:39.218568 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd433af-5463-4875-ac59-9578c9bc442b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:39.226747 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 533/1092] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:38:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:39.232453 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd433af-5463-4875-ac59-9578c9bc442b None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:39.250319 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777deead-e6ab-4181-b871-3b4378b4e467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:39.251126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777deead-e6ab-4181-b871-3b4378b4e467 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:39.251401 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777deead-e6ab-4181-b871-3b4378b4e467 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:39.251670 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777deead-e6ab-4181-b871-3b4378b4e467 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:39.258418 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777deead-e6ab-4181-b871-3b4378b4e467 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:39.259859 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777deead-e6ab-4181-b871-3b4378b4e467 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:39.273374 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-777deead-e6ab-4181-b871-3b4378b4e467 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:38:39.279171 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 560/1093] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:38:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:38:39.280329 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777deead-e6ab-4181-b871-3b4378b4e467 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:39.325886 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd433af-5463-4875-ac59-9578c9bc442b None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:39.357100 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a98f8-1fc2-41bb-8ce4-ee35806c373a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:39.357951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a98f8-1fc2-41bb-8ce4-ee35806c373a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:39.358226 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a98f8-1fc2-41bb-8ce4-ee35806c373a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:39.358494 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8a98f8-1fc2-41bb-8ce4-ee35806c373a None admin] PATH_INFO: `/v3/users/bd73609b0ae242fe955820dfedf33257` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:39.359694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a98f8-1fc2-41bb-8ce4-ee35806c373a None admin] RBAC: Authorizing `identity:get_user(user_id=bd73609b0ae242fe955820dfedf33257)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:39.361101 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8a98f8-1fc2-41bb-8ce4-ee35806c373a None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:39.362729 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 534/1094] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:38:39 2022] GET /identity/v3/users/bd73609b0ae242fe955820dfedf33257 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:39.368336 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a98f8-1fc2-41bb-8ce4-ee35806c373a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:39.372128 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777deead-e6ab-4181-b871-3b4378b4e467 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:39.405095 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afa6dc-dc2c-46e9-bc7b-c11695422e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:39.405848 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afa6dc-dc2c-46e9-bc7b-c11695422e0f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:39.406130 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afa6dc-dc2c-46e9-bc7b-c11695422e0f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:39.406408 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afa6dc-dc2c-46e9-bc7b-c11695422e0f None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:39.407214 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afa6dc-dc2c-46e9-bc7b-c11695422e0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:39.407527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afa6dc-dc2c-46e9-bc7b-c11695422e0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:39.408944 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afa6dc-dc2c-46e9-bc7b-c11695422e0f None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:39.420427 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 561/1095] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:38:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:39.426556 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afa6dc-dc2c-46e9-bc7b-c11695422e0f None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:39.462194 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8a98f8-1fc2-41bb-8ce4-ee35806c373a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:39.493425 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb44fa-fb72-4692-bd88-53a153ff60b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:39.494264 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb44fa-fb72-4692-bd88-53a153ff60b0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:39.494545 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb44fa-fb72-4692-bd88-53a153ff60b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:39.494846 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb44fa-fb72-4692-bd88-53a153ff60b0 None admin] PATH_INFO: `/v3/projects/6865c37dd5b6408cb074997dab9c8a4e` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:39.496005 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb44fa-fb72-4692-bd88-53a153ff60b0 None admin] RBAC: Authorizing `identity:get_project(project_id=6865c37dd5b6408cb074997dab9c8a4e)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:39.497414 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb44fa-fb72-4692-bd88-53a153ff60b0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:39.499105 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 535/1096] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:38:39 2022] GET /identity/v3/projects/6865c37dd5b6408cb074997dab9c8a4e => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:39.505478 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb44fa-fb72-4692-bd88-53a153ff60b0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:39.520147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afa6dc-dc2c-46e9-bc7b-c11695422e0f None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:39.550734 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36bb3d-9aa8-495d-b162-47f33ac9b454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:39.551376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36bb3d-9aa8-495d-b162-47f33ac9b454 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:39.552144 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36bb3d-9aa8-495d-b162-47f33ac9b454 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:39.552419 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36bb3d-9aa8-495d-b162-47f33ac9b454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:39.553240 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36bb3d-9aa8-495d-b162-47f33ac9b454 None admin] RBAC: Adding query filter params (role.id=3ff1752e60db4b41898fc8faf026d448, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=ba3665d046864985916fdd6c4a4edcd1) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:39.553565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36bb3d-9aa8-495d-b162-47f33ac9b454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:39.555009 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36bb3d-9aa8-495d-b162-47f33ac9b454 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:39.560742 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 562/1097] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:38:39 2022] GET /identity/v3/role_assignments?user.id=ba3665d046864985916fdd6c4a4edcd1&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=3ff1752e60db4b41898fc8faf026d448 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:38:39.600448 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb44fa-fb72-4692-bd88-53a153ff60b0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:39.633771 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e6a80-5b47-4b50-a655-c6eee9390471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:39.634702 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e6a80-5b47-4b50-a655-c6eee9390471 None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:39.634986 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e6a80-5b47-4b50-a655-c6eee9390471 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:39.635249 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e6a80-5b47-4b50-a655-c6eee9390471 None admin] PATH_INFO: `/v3/projects/6865c37dd5b6408cb074997dab9c8a4e/users/bd73609b0ae242fe955820dfedf33257/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:39.637279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e6a80-5b47-4b50-a655-c6eee9390471 None admin] RBAC: Authorizing `identity:create_grant(project_id=6865c37dd5b6408cb074997dab9c8a4e, user_id=bd73609b0ae242fe955820dfedf33257, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:39.639000 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e6a80-5b47-4b50-a655-c6eee9390471 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:39.653444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 536/1098] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:38:39 2022] PUT /identity/v3/projects/6865c37dd5b6408cb074997dab9c8a4e/users/bd73609b0ae242fe955820dfedf33257/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:38:41.947360 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c665c2-a928-4f45-857c-9641c0176925 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:41.947785 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c665c2-a928-4f45-857c-9641c0176925 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:41.947911 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c665c2-a928-4f45-857c-9641c0176925 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:41.949292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 563/1099] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:41.954322 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1118cf-91d8-41da-ad2a-d931574ff74c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:41.954764 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1118cf-91d8-41da-ad2a-d931574ff74c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:41.954905 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1118cf-91d8-41da-ad2a-d931574ff74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:41.970854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-da1118cf-91d8-41da-ad2a-d931574ff74c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:41.972013 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-da1118cf-91d8-41da-ad2a-d931574ff74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:42.033545 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 537/1100] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:42.057886 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c665c2-a928-4f45-857c-9641c0176925 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:42.155086 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c665c2-a928-4f45-857c-9641c0176925 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:42.187348 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bc7dd-8b96-4bdf-b5c6-ad71a38d8e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:42.188124 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bc7dd-8b96-4bdf-b5c6-ad71a38d8e0f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:42.188406 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bc7dd-8b96-4bdf-b5c6-ad71a38d8e0f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:42.188681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3bc7dd-8b96-4bdf-b5c6-ad71a38d8e0f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:42.198771 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3bc7dd-8b96-4bdf-b5c6-ad71a38d8e0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:38:42.205545 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-6a3bc7dd-8b96-4bdf-b5c6-ad71a38d8e0f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:38:42.207074 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 564/1101] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:38:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:38:42.213216 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1118cf-91d8-41da-ad2a-d931574ff74c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:42.305368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1118cf-91d8-41da-ad2a-d931574ff74c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:42.336087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4e82e-fbbd-4d23-8aa8-b31d4ec1dd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:42.336729 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4e82e-fbbd-4d23-8aa8-b31d4ec1dd99 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:42.337009 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4e82e-fbbd-4d23-8aa8-b31d4ec1dd99 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:42.337281 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4e82e-fbbd-4d23-8aa8-b31d4ec1dd99 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:42.338064 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4e82e-fbbd-4d23-8aa8-b31d4ec1dd99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:42.338370 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4e82e-fbbd-4d23-8aa8-b31d4ec1dd99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:42.339755 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4e82e-fbbd-4d23-8aa8-b31d4ec1dd99 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:42.347263 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 538/1102] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:38:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:42.353434 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bc7dd-8b96-4bdf-b5c6-ad71a38d8e0f None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:42.447025 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3bc7dd-8b96-4bdf-b5c6-ad71a38d8e0f None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:42.478153 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a115e-6c8a-4d4b-b4fd-61c64cf2f297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:42.479062 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a115e-6c8a-4d4b-b4fd-61c64cf2f297 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:42.479350 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a115e-6c8a-4d4b-b4fd-61c64cf2f297 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:42.479625 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a115e-6c8a-4d4b-b4fd-61c64cf2f297 None admin] PATH_INFO: `/v3/users/bd73609b0ae242fe955820dfedf33257` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:42.480790 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a115e-6c8a-4d4b-b4fd-61c64cf2f297 None admin] RBAC: Authorizing `identity:get_user(user_id=bd73609b0ae242fe955820dfedf33257)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:42.482214 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a115e-6c8a-4d4b-b4fd-61c64cf2f297 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:42.483846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 565/1103] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:38:42 2022] GET /identity/v3/users/bd73609b0ae242fe955820dfedf33257 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:42.490149 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4e82e-fbbd-4d23-8aa8-b31d4ec1dd99 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:42.582532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4e82e-fbbd-4d23-8aa8-b31d4ec1dd99 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:42.615686 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b5b46-9cee-48e4-8b72-012de21c5334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:42.616314 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b5b46-9cee-48e4-8b72-012de21c5334 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:42.616595 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b5b46-9cee-48e4-8b72-012de21c5334 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:42.616866 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b5b46-9cee-48e4-8b72-012de21c5334 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:42.678630 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b5b46-9cee-48e4-8b72-012de21c5334 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:42.680047 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b5b46-9cee-48e4-8b72-012de21c5334 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:42.771005 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 539/1104] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:38:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:38:42.776959 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a115e-6c8a-4d4b-b4fd-61c64cf2f297 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:42.870391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a115e-6c8a-4d4b-b4fd-61c64cf2f297 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:42.902577 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d5842-6ac0-421a-bd38-82700b8c72d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:42.903443 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d5842-6ac0-421a-bd38-82700b8c72d4 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:42.903720 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d5842-6ac0-421a-bd38-82700b8c72d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:42.903989 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d5842-6ac0-421a-bd38-82700b8c72d4 None admin] PATH_INFO: `/v3/projects/6865c37dd5b6408cb074997dab9c8a4e` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:42.905169 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d5842-6ac0-421a-bd38-82700b8c72d4 None admin] RBAC: Authorizing `identity:get_project(project_id=6865c37dd5b6408cb074997dab9c8a4e)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:42.906612 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d5842-6ac0-421a-bd38-82700b8c72d4 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:42.908293 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 566/1105] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:38:42 2022] GET /identity/v3/projects/6865c37dd5b6408cb074997dab9c8a4e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:42.914846 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b5b46-9cee-48e4-8b72-012de21c5334 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:43.011470 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b5b46-9cee-48e4-8b72-012de21c5334 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:43.043438 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a10997-b6cf-47eb-8afb-3dd7ced70385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:43.044016 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a10997-b6cf-47eb-8afb-3dd7ced70385 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:43.044300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a10997-b6cf-47eb-8afb-3dd7ced70385 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:43.044575 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a10997-b6cf-47eb-8afb-3dd7ced70385 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:43.045486 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a10997-b6cf-47eb-8afb-3dd7ced70385 None admin] RBAC: Adding query filter params (role.id=13de1ce875d44fcc988cc31b3a0639be, scope.project.id=6865c37dd5b6408cb074997dab9c8a4e, user.id=bd73609b0ae242fe955820dfedf33257) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:43.045800 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a10997-b6cf-47eb-8afb-3dd7ced70385 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:43.047243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a10997-b6cf-47eb-8afb-3dd7ced70385 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:43.052821 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 540/1106] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:38:42 2022] GET /identity/v3/role_assignments?user.id=bd73609b0ae242fe955820dfedf33257&scope.project.id=6865c37dd5b6408cb074997dab9c8a4e&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:45.352492 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808b27a-d972-4504-ab13-22734259da09 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:45.353014 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808b27a-d972-4504-ab13-22734259da09 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:45.353014 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808b27a-d972-4504-ab13-22734259da09 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:45.354310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 567/1107] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:45.359762 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d3ec0-726d-4a86-a8f5-6ea6a0ffcd3c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:45.360153 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d3ec0-726d-4a86-a8f5-6ea6a0ffcd3c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:45.360319 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d3ec0-726d-4a86-a8f5-6ea6a0ffcd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:45.376445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-fa3d3ec0-726d-4a86-a8f5-6ea6a0ffcd3c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:45.377609 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-fa3d3ec0-726d-4a86-a8f5-6ea6a0ffcd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:45.439673 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 541/1108] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:45.466330 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808b27a-d972-4504-ab13-22734259da09 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:45.560721 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808b27a-d972-4504-ab13-22734259da09 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:45.591780 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda15fe-c59e-4b23-aa7c-a632f1e7e8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:45.592546 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda15fe-c59e-4b23-aa7c-a632f1e7e8f1 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:45.592819 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda15fe-c59e-4b23-aa7c-a632f1e7e8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:45.593082 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda15fe-c59e-4b23-aa7c-a632f1e7e8f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:45.594207 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda15fe-c59e-4b23-aa7c-a632f1e7e8f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:45.595650 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbda15fe-c59e-4b23-aa7c-a632f1e7e8f1 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:45.597216 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 568/1109] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:45.603132 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d3ec0-726d-4a86-a8f5-6ea6a0ffcd3c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:45.694418 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d3ec0-726d-4a86-a8f5-6ea6a0ffcd3c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:45.725179 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075906eb-3737-4ba6-add0-f70e3c405f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:45.725826 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075906eb-3737-4ba6-add0-f70e3c405f71 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:45.726109 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075906eb-3737-4ba6-add0-f70e3c405f71 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:45.726386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075906eb-3737-4ba6-add0-f70e3c405f71 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:45.727109 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075906eb-3737-4ba6-add0-f70e3c405f71 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:45.728529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075906eb-3737-4ba6-add0-f70e3c405f71 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:45.748019 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 542/1110] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Apr 11 16:38:45 2022] POST /identity/v3/users => generated 286 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:38:48.050255 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1ba31-531a-4bcb-b472-0b3322b679f1 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:48.050765 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1ba31-531a-4bcb-b472-0b3322b679f1 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:48.050893 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1ba31-531a-4bcb-b472-0b3322b679f1 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:48.052688 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 569/1111] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:48.057789 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96e4fe-41e3-4f32-a189-a4fa2c66219d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:48.058225 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96e4fe-41e3-4f32-a189-a4fa2c66219d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:48.058349 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96e4fe-41e3-4f32-a189-a4fa2c66219d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:48.075097 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6e96e4fe-41e3-4f32-a189-a4fa2c66219d None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:48.076265 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6e96e4fe-41e3-4f32-a189-a4fa2c66219d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:48.142767 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 543/1112] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:38:48.167250 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1ba31-531a-4bcb-b472-0b3322b679f1 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:48.261260 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1ba31-531a-4bcb-b472-0b3322b679f1 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:48.293674 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c82c3b-b962-452e-8d54-74cec25e958d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:48.294510 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c82c3b-b962-452e-8d54-74cec25e958d None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:48.294820 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c82c3b-b962-452e-8d54-74cec25e958d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:48.295099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c82c3b-b962-452e-8d54-74cec25e958d None admin] PATH_INFO: `/v3/roles/807f93fb1a91497aba7762557ae039dd` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:48.296550 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c82c3b-b962-452e-8d54-74cec25e958d None admin] RBAC: Authorizing `identity:get_role(role_id=807f93fb1a91497aba7762557ae039dd)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:48.297912 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c82c3b-b962-452e-8d54-74cec25e958d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:48.299313 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 570/1113] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:38:48 2022] GET /identity/v3/roles/807f93fb1a91497aba7762557ae039dd => generated 223 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:48.305535 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96e4fe-41e3-4f32-a189-a4fa2c66219d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:48.397673 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96e4fe-41e3-4f32-a189-a4fa2c66219d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:48.429117 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a1f24-540e-491e-87e6-2c0dc9baba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:48.429965 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a1f24-540e-491e-87e6-2c0dc9baba16 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:48.430248 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a1f24-540e-491e-87e6-2c0dc9baba16 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:48.430529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a1f24-540e-491e-87e6-2c0dc9baba16 None admin] PATH_INFO: `/v3/users/726705f6e15c4dbbad13826c7ccf9f5f` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:48.444258 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a1f24-540e-491e-87e6-2c0dc9baba16 None admin] RBAC: Authorizing `identity:get_user(user_id=726705f6e15c4dbbad13826c7ccf9f5f)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:48.445680 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a1f24-540e-491e-87e6-2c0dc9baba16 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:48.447331 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 544/1114] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:38:48 2022] GET /identity/v3/users/726705f6e15c4dbbad13826c7ccf9f5f => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:48.453034 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c82c3b-b962-452e-8d54-74cec25e958d None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:48.545211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c82c3b-b962-452e-8d54-74cec25e958d None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:48.577311 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d7477-b2e5-441a-80ca-b3b3270f8e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:48.577935 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d7477-b2e5-441a-80ca-b3b3270f8e5e None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:48.578211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d7477-b2e5-441a-80ca-b3b3270f8e5e None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:48.578480 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d7477-b2e5-441a-80ca-b3b3270f8e5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:48.639607 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d7477-b2e5-441a-80ca-b3b3270f8e5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:48.641133 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d7477-b2e5-441a-80ca-b3b3270f8e5e None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:48.729998 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 571/1115] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:38:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:38:48.735864 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a1f24-540e-491e-87e6-2c0dc9baba16 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:48.828884 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a1f24-540e-491e-87e6-2c0dc9baba16 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:48.859751 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b47f02-c7b9-4970-87b6-d653b8752679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:48.860588 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b47f02-c7b9-4970-87b6-d653b8752679 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:48.860871 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b47f02-c7b9-4970-87b6-d653b8752679 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:48.861145 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b47f02-c7b9-4970-87b6-d653b8752679 None admin] PATH_INFO: `/v3/projects/6865c37dd5b6408cb074997dab9c8a4e` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:48.862307 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b47f02-c7b9-4970-87b6-d653b8752679 None admin] RBAC: Authorizing `identity:get_project(project_id=6865c37dd5b6408cb074997dab9c8a4e)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:48.864259 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b47f02-c7b9-4970-87b6-d653b8752679 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:48.865920 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 545/1116] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:38:48 2022] GET /identity/v3/projects/6865c37dd5b6408cb074997dab9c8a4e => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:48.872103 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d7477-b2e5-441a-80ca-b3b3270f8e5e None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:48.964444 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d7477-b2e5-441a-80ca-b3b3270f8e5e None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:48.996883 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ed643-ccc3-4af7-a7b2-223abde05e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:48.997515 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ed643-ccc3-4af7-a7b2-223abde05e77 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:48.997795 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ed643-ccc3-4af7-a7b2-223abde05e77 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:48.998066 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ed643-ccc3-4af7-a7b2-223abde05e77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:48.998909 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ed643-ccc3-4af7-a7b2-223abde05e77 None admin] RBAC: Adding query filter params (role.id=807f93fb1a91497aba7762557ae039dd, scope.project.id=6865c37dd5b6408cb074997dab9c8a4e, user.id=726705f6e15c4dbbad13826c7ccf9f5f) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:48.999218 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ed643-ccc3-4af7-a7b2-223abde05e77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:49.000627 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59ed643-ccc3-4af7-a7b2-223abde05e77 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:49.005765 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 572/1117] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:38:48 2022] GET /identity/v3/role_assignments?user.id=726705f6e15c4dbbad13826c7ccf9f5f&scope.project.id=6865c37dd5b6408cb074997dab9c8a4e&role.id=807f93fb1a91497aba7762557ae039dd => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:51.255366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23889d-2c1f-4b9f-a6d5-25391fa8ba2f None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:51.256165 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23889d-2c1f-4b9f-a6d5-25391fa8ba2f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:51.256165 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23889d-2c1f-4b9f-a6d5-25391fa8ba2f None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:51.257179 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 546/1118] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:51.262342 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7e640-8d10-4784-85a1-3683d0644674 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:51.262780 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7e640-8d10-4784-85a1-3683d0644674 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:51.262933 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7e640-8d10-4784-85a1-3683d0644674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:51.279716 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-79f7e640-8d10-4784-85a1-3683d0644674 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:51.280863 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-79f7e640-8d10-4784-85a1-3683d0644674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:51.341650 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 573/1119] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:38:51.363531 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23889d-2c1f-4b9f-a6d5-25391fa8ba2f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:51.457430 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23889d-2c1f-4b9f-a6d5-25391fa8ba2f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:51.488969 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cef72-da4a-4910-87ec-68cb89c3de18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:51.489798 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cef72-da4a-4910-87ec-68cb89c3de18 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:51.490079 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cef72-da4a-4910-87ec-68cb89c3de18 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:51.490353 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49cef72-da4a-4910-87ec-68cb89c3de18 None admin] PATH_INFO: `/v3/roles/807f93fb1a91497aba7762557ae039dd` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:51.491807 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49cef72-da4a-4910-87ec-68cb89c3de18 None admin] RBAC: Authorizing `identity:get_role(role_id=807f93fb1a91497aba7762557ae039dd)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:51.493148 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49cef72-da4a-4910-87ec-68cb89c3de18 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:51.494468 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 547/1120] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:38:51 2022] GET /identity/v3/roles/807f93fb1a91497aba7762557ae039dd => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:51.500147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7e640-8d10-4784-85a1-3683d0644674 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:51.590484 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7e640-8d10-4784-85a1-3683d0644674 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:51.621409 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e35eb-8fda-4a02-bac2-944680667470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:51.622242 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e35eb-8fda-4a02-bac2-944680667470 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:51.622518 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e35eb-8fda-4a02-bac2-944680667470 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:51.622816 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e35eb-8fda-4a02-bac2-944680667470 None admin] PATH_INFO: `/v3/users/726705f6e15c4dbbad13826c7ccf9f5f` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:51.623968 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e35eb-8fda-4a02-bac2-944680667470 None admin] RBAC: Authorizing `identity:get_user(user_id=726705f6e15c4dbbad13826c7ccf9f5f)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:51.625372 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e35eb-8fda-4a02-bac2-944680667470 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:51.626979 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 574/1121] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:38:51 2022] GET /identity/v3/users/726705f6e15c4dbbad13826c7ccf9f5f => generated 286 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:51.632595 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cef72-da4a-4910-87ec-68cb89c3de18 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:51.724975 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49cef72-da4a-4910-87ec-68cb89c3de18 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:51.755987 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae23296-61b9-4679-970d-77186f30ca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:51.756844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae23296-61b9-4679-970d-77186f30ca7b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:51.757125 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae23296-61b9-4679-970d-77186f30ca7b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:51.757402 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae23296-61b9-4679-970d-77186f30ca7b None admin] PATH_INFO: `/v3/projects/6865c37dd5b6408cb074997dab9c8a4e` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:51.758553 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae23296-61b9-4679-970d-77186f30ca7b None admin] RBAC: Authorizing `identity:get_project(project_id=6865c37dd5b6408cb074997dab9c8a4e)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:51.759996 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae23296-61b9-4679-970d-77186f30ca7b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:51.761653 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 548/1122] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:38:51 2022] GET /identity/v3/projects/6865c37dd5b6408cb074997dab9c8a4e => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:51.768906 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e35eb-8fda-4a02-bac2-944680667470 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:51.860358 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e35eb-8fda-4a02-bac2-944680667470 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:51.892182 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25de9d-84b9-4df1-b24b-5b3830320389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:51.893047 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25de9d-84b9-4df1-b24b-5b3830320389 None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:51.893324 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25de9d-84b9-4df1-b24b-5b3830320389 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:51.893596 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25de9d-84b9-4df1-b24b-5b3830320389 None admin] PATH_INFO: `/v3/projects/6865c37dd5b6408cb074997dab9c8a4e/users/726705f6e15c4dbbad13826c7ccf9f5f/roles/807f93fb1a91497aba7762557ae039dd` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:51.895775 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25de9d-84b9-4df1-b24b-5b3830320389 None admin] RBAC: Authorizing `identity:create_grant(project_id=6865c37dd5b6408cb074997dab9c8a4e, user_id=726705f6e15c4dbbad13826c7ccf9f5f, role_id=807f93fb1a91497aba7762557ae039dd)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:51.897195 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25de9d-84b9-4df1-b24b-5b3830320389 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:51.909782 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 575/1123] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:38:51 2022] PUT /identity/v3/projects/6865c37dd5b6408cb074997dab9c8a4e/users/726705f6e15c4dbbad13826c7ccf9f5f/roles/807f93fb1a91497aba7762557ae039dd => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:38:54.169716 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9468420-f256-45e8-9789-35ac6a677834 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:54.170253 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9468420-f256-45e8-9789-35ac6a677834 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:54.170253 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9468420-f256-45e8-9789-35ac6a677834 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:54.171658 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 549/1124] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:54.176788 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a87a42-bc78-4053-82fa-dcfc245df8a7 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:54.177185 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a87a42-bc78-4053-82fa-dcfc245df8a7 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:54.177328 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a87a42-bc78-4053-82fa-dcfc245df8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:54.193866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-b9a87a42-bc78-4053-82fa-dcfc245df8a7 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:54.195021 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b9a87a42-bc78-4053-82fa-dcfc245df8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:54.256283 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 576/1125] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:54.281289 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9468420-f256-45e8-9789-35ac6a677834 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:54.374905 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9468420-f256-45e8-9789-35ac6a677834 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:54.405599 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d92290-d685-477d-8d42-ff48a0c05485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:54.406418 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d92290-d685-477d-8d42-ff48a0c05485 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:54.406726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d92290-d685-477d-8d42-ff48a0c05485 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:54.406999 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d92290-d685-477d-8d42-ff48a0c05485 None admin] PATH_INFO: `/v3/roles/807f93fb1a91497aba7762557ae039dd` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:54.408425 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d92290-d685-477d-8d42-ff48a0c05485 None admin] RBAC: Authorizing `identity:get_role(role_id=807f93fb1a91497aba7762557ae039dd)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:54.409761 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d92290-d685-477d-8d42-ff48a0c05485 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:54.411919 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 550/1126] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:38:54 2022] GET /identity/v3/roles/807f93fb1a91497aba7762557ae039dd => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:54.417757 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a87a42-bc78-4053-82fa-dcfc245df8a7 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:54.509970 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a87a42-bc78-4053-82fa-dcfc245df8a7 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:54.542118 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58102fc-0fad-463f-a254-7fd8f4f40923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:54.542996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58102fc-0fad-463f-a254-7fd8f4f40923 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:54.543277 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58102fc-0fad-463f-a254-7fd8f4f40923 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:54.543546 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58102fc-0fad-463f-a254-7fd8f4f40923 None admin] PATH_INFO: `/v3/users/726705f6e15c4dbbad13826c7ccf9f5f` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:54.544701 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58102fc-0fad-463f-a254-7fd8f4f40923 None admin] RBAC: Authorizing `identity:get_user(user_id=726705f6e15c4dbbad13826c7ccf9f5f)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:54.546125 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58102fc-0fad-463f-a254-7fd8f4f40923 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:54.547784 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 577/1127] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:38:54 2022] GET /identity/v3/users/726705f6e15c4dbbad13826c7ccf9f5f => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:54.553513 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d92290-d685-477d-8d42-ff48a0c05485 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:54.645212 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d92290-d685-477d-8d42-ff48a0c05485 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:54.676252 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166c8a1-fbbd-4a1b-b256-0bd452d52e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:54.676871 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166c8a1-fbbd-4a1b-b256-0bd452d52e06 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:54.677149 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166c8a1-fbbd-4a1b-b256-0bd452d52e06 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:54.677421 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166c8a1-fbbd-4a1b-b256-0bd452d52e06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:54.738260 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166c8a1-fbbd-4a1b-b256-0bd452d52e06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:54.739699 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c166c8a1-fbbd-4a1b-b256-0bd452d52e06 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:54.828474 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 551/1128] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:38:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:38:54.834601 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58102fc-0fad-463f-a254-7fd8f4f40923 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:54.927338 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58102fc-0fad-463f-a254-7fd8f4f40923 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:54.960107 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7d048-9e38-456b-a04d-cb67fbeb529d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:54.960948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7d048-9e38-456b-a04d-cb67fbeb529d None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:54.961228 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7d048-9e38-456b-a04d-cb67fbeb529d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:54.961503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7d048-9e38-456b-a04d-cb67fbeb529d None admin] PATH_INFO: `/v3/projects/6865c37dd5b6408cb074997dab9c8a4e` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:54.962688 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7d048-9e38-456b-a04d-cb67fbeb529d None admin] RBAC: Authorizing `identity:get_project(project_id=6865c37dd5b6408cb074997dab9c8a4e)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:54.964116 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7d048-9e38-456b-a04d-cb67fbeb529d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:54.965786 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 578/1129] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:38:54 2022] GET /identity/v3/projects/6865c37dd5b6408cb074997dab9c8a4e => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:54.971969 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166c8a1-fbbd-4a1b-b256-0bd452d52e06 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:55.061600 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c166c8a1-fbbd-4a1b-b256-0bd452d52e06 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:55.093455 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1b10b-4e27-421c-aa27-deef91d899c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:55.094033 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1b10b-4e27-421c-aa27-deef91d899c3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:55.094315 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1b10b-4e27-421c-aa27-deef91d899c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:55.094609 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1b10b-4e27-421c-aa27-deef91d899c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:55.095436 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1b10b-4e27-421c-aa27-deef91d899c3 None admin] RBAC: Adding query filter params (role.id=807f93fb1a91497aba7762557ae039dd, scope.project.id=6865c37dd5b6408cb074997dab9c8a4e, user.id=726705f6e15c4dbbad13826c7ccf9f5f) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:38:55.095745 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1b10b-4e27-421c-aa27-deef91d899c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:55.097142 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1b10b-4e27-421c-aa27-deef91d899c3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:55.103217 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 552/1130] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:38:54 2022] GET /identity/v3/role_assignments?user.id=726705f6e15c4dbbad13826c7ccf9f5f&scope.project.id=6865c37dd5b6408cb074997dab9c8a4e&role.id=807f93fb1a91497aba7762557ae039dd => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:57.378980 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f684e9-5982-4d9d-a4be-b96642c19020 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:57.379504 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f684e9-5982-4d9d-a4be-b96642c19020 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:57.379599 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f684e9-5982-4d9d-a4be-b96642c19020 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:57.380899 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 579/1131] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:38:57.385992 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47bf5d-ef91-4d80-940c-81cb3a4cd979 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:57.386424 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47bf5d-ef91-4d80-940c-81cb3a4cd979 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:57.386540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf47bf5d-ef91-4d80-940c-81cb3a4cd979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:57.403373 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-cf47bf5d-ef91-4d80-940c-81cb3a4cd979 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:38:57.404541 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-cf47bf5d-ef91-4d80-940c-81cb3a4cd979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:38:57.480193 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 553/1132] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:38:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:38:57.505460 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f684e9-5982-4d9d-a4be-b96642c19020 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:57.601991 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f684e9-5982-4d9d-a4be-b96642c19020 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:57.633222 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073319f-60c1-47e4-9ff9-564db8a8e9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:57.633939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073319f-60c1-47e4-9ff9-564db8a8e9d8 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:57.634219 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073319f-60c1-47e4-9ff9-564db8a8e9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:57.634493 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073319f-60c1-47e4-9ff9-564db8a8e9d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:57.635681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073319f-60c1-47e4-9ff9-564db8a8e9d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:57.637292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073319f-60c1-47e4-9ff9-564db8a8e9d8 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:57.639189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 580/1133] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:38:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:38:57.645540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47bf5d-ef91-4d80-940c-81cb3a4cd979 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:38:57.736860 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf47bf5d-ef91-4d80-940c-81cb3a4cd979 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:38:57.767964 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d988f4e-48c5-4e44-b0e0-2c5a031f6405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:38:57.768604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d988f4e-48c5-4e44-b0e0-2c5a031f6405 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:38:57.768881 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d988f4e-48c5-4e44-b0e0-2c5a031f6405 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:38:57.769182 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d988f4e-48c5-4e44-b0e0-2c5a031f6405 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:38:57.770384 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d988f4e-48c5-4e44-b0e0-2c5a031f6405 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:38:57.771891 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d988f4e-48c5-4e44-b0e0-2c5a031f6405 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:38:57.795974 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 554/1134] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Apr 11 16:38:57 2022] POST /identity/v3/projects => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:39:00.123961 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c1f82-d47b-4e7c-ad90-abe86b1ea4e1 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:00.124472 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c1f82-d47b-4e7c-ad90-abe86b1ea4e1 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:00.124582 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560c1f82-d47b-4e7c-ad90-abe86b1ea4e1 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:00.125888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 581/1135] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:39:00.131778 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc02d04-8458-4b4b-b674-bc194ace382a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:00.132192 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc02d04-8458-4b4b-b674-bc194ace382a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:00.132329 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc02d04-8458-4b4b-b674-bc194ace382a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:00.149157 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ddc02d04-8458-4b4b-b674-bc194ace382a None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:39:00.150309 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ddc02d04-8458-4b4b-b674-bc194ace382a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:39:00.211607 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 555/1136] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:39:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:39:00.236845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c1f82-d47b-4e7c-ad90-abe86b1ea4e1 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:00.330187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560c1f82-d47b-4e7c-ad90-abe86b1ea4e1 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:00.361279 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10bc71-8989-42fb-980a-69d8ab1ec35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:00.362043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10bc71-8989-42fb-980a-69d8ab1ec35b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:00.362317 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10bc71-8989-42fb-980a-69d8ab1ec35b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:00.362581 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10bc71-8989-42fb-980a-69d8ab1ec35b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:00.363770 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10bc71-8989-42fb-980a-69d8ab1ec35b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:00.365178 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10bc71-8989-42fb-980a-69d8ab1ec35b None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:00.366759 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 582/1137] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:39:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:00.372360 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc02d04-8458-4b4b-b674-bc194ace382a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:00.464530 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc02d04-8458-4b4b-b674-bc194ace382a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:00.495640 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c5026-dac2-4f4b-934b-5df95ebdc10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:00.496283 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c5026-dac2-4f4b-934b-5df95ebdc10b None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:00.496564 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c5026-dac2-4f4b-934b-5df95ebdc10b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:00.496835 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c5026-dac2-4f4b-934b-5df95ebdc10b None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:00.497520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c5026-dac2-4f4b-934b-5df95ebdc10b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:00.498964 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c5026-dac2-4f4b-934b-5df95ebdc10b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:00.517820 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 556/1138] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Apr 11 16:39:00 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:39:02.826450 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c2237-a355-4e28-9141-10e019e8e9ab None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:02.827046 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c2237-a355-4e28-9141-10e019e8e9ab None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:02.827046 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c2237-a355-4e28-9141-10e019e8e9ab None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:02.828373 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 583/1139] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:39:02.833930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e6429-08c9-48de-8d4f-347c8775282c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:02.834319 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e6429-08c9-48de-8d4f-347c8775282c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:02.834483 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18e6429-08c9-48de-8d4f-347c8775282c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:02.851692 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-d18e6429-08c9-48de-8d4f-347c8775282c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:39:02.852847 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d18e6429-08c9-48de-8d4f-347c8775282c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:39:02.915687 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 557/1140] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:39:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:39:02.940125 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c2237-a355-4e28-9141-10e019e8e9ab None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:03.035985 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c2237-a355-4e28-9141-10e019e8e9ab None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:03.066855 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a38d95-5786-43d9-8031-759e3afa21dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:03.067632 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a38d95-5786-43d9-8031-759e3afa21dc None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:03.067913 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a38d95-5786-43d9-8031-759e3afa21dc None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:03.068187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a38d95-5786-43d9-8031-759e3afa21dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:03.077676 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a38d95-5786-43d9-8031-759e3afa21dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:39:03.085057 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-18a38d95-5786-43d9-8031-759e3afa21dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:39:03.086227 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 584/1141] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:39:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:39:03.092264 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e6429-08c9-48de-8d4f-347c8775282c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:03.183591 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18e6429-08c9-48de-8d4f-347c8775282c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:03.215484 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa20813-753a-49d3-88e8-216521b07a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:03.216126 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa20813-753a-49d3-88e8-216521b07a7d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:03.216404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa20813-753a-49d3-88e8-216521b07a7d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:03.216676 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa20813-753a-49d3-88e8-216521b07a7d None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:03.217404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa20813-753a-49d3-88e8-216521b07a7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:39:03.217709 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa20813-753a-49d3-88e8-216521b07a7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:03.219084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa20813-753a-49d3-88e8-216521b07a7d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:03.226655 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 558/1142] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:39:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:03.232122 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a38d95-5786-43d9-8031-759e3afa21dc None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:03.324737 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a38d95-5786-43d9-8031-759e3afa21dc None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:03.356062 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7f044-d275-4974-b2b6-f9bd5a756f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:03.356845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7f044-d275-4974-b2b6-f9bd5a756f1c None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:03.357122 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7f044-d275-4974-b2b6-f9bd5a756f1c None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:03.357393 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7f044-d275-4974-b2b6-f9bd5a756f1c None admin] PATH_INFO: `/v3/users/207a9e23639b4b71bf80d8b24cb3ef92` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:03.369551 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7f044-d275-4974-b2b6-f9bd5a756f1c None admin] RBAC: Authorizing `identity:get_user(user_id=207a9e23639b4b71bf80d8b24cb3ef92)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:03.370997 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7f044-d275-4974-b2b6-f9bd5a756f1c None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:03.372594 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 585/1143] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:39:03 2022] GET /identity/v3/users/207a9e23639b4b71bf80d8b24cb3ef92 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:03.378227 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa20813-753a-49d3-88e8-216521b07a7d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:03.476783 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa20813-753a-49d3-88e8-216521b07a7d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:03.508258 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe8e07-47ea-435b-845e-4599d73d1aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:03.508886 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe8e07-47ea-435b-845e-4599d73d1aa6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:03.509166 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe8e07-47ea-435b-845e-4599d73d1aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:03.509440 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfe8e07-47ea-435b-845e-4599d73d1aa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:03.570607 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe8e07-47ea-435b-845e-4599d73d1aa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:03.572034 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfe8e07-47ea-435b-845e-4599d73d1aa6 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:03.661135 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 559/1144] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:39:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:39:03.666949 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7f044-d275-4974-b2b6-f9bd5a756f1c None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:03.759733 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7f044-d275-4974-b2b6-f9bd5a756f1c None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:03.795037 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a75a6-1ec8-4122-9a51-2195f7b6a261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:03.795871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a75a6-1ec8-4122-9a51-2195f7b6a261 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:03.796152 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a75a6-1ec8-4122-9a51-2195f7b6a261 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:03.796428 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a75a6-1ec8-4122-9a51-2195f7b6a261 None admin] PATH_INFO: `/v3/projects/897f8e9b56124cfa885763f4d040c255` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:03.797578 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a75a6-1ec8-4122-9a51-2195f7b6a261 None admin] RBAC: Authorizing `identity:get_project(project_id=897f8e9b56124cfa885763f4d040c255)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:03.799027 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a75a6-1ec8-4122-9a51-2195f7b6a261 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:03.801179 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 586/1145] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:39:03 2022] GET /identity/v3/projects/897f8e9b56124cfa885763f4d040c255 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:03.807384 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe8e07-47ea-435b-845e-4599d73d1aa6 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:03.896791 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfe8e07-47ea-435b-845e-4599d73d1aa6 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:03.928725 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a9453-def1-4686-b310-f1e2e533445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:03.929302 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a9453-def1-4686-b310-f1e2e533445e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:03.929579 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a9453-def1-4686-b310-f1e2e533445e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:03.929848 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a9453-def1-4686-b310-f1e2e533445e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:03.930693 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a9453-def1-4686-b310-f1e2e533445e None admin] RBAC: Adding query filter params (role.id=13de1ce875d44fcc988cc31b3a0639be, scope.project.id=897f8e9b56124cfa885763f4d040c255, user.id=207a9e23639b4b71bf80d8b24cb3ef92) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:39:03.931000 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a9453-def1-4686-b310-f1e2e533445e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:03.932391 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7a9453-def1-4686-b310-f1e2e533445e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:03.937507 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 560/1146] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:39:03 2022] GET /identity/v3/role_assignments?user.id=207a9e23639b4b71bf80d8b24cb3ef92&scope.project.id=897f8e9b56124cfa885763f4d040c255&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 259 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:39:06.183431 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdf7a0-1219-4e7a-8d45-e6eb88af3136 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:06.183943 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdf7a0-1219-4e7a-8d45-e6eb88af3136 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:06.183943 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bdf7a0-1219-4e7a-8d45-e6eb88af3136 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:06.185328 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 587/1147] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:39:06.190475 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaf31a-67eb-490f-900a-bb3bf317a164 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:06.191479 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaf31a-67eb-490f-900a-bb3bf317a164 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:06.191589 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebaf31a-67eb-490f-900a-bb3bf317a164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:06.208219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9ebaf31a-67eb-490f-900a-bb3bf317a164 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:39:06.209386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9ebaf31a-67eb-490f-900a-bb3bf317a164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:39:06.272180 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 561/1148] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:39:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 16:39:06.294105 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdf7a0-1219-4e7a-8d45-e6eb88af3136 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:06.388351 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bdf7a0-1219-4e7a-8d45-e6eb88af3136 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:06.419700 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad084dca-01ab-46e7-ba00-a53b352d8952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:06.420485 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad084dca-01ab-46e7-ba00-a53b352d8952 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:06.420763 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad084dca-01ab-46e7-ba00-a53b352d8952 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:06.421035 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad084dca-01ab-46e7-ba00-a53b352d8952 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:06.430552 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad084dca-01ab-46e7-ba00-a53b352d8952 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:39:06.437359 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-ad084dca-01ab-46e7-ba00-a53b352d8952 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:39:06.438519 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 588/1149] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:39:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:39:06.446247 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaf31a-67eb-490f-900a-bb3bf317a164 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:06.537378 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebaf31a-67eb-490f-900a-bb3bf317a164 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:06.569354 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a487872-08be-416a-84c7-8a10cba37de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:06.570003 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a487872-08be-416a-84c7-8a10cba37de9 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:06.570287 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a487872-08be-416a-84c7-8a10cba37de9 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:06.570561 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a487872-08be-416a-84c7-8a10cba37de9 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:06.571328 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a487872-08be-416a-84c7-8a10cba37de9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:39:06.571633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a487872-08be-416a-84c7-8a10cba37de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:06.572988 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a487872-08be-416a-84c7-8a10cba37de9 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:06.580583 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 562/1150] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:39:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:06.586290 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad084dca-01ab-46e7-ba00-a53b352d8952 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:06.680400 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad084dca-01ab-46e7-ba00-a53b352d8952 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:06.711488 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e6ba9-4112-479d-b7ca-a34db33f1aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:06.712272 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e6ba9-4112-479d-b7ca-a34db33f1aa8 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:06.712549 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e6ba9-4112-479d-b7ca-a34db33f1aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:06.712819 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e6ba9-4112-479d-b7ca-a34db33f1aa8 None admin] PATH_INFO: `/v3/users/207a9e23639b4b71bf80d8b24cb3ef92` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:06.713972 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e6ba9-4112-479d-b7ca-a34db33f1aa8 None admin] RBAC: Authorizing `identity:get_user(user_id=207a9e23639b4b71bf80d8b24cb3ef92)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:06.715419 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e6ba9-4112-479d-b7ca-a34db33f1aa8 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:06.717012 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 589/1151] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:39:06 2022] GET /identity/v3/users/207a9e23639b4b71bf80d8b24cb3ef92 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:06.723198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a487872-08be-416a-84c7-8a10cba37de9 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:06.815819 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a487872-08be-416a-84c7-8a10cba37de9 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:06.847655 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb3286-c3ac-4568-9b84-62a24994e3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:06.848489 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb3286-c3ac-4568-9b84-62a24994e3b2 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:06.848770 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb3286-c3ac-4568-9b84-62a24994e3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:06.849042 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb3286-c3ac-4568-9b84-62a24994e3b2 None admin] PATH_INFO: `/v3/projects/897f8e9b56124cfa885763f4d040c255` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:06.850203 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb3286-c3ac-4568-9b84-62a24994e3b2 None admin] RBAC: Authorizing `identity:get_project(project_id=897f8e9b56124cfa885763f4d040c255)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:06.851638 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb3286-c3ac-4568-9b84-62a24994e3b2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:06.853303 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 563/1152] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:39:06 2022] GET /identity/v3/projects/897f8e9b56124cfa885763f4d040c255 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:06.859242 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e6ba9-4112-479d-b7ca-a34db33f1aa8 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:06.953356 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e6ba9-4112-479d-b7ca-a34db33f1aa8 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:06.984802 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c22f93-0659-4700-af95-7e14c0a3975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:06.985611 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c22f93-0659-4700-af95-7e14c0a3975a None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:06.985894 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c22f93-0659-4700-af95-7e14c0a3975a None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:06.986168 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c22f93-0659-4700-af95-7e14c0a3975a None admin] PATH_INFO: `/v3/projects/897f8e9b56124cfa885763f4d040c255/users/207a9e23639b4b71bf80d8b24cb3ef92/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:06.988138 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c22f93-0659-4700-af95-7e14c0a3975a None admin] RBAC: Authorizing `identity:create_grant(project_id=897f8e9b56124cfa885763f4d040c255, user_id=207a9e23639b4b71bf80d8b24cb3ef92, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:06.989557 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c22f93-0659-4700-af95-7e14c0a3975a None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:07.002057 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 590/1153] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:39:06 2022] PUT /identity/v3/projects/897f8e9b56124cfa885763f4d040c255/users/207a9e23639b4b71bf80d8b24cb3ef92/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:39:09.257765 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be68983-40e8-4878-81ba-7f870bba680e None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:09.258338 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be68983-40e8-4878-81ba-7f870bba680e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:09.258338 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be68983-40e8-4878-81ba-7f870bba680e None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:09.259646 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 564/1154] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:39:09.264931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2457ba9-57f5-46aa-88d4-1a2cc8dbe285 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:09.265315 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2457ba9-57f5-46aa-88d4-1a2cc8dbe285 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:09.265485 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2457ba9-57f5-46aa-88d4-1a2cc8dbe285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:09.281565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-a2457ba9-57f5-46aa-88d4-1a2cc8dbe285 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:39:09.282758 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a2457ba9-57f5-46aa-88d4-1a2cc8dbe285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:39:09.345191 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 591/1155] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:39:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:39:09.370349 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be68983-40e8-4878-81ba-7f870bba680e None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:09.464661 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be68983-40e8-4878-81ba-7f870bba680e None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:09.496286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21aec5-fd4a-4bfb-a4fb-077c7e76f208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:09.497053 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21aec5-fd4a-4bfb-a4fb-077c7e76f208 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:09.497333 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21aec5-fd4a-4bfb-a4fb-077c7e76f208 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:09.497608 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21aec5-fd4a-4bfb-a4fb-077c7e76f208 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:09.511234 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21aec5-fd4a-4bfb-a4fb-077c7e76f208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:39:09.518307 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-0e21aec5-fd4a-4bfb-a4fb-077c7e76f208 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:39:09.520004 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 565/1156] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:39:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:39:09.525943 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2457ba9-57f5-46aa-88d4-1a2cc8dbe285 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:09.617450 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2457ba9-57f5-46aa-88d4-1a2cc8dbe285 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:09.649073 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e70009-613d-4037-8c1e-be54bf93b4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:09.649715 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e70009-613d-4037-8c1e-be54bf93b4d1 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:09.649996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e70009-613d-4037-8c1e-be54bf93b4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:09.650269 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e70009-613d-4037-8c1e-be54bf93b4d1 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:09.651036 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e70009-613d-4037-8c1e-be54bf93b4d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:39:09.651341 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e70009-613d-4037-8c1e-be54bf93b4d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:09.652691 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e70009-613d-4037-8c1e-be54bf93b4d1 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:09.660279 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 592/1157] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:39:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:09.665861 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21aec5-fd4a-4bfb-a4fb-077c7e76f208 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:09.758184 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21aec5-fd4a-4bfb-a4fb-077c7e76f208 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:09.788912 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cd930-d5e2-4556-b336-d6c9e6ac6da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:09.789706 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cd930-d5e2-4556-b336-d6c9e6ac6da0 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:09.789989 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cd930-d5e2-4556-b336-d6c9e6ac6da0 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:09.790265 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3cd930-d5e2-4556-b336-d6c9e6ac6da0 None admin] PATH_INFO: `/v3/users/207a9e23639b4b71bf80d8b24cb3ef92` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:09.791450 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cd930-d5e2-4556-b336-d6c9e6ac6da0 None admin] RBAC: Authorizing `identity:get_user(user_id=207a9e23639b4b71bf80d8b24cb3ef92)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:09.792854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3cd930-d5e2-4556-b336-d6c9e6ac6da0 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:09.794438 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 566/1158] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:39:09 2022] GET /identity/v3/users/207a9e23639b4b71bf80d8b24cb3ef92 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:09.800487 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e70009-613d-4037-8c1e-be54bf93b4d1 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:09.894187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e70009-613d-4037-8c1e-be54bf93b4d1 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:09.926011 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406c3e1-6df3-42f3-a03f-530c80c6d1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:09.926670 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406c3e1-6df3-42f3-a03f-530c80c6d1ad None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:09.926951 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406c3e1-6df3-42f3-a03f-530c80c6d1ad None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:09.927223 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406c3e1-6df3-42f3-a03f-530c80c6d1ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:09.989052 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406c3e1-6df3-42f3-a03f-530c80c6d1ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:09.990464 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406c3e1-6df3-42f3-a03f-530c80c6d1ad None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:10.079171 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 593/1159] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:39:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:39:10.084955 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cd930-d5e2-4556-b336-d6c9e6ac6da0 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:10.177389 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3cd930-d5e2-4556-b336-d6c9e6ac6da0 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:10.207625 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17415da1-4c6d-4a8e-a859-99487d851355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:10.208463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17415da1-4c6d-4a8e-a859-99487d851355 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:10.208742 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17415da1-4c6d-4a8e-a859-99487d851355 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:10.209016 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17415da1-4c6d-4a8e-a859-99487d851355 None admin] PATH_INFO: `/v3/projects/897f8e9b56124cfa885763f4d040c255` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:10.210169 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17415da1-4c6d-4a8e-a859-99487d851355 None admin] RBAC: Authorizing `identity:get_project(project_id=897f8e9b56124cfa885763f4d040c255)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:10.211607 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17415da1-4c6d-4a8e-a859-99487d851355 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:10.213244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 567/1160] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:39:10 2022] GET /identity/v3/projects/897f8e9b56124cfa885763f4d040c255 => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:10.218953 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406c3e1-6df3-42f3-a03f-530c80c6d1ad None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:10.311285 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406c3e1-6df3-42f3-a03f-530c80c6d1ad None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:10.342654 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f4348f-fa78-45e7-bac6-8f7bd7f70c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:10.343253 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4348f-fa78-45e7-bac6-8f7bd7f70c89 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:10.343534 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4348f-fa78-45e7-bac6-8f7bd7f70c89 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:10.343811 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f4348f-fa78-45e7-bac6-8f7bd7f70c89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:10.344625 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4348f-fa78-45e7-bac6-8f7bd7f70c89 None admin] RBAC: Adding query filter params (role.id=13de1ce875d44fcc988cc31b3a0639be, scope.project.id=897f8e9b56124cfa885763f4d040c255, user.id=207a9e23639b4b71bf80d8b24cb3ef92) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:39:10.344934 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4348f-fa78-45e7-bac6-8f7bd7f70c89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:10.346342 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f4348f-fa78-45e7-bac6-8f7bd7f70c89 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:10.352396 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 594/1161] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:39:10 2022] GET /identity/v3/role_assignments?user.id=207a9e23639b4b71bf80d8b24cb3ef92&scope.project.id=897f8e9b56124cfa885763f4d040c255&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:12.644365 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db01873-0a6a-4b71-99af-894bdb760e66 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:12.644890 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db01873-0a6a-4b71-99af-894bdb760e66 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:12.644890 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db01873-0a6a-4b71-99af-894bdb760e66 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:12.646249 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 568/1162] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:39:12.651432 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a28de-5bd0-4d96-9cc5-ad4683728efa None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:12.651824 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a28de-5bd0-4d96-9cc5-ad4683728efa None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:12.651984 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a28de-5bd0-4d96-9cc5-ad4683728efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:12.667965 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-da0a28de-5bd0-4d96-9cc5-ad4683728efa None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:39:12.669124 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-da0a28de-5bd0-4d96-9cc5-ad4683728efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:39:12.730558 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 595/1163] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:39:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:39:12.752540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db01873-0a6a-4b71-99af-894bdb760e66 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:12.845944 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db01873-0a6a-4b71-99af-894bdb760e66 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:12.876999 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b105e-6b05-4a20-ad74-a08705ab7620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:12.877630 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b105e-6b05-4a20-ad74-a08705ab7620 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:12.878437 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b105e-6b05-4a20-ad74-a08705ab7620 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:12.878843 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b105e-6b05-4a20-ad74-a08705ab7620 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:12.941106 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b105e-6b05-4a20-ad74-a08705ab7620 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:12.942469 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51b105e-6b05-4a20-ad74-a08705ab7620 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:13.032585 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 569/1164] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:39:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 16:39:13.040654 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a28de-5bd0-4d96-9cc5-ad4683728efa None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:13.135367 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a28de-5bd0-4d96-9cc5-ad4683728efa None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:13.166792 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613b768-29b4-4f9c-a7eb-8b6ae49545ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:13.167578 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613b768-29b4-4f9c-a7eb-8b6ae49545ae None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:13.167858 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613b768-29b4-4f9c-a7eb-8b6ae49545ae None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:13.168129 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613b768-29b4-4f9c-a7eb-8b6ae49545ae None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:13.174373 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613b768-29b4-4f9c-a7eb-8b6ae49545ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:13.176387 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613b768-29b4-4f9c-a7eb-8b6ae49545ae None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:13.189113 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-0613b768-29b4-4f9c-a7eb-8b6ae49545ae None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 11 16:39:13.190287 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 596/1165] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Apr 11 16:39:13 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:39:13.196327 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b105e-6b05-4a20-ad74-a08705ab7620 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:13.287673 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b105e-6b05-4a20-ad74-a08705ab7620 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:13.318464 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af0fc7-5417-4509-a979-06a2149d672b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:13.319274 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af0fc7-5417-4509-a979-06a2149d672b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:13.319552 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af0fc7-5417-4509-a979-06a2149d672b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:13.319821 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af0fc7-5417-4509-a979-06a2149d672b None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:13.320519 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af0fc7-5417-4509-a979-06a2149d672b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:39:13.320818 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af0fc7-5417-4509-a979-06a2149d672b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:13.322153 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af0fc7-5417-4509-a979-06a2149d672b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:13.328891 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 570/1166] 10.222.0.73 () {56 vars in 1115 bytes} [Mon Apr 11 16:39:13 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:15.619870 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7cdf8-d58e-4dde-9faa-f5ece11c68eb None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:15.620423 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7cdf8-d58e-4dde-9faa-f5ece11c68eb None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:15.620423 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7cdf8-d58e-4dde-9faa-f5ece11c68eb None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:15.621777 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 597/1167] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:39:15.626784 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a0c7e-cd12-4a88-9c0f-2038eb42ce94 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:15.627222 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a0c7e-cd12-4a88-9c0f-2038eb42ce94 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:15.627337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0a0c7e-cd12-4a88-9c0f-2038eb42ce94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:15.644117 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-1f0a0c7e-cd12-4a88-9c0f-2038eb42ce94 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:39:15.645258 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1f0a0c7e-cd12-4a88-9c0f-2038eb42ce94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:39:15.707898 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 571/1168] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:39:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:39:15.731719 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7cdf8-d58e-4dde-9faa-f5ece11c68eb None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:15.827376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7cdf8-d58e-4dde-9faa-f5ece11c68eb None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:15.857784 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04ad20-d934-4591-b4d4-47e41d415d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:15.858415 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04ad20-d934-4591-b4d4-47e41d415d18 None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:15.858718 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04ad20-d934-4591-b4d4-47e41d415d18 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:15.858986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04ad20-d934-4591-b4d4-47e41d415d18 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:15.859708 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04ad20-d934-4591-b4d4-47e41d415d18 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:15.861055 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04ad20-d934-4591-b4d4-47e41d415d18 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:15.876693 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 598/1169] 10.222.0.73 () {60 vars in 1138 bytes} [Mon Apr 11 16:39:15 2022] POST /identity/v3/domains => generated 267 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:39:18.193776 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2a2dd-8462-4b9b-a16b-9be3fe15defb None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:18.194277 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2a2dd-8462-4b9b-a16b-9be3fe15defb None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:18.194277 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2a2dd-8462-4b9b-a16b-9be3fe15defb None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:18.195633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 572/1170] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:39:18.200768 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d4453-7e9d-42d6-b713-b07f18d7587d None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:18.201210 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d4453-7e9d-42d6-b713-b07f18d7587d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:18.201312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d4453-7e9d-42d6-b713-b07f18d7587d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:18.217962 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-0c9d4453-7e9d-42d6-b713-b07f18d7587d None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:39:18.219152 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-0c9d4453-7e9d-42d6-b713-b07f18d7587d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:39:18.280668 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 599/1171] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:39:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:39:18.305618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2a2dd-8462-4b9b-a16b-9be3fe15defb None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:18.400465 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c2a2dd-8462-4b9b-a16b-9be3fe15defb None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:18.432139 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03510bc-16e5-41c2-a523-ad1d6ff53248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:18.432974 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03510bc-16e5-41c2-a523-ad1d6ff53248 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:18.433252 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03510bc-16e5-41c2-a523-ad1d6ff53248 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:18.433523 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03510bc-16e5-41c2-a523-ad1d6ff53248 None admin] PATH_INFO: `/v3/domains/2077d7a08aab4e5eae7484508059dba7` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:18.443291 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03510bc-16e5-41c2-a523-ad1d6ff53248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2077d7a08aab4e5eae7484508059dba7)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:18.444752 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03510bc-16e5-41c2-a523-ad1d6ff53248 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:18.446286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 573/1172] 10.222.0.73 () {56 vars in 1183 bytes} [Mon Apr 11 16:39:18 2022] GET /identity/v3/domains/2077d7a08aab4e5eae7484508059dba7 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:18.451914 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d4453-7e9d-42d6-b713-b07f18d7587d None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:18.542435 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d4453-7e9d-42d6-b713-b07f18d7587d None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:18.573025 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29251fec-9602-4b0e-bdb7-a6cebb444c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:18.573656 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29251fec-9602-4b0e-bdb7-a6cebb444c9d None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:18.573939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29251fec-9602-4b0e-bdb7-a6cebb444c9d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:18.574211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29251fec-9602-4b0e-bdb7-a6cebb444c9d None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:18.574920 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29251fec-9602-4b0e-bdb7-a6cebb444c9d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:18.576334 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29251fec-9602-4b0e-bdb7-a6cebb444c9d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:18.600481 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 600/1173] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Apr 11 16:39:18 2022] POST /identity/v3/projects => generated 361 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:39:20.913198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee883d-5b9c-467f-a623-8ea25271eefa None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:20.913717 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee883d-5b9c-467f-a623-8ea25271eefa None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:20.913829 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee883d-5b9c-467f-a623-8ea25271eefa None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:20.915139 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 574/1174] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:39:20.920353 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7be17-a3e4-4805-b02f-1edf5d849b46 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:20.920776 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7be17-a3e4-4805-b02f-1edf5d849b46 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:20.920904 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7be17-a3e4-4805-b02f-1edf5d849b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:20.936941 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-85e7be17-a3e4-4805-b02f-1edf5d849b46 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:39:20.938110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-85e7be17-a3e4-4805-b02f-1edf5d849b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:39:20.999780 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 601/1175] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:39:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:39:21.026320 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee883d-5b9c-467f-a623-8ea25271eefa None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:21.122526 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee883d-5b9c-467f-a623-8ea25271eefa None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:21.155159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba06f95-6c08-4e1d-92e4-29c41656b14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:21.156001 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba06f95-6c08-4e1d-92e4-29c41656b14b None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:21.156281 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba06f95-6c08-4e1d-92e4-29c41656b14b None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:21.156551 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba06f95-6c08-4e1d-92e4-29c41656b14b None admin] PATH_INFO: `/v3/domains/2077d7a08aab4e5eae7484508059dba7` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:21.157716 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba06f95-6c08-4e1d-92e4-29c41656b14b None admin] RBAC: Authorizing `identity:get_domain(domain_id=2077d7a08aab4e5eae7484508059dba7)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:21.159227 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba06f95-6c08-4e1d-92e4-29c41656b14b None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:21.160824 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 575/1176] 10.222.0.73 () {56 vars in 1183 bytes} [Mon Apr 11 16:39:21 2022] GET /identity/v3/domains/2077d7a08aab4e5eae7484508059dba7 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:21.166701 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7be17-a3e4-4805-b02f-1edf5d849b46 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:21.259417 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7be17-a3e4-4805-b02f-1edf5d849b46 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:21.291656 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c8ad6-6400-4921-8905-21cb29c5d407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:21.292316 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c8ad6-6400-4921-8905-21cb29c5d407 None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:21.292598 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c8ad6-6400-4921-8905-21cb29c5d407 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:21.292872 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c8ad6-6400-4921-8905-21cb29c5d407 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:21.293572 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c8ad6-6400-4921-8905-21cb29c5d407 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:21.295042 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c8ad6-6400-4921-8905-21cb29c5d407 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:21.313511 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 602/1177] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Apr 11 16:39:21 2022] POST /identity/v3/users => generated 311 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:39:23.664585 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518f428-aa68-4369-9f48-446cf4c58279 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:23.665115 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518f428-aa68-4369-9f48-446cf4c58279 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:23.665115 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518f428-aa68-4369-9f48-446cf4c58279 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:23.666456 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 576/1178] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:39:23.671659 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2439c7-952b-4b0a-add7-1fe6aac8e37e None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:23.672205 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2439c7-952b-4b0a-add7-1fe6aac8e37e None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:23.672205 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2439c7-952b-4b0a-add7-1fe6aac8e37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:23.688688 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-fe2439c7-952b-4b0a-add7-1fe6aac8e37e None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:39:23.690370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-fe2439c7-952b-4b0a-add7-1fe6aac8e37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:39:23.752996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 603/1179] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:39:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:39:23.777317 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518f428-aa68-4369-9f48-446cf4c58279 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:23.871187 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518f428-aa68-4369-9f48-446cf4c58279 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:23.903547 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6531e-36f5-4f1b-9b8b-d4d61dc349a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:23.904346 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6531e-36f5-4f1b-9b8b-d4d61dc349a1 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:23.904625 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6531e-36f5-4f1b-9b8b-d4d61dc349a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:23.904896 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6531e-36f5-4f1b-9b8b-d4d61dc349a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:23.914953 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6531e-36f5-4f1b-9b8b-d4d61dc349a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:39:23.921694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-41a6531e-36f5-4f1b-9b8b-d4d61dc349a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:39:23.922923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 577/1180] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:39:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:39:23.929409 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2439c7-952b-4b0a-add7-1fe6aac8e37e None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:24.021570 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2439c7-952b-4b0a-add7-1fe6aac8e37e None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:24.052701 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e7c19-1a07-498e-89fd-20b320fe29a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:24.053345 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e7c19-1a07-498e-89fd-20b320fe29a8 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:24.053618 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e7c19-1a07-498e-89fd-20b320fe29a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:24.053886 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e7c19-1a07-498e-89fd-20b320fe29a8 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:24.054636 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e7c19-1a07-498e-89fd-20b320fe29a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:39:24.054940 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e7c19-1a07-498e-89fd-20b320fe29a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:24.056290 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e7c19-1a07-498e-89fd-20b320fe29a8 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:24.063759 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 604/1181] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:39:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:24.070116 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6531e-36f5-4f1b-9b8b-d4d61dc349a1 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:24.162558 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6531e-36f5-4f1b-9b8b-d4d61dc349a1 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:24.193432 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4aa04-8d14-497e-bdf3-10da966bbf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:24.194220 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4aa04-8d14-497e-bdf3-10da966bbf4d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:24.194496 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4aa04-8d14-497e-bdf3-10da966bbf4d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:24.194791 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4aa04-8d14-497e-bdf3-10da966bbf4d None admin] PATH_INFO: `/v3/users/80a4dff548694223b8ae3e91057ca590` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:24.206977 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4aa04-8d14-497e-bdf3-10da966bbf4d None admin] RBAC: Authorizing `identity:get_user(user_id=80a4dff548694223b8ae3e91057ca590)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:24.208391 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4aa04-8d14-497e-bdf3-10da966bbf4d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:24.209990 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 578/1182] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:39:24 2022] GET /identity/v3/users/80a4dff548694223b8ae3e91057ca590 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:24.215892 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e7c19-1a07-498e-89fd-20b320fe29a8 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:24.310048 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e7c19-1a07-498e-89fd-20b320fe29a8 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:24.340639 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad921a1-c26f-4b78-9237-3e27bc444aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:24.341273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad921a1-c26f-4b78-9237-3e27bc444aa3 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:24.341556 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad921a1-c26f-4b78-9237-3e27bc444aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:24.341833 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad921a1-c26f-4b78-9237-3e27bc444aa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:24.404394 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad921a1-c26f-4b78-9237-3e27bc444aa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:24.405849 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad921a1-c26f-4b78-9237-3e27bc444aa3 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:24.496888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 605/1183] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:39:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:39:24.502823 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4aa04-8d14-497e-bdf3-10da966bbf4d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:24.601172 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4aa04-8d14-497e-bdf3-10da966bbf4d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:24.631919 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91b030-77cd-48ea-b763-896a4ba7ca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:24.632745 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91b030-77cd-48ea-b763-896a4ba7ca82 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:24.633022 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91b030-77cd-48ea-b763-896a4ba7ca82 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:24.633293 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91b030-77cd-48ea-b763-896a4ba7ca82 None admin] PATH_INFO: `/v3/projects/b3e8d9d160784e6eb8317ef283fbd80c` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:24.634432 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91b030-77cd-48ea-b763-896a4ba7ca82 None admin] RBAC: Authorizing `identity:get_project(project_id=b3e8d9d160784e6eb8317ef283fbd80c)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:24.635852 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91b030-77cd-48ea-b763-896a4ba7ca82 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:24.637731 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 579/1184] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:39:24 2022] GET /identity/v3/projects/b3e8d9d160784e6eb8317ef283fbd80c => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:24.644278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad921a1-c26f-4b78-9237-3e27bc444aa3 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:24.736318 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad921a1-c26f-4b78-9237-3e27bc444aa3 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:24.768544 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69602b-a558-405c-81ff-897356c4eb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:24.769129 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69602b-a558-405c-81ff-897356c4eb23 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:24.769408 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69602b-a558-405c-81ff-897356c4eb23 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:24.769683 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69602b-a558-405c-81ff-897356c4eb23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:24.770501 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69602b-a558-405c-81ff-897356c4eb23 None admin] RBAC: Adding query filter params (role.id=13de1ce875d44fcc988cc31b3a0639be, scope.project.id=b3e8d9d160784e6eb8317ef283fbd80c, user.id=80a4dff548694223b8ae3e91057ca590) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:39:24.770845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69602b-a558-405c-81ff-897356c4eb23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:24.772267 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69602b-a558-405c-81ff-897356c4eb23 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:24.777464 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 606/1185] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:39:24 2022] GET /identity/v3/role_assignments?user.id=80a4dff548694223b8ae3e91057ca590&scope.project.id=b3e8d9d160784e6eb8317ef283fbd80c&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:27.033594 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3eea62-e8ad-4ffc-ac73-a808caa002be None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:27.034107 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3eea62-e8ad-4ffc-ac73-a808caa002be None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:27.034205 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3eea62-e8ad-4ffc-ac73-a808caa002be None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:27.035516 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 580/1186] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:39:27.040772 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b7607-c8e7-44e7-b904-b62378d9b482 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:27.041145 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b7607-c8e7-44e7-b904-b62378d9b482 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:27.041323 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b7607-c8e7-44e7-b904-b62378d9b482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:27.057781 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-938b7607-c8e7-44e7-b904-b62378d9b482 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:39:27.058986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-938b7607-c8e7-44e7-b904-b62378d9b482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:39:27.120597 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 607/1187] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:39:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:39:27.143721 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3eea62-e8ad-4ffc-ac73-a808caa002be None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:27.238443 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3eea62-e8ad-4ffc-ac73-a808caa002be None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:27.271220 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3c89e-22e9-4d16-99de-10741b2f95b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:27.271998 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3c89e-22e9-4d16-99de-10741b2f95b6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:27.272279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3c89e-22e9-4d16-99de-10741b2f95b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:27.272552 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3c89e-22e9-4d16-99de-10741b2f95b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:27.282179 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3c89e-22e9-4d16-99de-10741b2f95b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:39:27.289000 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-86d3c89e-22e9-4d16-99de-10741b2f95b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:39:27.290175 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 581/1188] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:39:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:39:27.297609 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b7607-c8e7-44e7-b904-b62378d9b482 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:27.389489 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b7607-c8e7-44e7-b904-b62378d9b482 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:27.420931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f18e7-a4eb-4853-a007-8e4bff2d3552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:27.421582 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f18e7-a4eb-4853-a007-8e4bff2d3552 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:27.421863 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f18e7-a4eb-4853-a007-8e4bff2d3552 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:27.422135 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21f18e7-a4eb-4853-a007-8e4bff2d3552 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:27.422888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f18e7-a4eb-4853-a007-8e4bff2d3552 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:39:27.423191 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f18e7-a4eb-4853-a007-8e4bff2d3552 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:27.425119 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21f18e7-a4eb-4853-a007-8e4bff2d3552 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:27.432635 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 608/1189] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:39:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:27.438554 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3c89e-22e9-4d16-99de-10741b2f95b6 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:27.532465 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3c89e-22e9-4d16-99de-10741b2f95b6 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:27.563538 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3ef3e-4010-49d3-a7cd-fe4b7cc71554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:27.564418 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3ef3e-4010-49d3-a7cd-fe4b7cc71554 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:27.564697 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3ef3e-4010-49d3-a7cd-fe4b7cc71554 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:27.564966 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3ef3e-4010-49d3-a7cd-fe4b7cc71554 None admin] PATH_INFO: `/v3/users/80a4dff548694223b8ae3e91057ca590` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:27.566133 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3ef3e-4010-49d3-a7cd-fe4b7cc71554 None admin] RBAC: Authorizing `identity:get_user(user_id=80a4dff548694223b8ae3e91057ca590)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:27.567571 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3ef3e-4010-49d3-a7cd-fe4b7cc71554 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:27.569178 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 582/1190] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:39:27 2022] GET /identity/v3/users/80a4dff548694223b8ae3e91057ca590 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:27.574966 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f18e7-a4eb-4853-a007-8e4bff2d3552 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:27.668768 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21f18e7-a4eb-4853-a007-8e4bff2d3552 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:27.699288 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b86338f-8cd6-4036-89a2-9e2f26b77795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:27.700121 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86338f-8cd6-4036-89a2-9e2f26b77795 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:27.700402 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86338f-8cd6-4036-89a2-9e2f26b77795 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:27.700677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b86338f-8cd6-4036-89a2-9e2f26b77795 None admin] PATH_INFO: `/v3/projects/b3e8d9d160784e6eb8317ef283fbd80c` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:27.701827 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86338f-8cd6-4036-89a2-9e2f26b77795 None admin] RBAC: Authorizing `identity:get_project(project_id=b3e8d9d160784e6eb8317ef283fbd80c)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:27.703275 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b86338f-8cd6-4036-89a2-9e2f26b77795 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:27.705449 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 609/1191] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:39:27 2022] GET /identity/v3/projects/b3e8d9d160784e6eb8317ef283fbd80c => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:27.711297 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3ef3e-4010-49d3-a7cd-fe4b7cc71554 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:27.805202 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3ef3e-4010-49d3-a7cd-fe4b7cc71554 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:27.836626 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025daa4-e31a-49dd-9113-033e5f657368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:27.837493 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025daa4-e31a-49dd-9113-033e5f657368 None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:27.837772 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025daa4-e31a-49dd-9113-033e5f657368 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:27.838043 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025daa4-e31a-49dd-9113-033e5f657368 None admin] PATH_INFO: `/v3/projects/b3e8d9d160784e6eb8317ef283fbd80c/users/80a4dff548694223b8ae3e91057ca590/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:27.839998 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025daa4-e31a-49dd-9113-033e5f657368 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3e8d9d160784e6eb8317ef283fbd80c, user_id=80a4dff548694223b8ae3e91057ca590, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:27.841410 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f025daa4-e31a-49dd-9113-033e5f657368 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:27.855390 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 583/1192] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:39:27 2022] PUT /identity/v3/projects/b3e8d9d160784e6eb8317ef283fbd80c/users/80a4dff548694223b8ae3e91057ca590/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:39:30.113235 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aa39f-6ad6-4fae-943f-de0e0ff139c4 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:30.113766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aa39f-6ad6-4fae-943f-de0e0ff139c4 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:30.113856 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16aa39f-6ad6-4fae-943f-de0e0ff139c4 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:30.115187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 610/1193] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:39:30.120283 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b161d8-c7d8-4921-b5f8-002a2730d1db None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:30.120660 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b161d8-c7d8-4921-b5f8-002a2730d1db None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:30.120834 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b161d8-c7d8-4921-b5f8-002a2730d1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:30.137572 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-25b161d8-c7d8-4921-b5f8-002a2730d1db None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:39:30.138787 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-25b161d8-c7d8-4921-b5f8-002a2730d1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:39:30.200530 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 584/1194] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:39:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:39:30.225479 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16aa39f-6ad6-4fae-943f-de0e0ff139c4 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:30.321244 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16aa39f-6ad6-4fae-943f-de0e0ff139c4 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:30.352703 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91836470-db64-4831-95ff-4ceec2b05b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:30.353470 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91836470-db64-4831-95ff-4ceec2b05b8f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:30.353751 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91836470-db64-4831-95ff-4ceec2b05b8f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:30.354026 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91836470-db64-4831-95ff-4ceec2b05b8f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:30.364037 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91836470-db64-4831-95ff-4ceec2b05b8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:39:30.371064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-91836470-db64-4831-95ff-4ceec2b05b8f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:39:30.372251 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 611/1195] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:39:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:39:30.378301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b161d8-c7d8-4921-b5f8-002a2730d1db None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:30.473466 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b161d8-c7d8-4921-b5f8-002a2730d1db None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:30.504540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a90ef-1490-4833-b2cb-9d9f47422300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:30.505182 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a90ef-1490-4833-b2cb-9d9f47422300 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:30.505463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a90ef-1490-4833-b2cb-9d9f47422300 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:30.505735 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358a90ef-1490-4833-b2cb-9d9f47422300 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:30.506461 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a90ef-1490-4833-b2cb-9d9f47422300 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:39:30.506792 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a90ef-1490-4833-b2cb-9d9f47422300 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:30.508142 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358a90ef-1490-4833-b2cb-9d9f47422300 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:30.515928 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 585/1196] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:39:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:30.522137 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91836470-db64-4831-95ff-4ceec2b05b8f None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:30.613782 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91836470-db64-4831-95ff-4ceec2b05b8f None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:30.644630 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9592d40-2558-48a4-906f-8735c86a4955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:30.645467 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9592d40-2558-48a4-906f-8735c86a4955 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:30.645743 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9592d40-2558-48a4-906f-8735c86a4955 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:30.646013 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9592d40-2558-48a4-906f-8735c86a4955 None admin] PATH_INFO: `/v3/users/80a4dff548694223b8ae3e91057ca590` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:30.647178 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9592d40-2558-48a4-906f-8735c86a4955 None admin] RBAC: Authorizing `identity:get_user(user_id=80a4dff548694223b8ae3e91057ca590)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:30.648593 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9592d40-2558-48a4-906f-8735c86a4955 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:30.650169 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 612/1197] 10.222.0.73 () {56 vars in 1177 bytes} [Mon Apr 11 16:39:30 2022] GET /identity/v3/users/80a4dff548694223b8ae3e91057ca590 => generated 311 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:30.655795 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a90ef-1490-4833-b2cb-9d9f47422300 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:30.747851 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358a90ef-1490-4833-b2cb-9d9f47422300 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:30.778987 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef24c8-d03b-4412-aea0-368f162136fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:30.779615 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef24c8-d03b-4412-aea0-368f162136fe None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:30.779897 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef24c8-d03b-4412-aea0-368f162136fe None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:30.780172 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef24c8-d03b-4412-aea0-368f162136fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:30.842012 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef24c8-d03b-4412-aea0-368f162136fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:30.843454 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef24c8-d03b-4412-aea0-368f162136fe None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:30.935170 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 586/1198] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:39:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:39:30.941153 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9592d40-2558-48a4-906f-8735c86a4955 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:31.032709 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9592d40-2558-48a4-906f-8735c86a4955 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:31.063861 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49e9ec7-fbd2-4fe6-a036-9ab87357364e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:31.064799 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e9ec7-fbd2-4fe6-a036-9ab87357364e None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:31.065074 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e9ec7-fbd2-4fe6-a036-9ab87357364e None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:31.065342 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49e9ec7-fbd2-4fe6-a036-9ab87357364e None admin] PATH_INFO: `/v3/projects/b3e8d9d160784e6eb8317ef283fbd80c` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:31.066479 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e9ec7-fbd2-4fe6-a036-9ab87357364e None admin] RBAC: Authorizing `identity:get_project(project_id=b3e8d9d160784e6eb8317ef283fbd80c)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:31.067937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49e9ec7-fbd2-4fe6-a036-9ab87357364e None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:31.069596 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 613/1199] 10.222.0.73 () {56 vars in 1186 bytes} [Mon Apr 11 16:39:30 2022] GET /identity/v3/projects/b3e8d9d160784e6eb8317ef283fbd80c => generated 361 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:39:31.075547 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef24c8-d03b-4412-aea0-368f162136fe None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:39:31.166822 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef24c8-d03b-4412-aea0-368f162136fe None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:39:31.198202 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e24015-b738-4456-96cc-8108ecc5f912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:39:31.198860 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e24015-b738-4456-96cc-8108ecc5f912 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:39:31.199143 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e24015-b738-4456-96cc-8108ecc5f912 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:39:31.199415 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e24015-b738-4456-96cc-8108ecc5f912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:39:31.200227 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e24015-b738-4456-96cc-8108ecc5f912 None admin] RBAC: Adding query filter params (role.id=13de1ce875d44fcc988cc31b3a0639be, scope.project.id=b3e8d9d160784e6eb8317ef283fbd80c, user.id=80a4dff548694223b8ae3e91057ca590) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:39:31.200534 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e24015-b738-4456-96cc-8108ecc5f912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:39:31.201927 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e24015-b738-4456-96cc-8108ecc5f912 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:39:31.207407 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 587/1200] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:39:31 2022] GET /identity/v3/role_assignments?user.id=80a4dff548694223b8ae3e91057ca590&scope.project.id=b3e8d9d160784e6eb8317ef283fbd80c&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:32.517517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7656df1-6e37-430b-9749-f37fd8bea668 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:32.517517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7656df1-6e37-430b-9749-f37fd8bea668 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:32.517517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7656df1-6e37-430b-9749-f37fd8bea668 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:32.517517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 614/1201] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:40:32.523360 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b451b6-1b33-43db-9491-d628c3fd5cd6 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:32.523839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b451b6-1b33-43db-9491-d628c3fd5cd6 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:32.524692 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b451b6-1b33-43db-9491-d628c3fd5cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:32.542876 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c1b451b6-1b33-43db-9491-d628c3fd5cd6 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:40:32.544253 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c1b451b6-1b33-43db-9491-d628c3fd5cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:40:32.631555 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 588/1202] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:40:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:40:32.660320 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7656df1-6e37-430b-9749-f37fd8bea668 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:32.781299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7656df1-6e37-430b-9749-f37fd8bea668 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:32.821477 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267801a5-a3d2-4597-95e2-e2dadc758d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:32.822292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267801a5-a3d2-4597-95e2-e2dadc758d1a None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:32.822562 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267801a5-a3d2-4597-95e2-e2dadc758d1a None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:32.822931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267801a5-a3d2-4597-95e2-e2dadc758d1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:32.835702 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267801a5-a3d2-4597-95e2-e2dadc758d1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:32.837533 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267801a5-a3d2-4597-95e2-e2dadc758d1a None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:32.858002 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-267801a5-a3d2-4597-95e2-e2dadc758d1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:40:32.859817 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 615/1203] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:32.865557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b451b6-1b33-43db-9491-d628c3fd5cd6 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:32.998867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b451b6-1b33-43db-9491-d628c3fd5cd6 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:33.036993 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec7762-c9c9-4120-a8ab-77250b5c1d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:33.037994 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec7762-c9c9-4120-a8ab-77250b5c1d6d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:33.038219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec7762-c9c9-4120-a8ab-77250b5c1d6d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:33.038504 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec7762-c9c9-4120-a8ab-77250b5c1d6d None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:33.039423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec7762-c9c9-4120-a8ab-77250b5c1d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:33.039698 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec7762-c9c9-4120-a8ab-77250b5c1d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:33.041040 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec7762-c9c9-4120-a8ab-77250b5c1d6d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:33.060546 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 589/1204] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:40:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:33.062159 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267801a5-a3d2-4597-95e2-e2dadc758d1a None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:33.192623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267801a5-a3d2-4597-95e2-e2dadc758d1a None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:33.236183 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e98576-dad1-4eae-93ef-f07e707d5f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:33.237057 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e98576-dad1-4eae-93ef-f07e707d5f60 None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:33.237442 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e98576-dad1-4eae-93ef-f07e707d5f60 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:33.237819 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e98576-dad1-4eae-93ef-f07e707d5f60 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:33.238551 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e98576-dad1-4eae-93ef-f07e707d5f60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:33.240260 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e98576-dad1-4eae-93ef-f07e707d5f60 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:33.282626 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 616/1205] 10.222.0.73 () {60 vars in 1132 bytes} [Mon Apr 11 16:40:33 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:40:36.024673 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4f7d5-f744-43f0-aa93-f4e27606f683 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:36.025203 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4f7d5-f744-43f0-aa93-f4e27606f683 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:36.025203 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4f7d5-f744-43f0-aa93-f4e27606f683 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:36.030275 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 590/1206] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:40:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:40:36.032012 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a22c4-8ca8-4341-a34c-935b79944cce None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:36.032459 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a22c4-8ca8-4341-a34c-935b79944cce None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:36.032626 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a22c4-8ca8-4341-a34c-935b79944cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:36.052113 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-137a22c4-8ca8-4341-a34c-935b79944cce None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:40:36.053315 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-137a22c4-8ca8-4341-a34c-935b79944cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:40:36.136612 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 617/1207] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:40:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:40:36.162713 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4f7d5-f744-43f0-aa93-f4e27606f683 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:36.277027 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4f7d5-f744-43f0-aa93-f4e27606f683 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:36.324311 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c3eb4-655e-44b4-b0b4-c25542ba15ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:36.325349 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c3eb4-655e-44b4-b0b4-c25542ba15ed None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:36.326346 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c3eb4-655e-44b4-b0b4-c25542ba15ed None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:36.326761 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c3eb4-655e-44b4-b0b4-c25542ba15ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:36.339300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c3eb4-655e-44b4-b0b4-c25542ba15ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:40:36.346803 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-e29c3eb4-655e-44b4-b0b4-c25542ba15ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:40:36.353029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 591/1208] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:40:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:36.354938 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a22c4-8ca8-4341-a34c-935b79944cce None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:36.461730 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a22c4-8ca8-4341-a34c-935b79944cce None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:36.495133 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b662f-fa9d-4ecf-a826-d6840f094ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:36.496019 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b662f-fa9d-4ecf-a826-d6840f094ff3 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:36.496482 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b662f-fa9d-4ecf-a826-d6840f094ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:36.496919 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b662f-fa9d-4ecf-a826-d6840f094ff3 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:36.498416 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b662f-fa9d-4ecf-a826-d6840f094ff3 None admin] RBAC: Adding query filter params (name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:36.498862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b662f-fa9d-4ecf-a826-d6840f094ff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:36.500550 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b662f-fa9d-4ecf-a826-d6840f094ff3 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:36.514640 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 618/1209] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:40:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:36.516769 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c3eb4-655e-44b4-b0b4-c25542ba15ed None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:36.629257 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c3eb4-655e-44b4-b0b4-c25542ba15ed None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:36.668705 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40841fd2-a8f5-4696-a083-781469a5cb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:36.670494 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40841fd2-a8f5-4696-a083-781469a5cb70 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:36.670948 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40841fd2-a8f5-4696-a083-781469a5cb70 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:36.671549 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40841fd2-a8f5-4696-a083-781469a5cb70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:36.685533 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40841fd2-a8f5-4696-a083-781469a5cb70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:36.687450 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40841fd2-a8f5-4696-a083-781469a5cb70 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:36.704516 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-40841fd2-a8f5-4696-a083-781469a5cb70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:40:36.705907 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 592/1210] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:40:36.711411 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b662f-fa9d-4ecf-a826-d6840f094ff3 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:36.816495 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b662f-fa9d-4ecf-a826-d6840f094ff3 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:36.850384 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfad37f-2bcc-4102-90ac-35718f7251f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:36.851108 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfad37f-2bcc-4102-90ac-35718f7251f5 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:36.851386 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfad37f-2bcc-4102-90ac-35718f7251f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:36.851655 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfad37f-2bcc-4102-90ac-35718f7251f5 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:36.852365 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfad37f-2bcc-4102-90ac-35718f7251f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:36.852668 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfad37f-2bcc-4102-90ac-35718f7251f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:36.854082 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfad37f-2bcc-4102-90ac-35718f7251f5 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:36.874073 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 619/1211] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:40:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:36.875570 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40841fd2-a8f5-4696-a083-781469a5cb70 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:36.990977 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40841fd2-a8f5-4696-a083-781469a5cb70 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:37.027473 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fda29d-82e2-4c61-bd88-3707b1a62176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:37.028279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fda29d-82e2-4c61-bd88-3707b1a62176 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:37.029096 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fda29d-82e2-4c61-bd88-3707b1a62176 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:37.029374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fda29d-82e2-4c61-bd88-3707b1a62176 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:37.037896 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fda29d-82e2-4c61-bd88-3707b1a62176 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:37.039471 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fda29d-82e2-4c61-bd88-3707b1a62176 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:37.057393 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-45fda29d-82e2-4c61-bd88-3707b1a62176 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 16:40:37.058909 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 593/1212] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:37.066263 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfad37f-2bcc-4102-90ac-35718f7251f5 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:37.168470 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfad37f-2bcc-4102-90ac-35718f7251f5 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:37.205558 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbffaa7-2adb-4f8b-b04d-6bf179701dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:37.206148 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbffaa7-2adb-4f8b-b04d-6bf179701dc5 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:37.206469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbffaa7-2adb-4f8b-b04d-6bf179701dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:37.206777 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbffaa7-2adb-4f8b-b04d-6bf179701dc5 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:37.207639 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbffaa7-2adb-4f8b-b04d-6bf179701dc5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:37.207984 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbffaa7-2adb-4f8b-b04d-6bf179701dc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:37.209553 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbffaa7-2adb-4f8b-b04d-6bf179701dc5 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:37.230621 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 620/1213] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Apr 11 16:40:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:37.234042 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fda29d-82e2-4c61-bd88-3707b1a62176 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:37.361975 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fda29d-82e2-4c61-bd88-3707b1a62176 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:37.412420 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ffa2a-b4ed-4853-875e-48a761609a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:37.413122 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ffa2a-b4ed-4853-875e-48a761609a61 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:37.413404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ffa2a-b4ed-4853-875e-48a761609a61 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:37.413678 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ffa2a-b4ed-4853-875e-48a761609a61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:37.484898 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ffa2a-b4ed-4853-875e-48a761609a61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:37.486268 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ffa2a-b4ed-4853-875e-48a761609a61 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:37.600874 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 594/1214] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:40:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:40:37.607600 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbffaa7-2adb-4f8b-b04d-6bf179701dc5 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:37.724047 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbffaa7-2adb-4f8b-b04d-6bf179701dc5 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:37.765960 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569b07e-b2a3-4946-bb27-120585eb784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:37.766677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569b07e-b2a3-4946-bb27-120585eb784f None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:37.766931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569b07e-b2a3-4946-bb27-120585eb784f None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:37.767200 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d569b07e-b2a3-4946-bb27-120585eb784f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:37.777377 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569b07e-b2a3-4946-bb27-120585eb784f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:37.778963 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d569b07e-b2a3-4946-bb27-120585eb784f None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:37.799865 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-d569b07e-b2a3-4946-bb27-120585eb784f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:40:37.801310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 621/1215] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:37.807722 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ffa2a-b4ed-4853-875e-48a761609a61 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:37.935987 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ffa2a-b4ed-4853-875e-48a761609a61 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:37.982301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32958a13-7c77-462d-94f2-5692db716043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:37.984012 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32958a13-7c77-462d-94f2-5692db716043 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:37.984012 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32958a13-7c77-462d-94f2-5692db716043 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:37.984012 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32958a13-7c77-462d-94f2-5692db716043 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:37.984365 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32958a13-7c77-462d-94f2-5692db716043 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:37.984365 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32958a13-7c77-462d-94f2-5692db716043 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:37.986215 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32958a13-7c77-462d-94f2-5692db716043 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:38.000604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 595/1216] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:38.006645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569b07e-b2a3-4946-bb27-120585eb784f None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:38.125816 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d569b07e-b2a3-4946-bb27-120585eb784f None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:38.170627 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90c5f9-1993-4e06-b650-5ad5a4f8dadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:38.170627 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90c5f9-1993-4e06-b650-5ad5a4f8dadb None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:38.170627 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90c5f9-1993-4e06-b650-5ad5a4f8dadb None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:38.170627 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90c5f9-1993-4e06-b650-5ad5a4f8dadb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:38.180788 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90c5f9-1993-4e06-b650-5ad5a4f8dadb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:38.182367 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f90c5f9-1993-4e06-b650-5ad5a4f8dadb None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:38.198762 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-6f90c5f9-1993-4e06-b650-5ad5a4f8dadb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:40:38.200123 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 622/1217] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:40:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:38.206243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32958a13-7c77-462d-94f2-5692db716043 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:38.311402 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32958a13-7c77-462d-94f2-5692db716043 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:38.349310 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a4016-eaf5-42b4-b179-a44cce1c9402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:38.350152 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a4016-eaf5-42b4-b179-a44cce1c9402 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:38.350395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a4016-eaf5-42b4-b179-a44cce1c9402 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:38.350696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a4016-eaf5-42b4-b179-a44cce1c9402 None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:38.351631 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a4016-eaf5-42b4-b179-a44cce1c9402 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:38.351942 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a4016-eaf5-42b4-b179-a44cce1c9402 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:38.353677 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a4016-eaf5-42b4-b179-a44cce1c9402 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:38.368240 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 596/1218] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:40:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:38.377329 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90c5f9-1993-4e06-b650-5ad5a4f8dadb None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:38.495156 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f90c5f9-1993-4e06-b650-5ad5a4f8dadb None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:38.533902 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9bd55-d9ab-426c-95ac-4991417d6e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:38.534551 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9bd55-d9ab-426c-95ac-4991417d6e94 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:38.534856 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9bd55-d9ab-426c-95ac-4991417d6e94 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:38.535207 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9bd55-d9ab-426c-95ac-4991417d6e94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:38.535945 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9bd55-d9ab-426c-95ac-4991417d6e94 None admin] RBAC: Adding query filter params (role.id=16dc6f09d53447fd9e4a95fb1df71d9d, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=85f5ef8708f54401af7e8defa8d13141) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:38.536250 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9bd55-d9ab-426c-95ac-4991417d6e94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:38.538008 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9bd55-d9ab-426c-95ac-4991417d6e94 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:38.550403 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 623/1219] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:40:38 2022] GET /identity/v3/role_assignments?user.id=85f5ef8708f54401af7e8defa8d13141&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=16dc6f09d53447fd9e4a95fb1df71d9d => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:40:41.161517 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b8ffa-da43-45c3-9e86-46069ec3fbb2 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:41.162087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b8ffa-da43-45c3-9e86-46069ec3fbb2 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:41.162406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b8ffa-da43-45c3-9e86-46069ec3fbb2 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:41.164233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 597/1220] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:40:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:40:41.169506 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f631266-ddc0-4617-9e12-34b82893e2e7 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:41.169979 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f631266-ddc0-4617-9e12-34b82893e2e7 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:41.170080 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f631266-ddc0-4617-9e12-34b82893e2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:41.186810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-2f631266-ddc0-4617-9e12-34b82893e2e7 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:40:41.188035 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-2f631266-ddc0-4617-9e12-34b82893e2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:40:41.255426 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 624/1221] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:40:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:40:41.278434 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b8ffa-da43-45c3-9e86-46069ec3fbb2 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:41.383095 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086b8ffa-da43-45c3-9e86-46069ec3fbb2 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:41.416943 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74366b3f-5d15-45aa-b6bb-5d741bdcf97a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:41.417730 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74366b3f-5d15-45aa-b6bb-5d741bdcf97a None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:41.418006 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74366b3f-5d15-45aa-b6bb-5d741bdcf97a None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:41.418273 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74366b3f-5d15-45aa-b6bb-5d741bdcf97a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:41.429051 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74366b3f-5d15-45aa-b6bb-5d741bdcf97a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:40:41.436514 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-74366b3f-5d15-45aa-b6bb-5d741bdcf97a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:40:41.437715 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 598/1222] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:40:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:41.444947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f631266-ddc0-4617-9e12-34b82893e2e7 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:41.542804 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f631266-ddc0-4617-9e12-34b82893e2e7 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:41.575651 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e81795-e63c-47ff-b921-63442fbf00e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:41.576343 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e81795-e63c-47ff-b921-63442fbf00e8 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:41.576584 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e81795-e63c-47ff-b921-63442fbf00e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:41.576878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e81795-e63c-47ff-b921-63442fbf00e8 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:41.577578 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e81795-e63c-47ff-b921-63442fbf00e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:41.577875 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e81795-e63c-47ff-b921-63442fbf00e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:41.579269 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e81795-e63c-47ff-b921-63442fbf00e8 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:41.587266 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 625/1223] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:40:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:41.593710 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74366b3f-5d15-45aa-b6bb-5d741bdcf97a None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:41.691657 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74366b3f-5d15-45aa-b6bb-5d741bdcf97a None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:41.724929 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c1114-b0f9-4f80-a143-0a04a2ee6882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:41.725718 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c1114-b0f9-4f80-a143-0a04a2ee6882 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:41.726001 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c1114-b0f9-4f80-a143-0a04a2ee6882 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:41.726275 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c1114-b0f9-4f80-a143-0a04a2ee6882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:41.737365 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c1114-b0f9-4f80-a143-0a04a2ee6882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:41.738825 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c1114-b0f9-4f80-a143-0a04a2ee6882 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:41.754791 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-787c1114-b0f9-4f80-a143-0a04a2ee6882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:40:41.755986 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 599/1224] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:40:41.762175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e81795-e63c-47ff-b921-63442fbf00e8 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:41.860214 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e81795-e63c-47ff-b921-63442fbf00e8 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:41.893020 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac93cee-7f3d-4ed5-b33a-8d540b019df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:41.893674 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac93cee-7f3d-4ed5-b33a-8d540b019df9 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:41.893953 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac93cee-7f3d-4ed5-b33a-8d540b019df9 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:41.894223 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac93cee-7f3d-4ed5-b33a-8d540b019df9 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:41.894962 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac93cee-7f3d-4ed5-b33a-8d540b019df9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:41.895262 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac93cee-7f3d-4ed5-b33a-8d540b019df9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:41.896617 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac93cee-7f3d-4ed5-b33a-8d540b019df9 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:41.908947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 626/1225] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:40:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:41.914850 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c1114-b0f9-4f80-a143-0a04a2ee6882 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:42.023093 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c1114-b0f9-4f80-a143-0a04a2ee6882 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:42.055994 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3da00-cdb6-4f89-8797-4987d40d7949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:42.056847 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3da00-cdb6-4f89-8797-4987d40d7949 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:42.057166 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3da00-cdb6-4f89-8797-4987d40d7949 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:42.057491 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3da00-cdb6-4f89-8797-4987d40d7949 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:42.065021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3da00-cdb6-4f89-8797-4987d40d7949 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:42.066656 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3da00-cdb6-4f89-8797-4987d40d7949 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:42.082931 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-97f3da00-cdb6-4f89-8797-4987d40d7949 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 16:40:42.084101 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 600/1226] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:40:42.090542 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac93cee-7f3d-4ed5-b33a-8d540b019df9 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:42.193028 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac93cee-7f3d-4ed5-b33a-8d540b019df9 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:42.226457 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ba3ab-5e27-4bb3-8fc8-c419556a885a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:42.227166 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ba3ab-5e27-4bb3-8fc8-c419556a885a None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:42.227421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ba3ab-5e27-4bb3-8fc8-c419556a885a None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:42.227690 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ba3ab-5e27-4bb3-8fc8-c419556a885a None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:42.228531 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ba3ab-5e27-4bb3-8fc8-c419556a885a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:42.228816 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ba3ab-5e27-4bb3-8fc8-c419556a885a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:42.230243 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626ba3ab-5e27-4bb3-8fc8-c419556a885a None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:42.247724 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 627/1227] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Apr 11 16:40:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:42.253679 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3da00-cdb6-4f89-8797-4987d40d7949 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:42.372813 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3da00-cdb6-4f89-8797-4987d40d7949 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:42.412536 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e7a9f-9f45-4088-a905-98c5f614d107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:42.413481 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e7a9f-9f45-4088-a905-98c5f614d107 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:42.413782 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e7a9f-9f45-4088-a905-98c5f614d107 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:42.414093 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e7a9f-9f45-4088-a905-98c5f614d107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:42.425635 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e7a9f-9f45-4088-a905-98c5f614d107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:42.427107 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e7a9f-9f45-4088-a905-98c5f614d107 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:42.444933 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-7a1e7a9f-9f45-4088-a905-98c5f614d107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:40:42.446092 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 601/1228] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:42.452821 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ba3ab-5e27-4bb3-8fc8-c419556a885a None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:42.560131 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ba3ab-5e27-4bb3-8fc8-c419556a885a None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:42.595887 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26b7dc-2c6c-4795-b0dd-136cbf76e11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:42.596572 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26b7dc-2c6c-4795-b0dd-136cbf76e11d None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:42.596885 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26b7dc-2c6c-4795-b0dd-136cbf76e11d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:42.597207 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26b7dc-2c6c-4795-b0dd-136cbf76e11d None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:42.598112 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26b7dc-2c6c-4795-b0dd-136cbf76e11d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:42.598413 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26b7dc-2c6c-4795-b0dd-136cbf76e11d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:42.600027 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26b7dc-2c6c-4795-b0dd-136cbf76e11d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:42.614390 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 628/1229] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:40:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:40:42.620496 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e7a9f-9f45-4088-a905-98c5f614d107 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:42.723313 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e7a9f-9f45-4088-a905-98c5f614d107 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:42.759391 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b7756-5ed4-4a4f-a0d3-7d8dc728a5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:42.760240 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b7756-5ed4-4a4f-a0d3-7d8dc728a5d1 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:42.760789 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b7756-5ed4-4a4f-a0d3-7d8dc728a5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:42.761068 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b7756-5ed4-4a4f-a0d3-7d8dc728a5d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:42.767999 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b7756-5ed4-4a4f-a0d3-7d8dc728a5d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:42.769418 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b7756-5ed4-4a4f-a0d3-7d8dc728a5d1 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:42.783282 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-761b7756-5ed4-4a4f-a0d3-7d8dc728a5d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:40:42.784580 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 602/1230] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:40:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:40:42.790704 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26b7dc-2c6c-4795-b0dd-136cbf76e11d None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:42.899324 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26b7dc-2c6c-4795-b0dd-136cbf76e11d None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:42.947047 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c36723f-f23c-4511-9d9b-aca021a28bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:42.948172 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36723f-f23c-4511-9d9b-aca021a28bbc None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:42.948733 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36723f-f23c-4511-9d9b-aca021a28bbc None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:42.949025 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c36723f-f23c-4511-9d9b-aca021a28bbc None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:42.950152 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36723f-f23c-4511-9d9b-aca021a28bbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:42.950463 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36723f-f23c-4511-9d9b-aca021a28bbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:42.952050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c36723f-f23c-4511-9d9b-aca021a28bbc None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:42.967221 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 629/1231] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:40:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:40:42.973030 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b7756-5ed4-4a4f-a0d3-7d8dc728a5d1 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:43.078107 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b7756-5ed4-4a4f-a0d3-7d8dc728a5d1 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:43.111452 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b892fcc-ab01-4138-ab9b-d93ef308a53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:43.112331 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b892fcc-ab01-4138-ab9b-d93ef308a53f None admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:43.112611 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b892fcc-ab01-4138-ab9b-d93ef308a53f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:43.112882 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b892fcc-ab01-4138-ab9b-d93ef308a53f None admin] PATH_INFO: `/v3/projects/c1eb8559ca744abda7039b767af5818f/users/85f5ef8708f54401af7e8defa8d13141/roles/16dc6f09d53447fd9e4a95fb1df71d9d` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:43.127817 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b892fcc-ab01-4138-ab9b-d93ef308a53f None admin] RBAC: Authorizing `identity:create_grant(project_id=c1eb8559ca744abda7039b767af5818f, user_id=85f5ef8708f54401af7e8defa8d13141, role_id=16dc6f09d53447fd9e4a95fb1df71d9d)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:43.129467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b892fcc-ab01-4138-ab9b-d93ef308a53f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:43.143422 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 603/1232] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:40:42 2022] PUT /identity/v3/projects/c1eb8559ca744abda7039b767af5818f/users/85f5ef8708f54401af7e8defa8d13141/roles/16dc6f09d53447fd9e4a95fb1df71d9d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:40:45.497430 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595bb75-e7c4-43ba-acfd-482d9bf09f42 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:45.497975 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595bb75-e7c4-43ba-acfd-482d9bf09f42 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:45.497975 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595bb75-e7c4-43ba-acfd-482d9bf09f42 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:45.499355 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 630/1233] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:40:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:40:45.504548 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259a881-5963-40b6-acc7-18707f6412f1 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:45.504945 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259a881-5963-40b6-acc7-18707f6412f1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:45.505095 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a259a881-5963-40b6-acc7-18707f6412f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:45.523658 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a259a881-5963-40b6-acc7-18707f6412f1 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:40:45.524831 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a259a881-5963-40b6-acc7-18707f6412f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:40:45.597856 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 604/1234] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:40:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:40:45.624435 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595bb75-e7c4-43ba-acfd-482d9bf09f42 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:45.740283 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595bb75-e7c4-43ba-acfd-482d9bf09f42 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:45.782072 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d86ab-9c64-44ab-bf55-9ec137b09baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:45.783372 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d86ab-9c64-44ab-bf55-9ec137b09baa None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:45.783695 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d86ab-9c64-44ab-bf55-9ec137b09baa None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:45.784064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20d86ab-9c64-44ab-bf55-9ec137b09baa None admin] PATH_INFO: `/v3/roles/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:45.798933 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20d86ab-9c64-44ab-bf55-9ec137b09baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:40:45.807868 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-a20d86ab-9c64-44ab-bf55-9ec137b09baa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 16:40:45.810117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 631/1235] 10.222.0.73 () {56 vars in 1102 bytes} [Mon Apr 11 16:40:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:40:45.816374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259a881-5963-40b6-acc7-18707f6412f1 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:45.917263 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a259a881-5963-40b6-acc7-18707f6412f1 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:45.955756 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3148e2-6006-4d16-9058-99fad364cfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:45.956715 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3148e2-6006-4d16-9058-99fad364cfac None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:45.957172 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3148e2-6006-4d16-9058-99fad364cfac None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:45.957516 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3148e2-6006-4d16-9058-99fad364cfac None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:45.958361 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3148e2-6006-4d16-9058-99fad364cfac None admin] RBAC: Adding query filter params (name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:45.958697 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3148e2-6006-4d16-9058-99fad364cfac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:45.960058 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3148e2-6006-4d16-9058-99fad364cfac None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:45.968775 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 605/1236] 10.222.0.73 () {56 vars in 1103 bytes} [Mon Apr 11 16:40:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:45.975397 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d86ab-9c64-44ab-bf55-9ec137b09baa None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:46.078260 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20d86ab-9c64-44ab-bf55-9ec137b09baa None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:46.111736 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812b708-d6e9-4894-8d0f-aa345be881cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:46.112523 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b708-d6e9-4894-8d0f-aa345be881cd None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:46.112802 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b708-d6e9-4894-8d0f-aa345be881cd None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:46.113077 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812b708-d6e9-4894-8d0f-aa345be881cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:46.124304 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812b708-d6e9-4894-8d0f-aa345be881cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:46.125758 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812b708-d6e9-4894-8d0f-aa345be881cd None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:46.142457 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-3812b708-d6e9-4894-8d0f-aa345be881cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:40:46.143697 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 632/1237] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:46.151046 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3148e2-6006-4d16-9058-99fad364cfac None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:46.286069 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3148e2-6006-4d16-9058-99fad364cfac None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:46.320853 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf20340-3ffe-4f30-9129-315c33b0eb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:46.321540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf20340-3ffe-4f30-9129-315c33b0eb71 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:46.321882 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf20340-3ffe-4f30-9129-315c33b0eb71 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:46.322160 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf20340-3ffe-4f30-9129-315c33b0eb71 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:46.322976 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf20340-3ffe-4f30-9129-315c33b0eb71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:46.323279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf20340-3ffe-4f30-9129-315c33b0eb71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:46.324634 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf20340-3ffe-4f30-9129-315c33b0eb71 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:46.338486 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 606/1238] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:40:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:46.345664 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812b708-d6e9-4894-8d0f-aa345be881cd None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:46.458113 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812b708-d6e9-4894-8d0f-aa345be881cd None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:46.494538 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca24ac-3665-4022-8191-61fe51494661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:46.495348 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca24ac-3665-4022-8191-61fe51494661 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:46.495636 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca24ac-3665-4022-8191-61fe51494661 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:46.495941 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aca24ac-3665-4022-8191-61fe51494661 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:46.504607 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca24ac-3665-4022-8191-61fe51494661 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:46.506093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aca24ac-3665-4022-8191-61fe51494661 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:46.521117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-1aca24ac-3665-4022-8191-61fe51494661 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 16:40:46.522480 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 633/1239] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:46.528435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf20340-3ffe-4f30-9129-315c33b0eb71 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:46.641370 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf20340-3ffe-4f30-9129-315c33b0eb71 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:46.676547 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d333d5e-6601-4641-af9a-ccc816e7cb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:46.677237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d333d5e-6601-4641-af9a-ccc816e7cb84 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:46.677567 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d333d5e-6601-4641-af9a-ccc816e7cb84 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:46.677865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d333d5e-6601-4641-af9a-ccc816e7cb84 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:46.678783 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d333d5e-6601-4641-af9a-ccc816e7cb84 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:46.679127 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d333d5e-6601-4641-af9a-ccc816e7cb84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:46.680657 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d333d5e-6601-4641-af9a-ccc816e7cb84 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:46.699111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 607/1240] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Apr 11 16:40:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:46.705674 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca24ac-3665-4022-8191-61fe51494661 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:46.819736 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aca24ac-3665-4022-8191-61fe51494661 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:46.862039 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19538084-ff65-49d5-9e0d-bc9e33126a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:46.863280 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19538084-ff65-49d5-9e0d-bc9e33126a5e None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:46.863632 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19538084-ff65-49d5-9e0d-bc9e33126a5e None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:46.864109 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19538084-ff65-49d5-9e0d-bc9e33126a5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:46.943967 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19538084-ff65-49d5-9e0d-bc9e33126a5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:46.945472 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19538084-ff65-49d5-9e0d-bc9e33126a5e None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:47.056054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 634/1241] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:40:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:40:47.061927 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d333d5e-6601-4641-af9a-ccc816e7cb84 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:47.163290 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d333d5e-6601-4641-af9a-ccc816e7cb84 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:47.198496 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73070480-1eb1-454f-ae30-46d99c7832b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:47.199244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73070480-1eb1-454f-ae30-46d99c7832b5 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:47.199554 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73070480-1eb1-454f-ae30-46d99c7832b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:47.200301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73070480-1eb1-454f-ae30-46d99c7832b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:47.210438 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73070480-1eb1-454f-ae30-46d99c7832b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:47.211878 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73070480-1eb1-454f-ae30-46d99c7832b5 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:47.229288 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-73070480-1eb1-454f-ae30-46d99c7832b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:40:47.230564 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 608/1242] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:47.236285 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19538084-ff65-49d5-9e0d-bc9e33126a5e None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:47.345331 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19538084-ff65-49d5-9e0d-bc9e33126a5e None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:47.382612 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae7b83-fa29-496a-bbaa-d15144cb2027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:47.383285 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae7b83-fa29-496a-bbaa-d15144cb2027 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:47.383565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae7b83-fa29-496a-bbaa-d15144cb2027 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:47.383872 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbae7b83-fa29-496a-bbaa-d15144cb2027 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:47.384671 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae7b83-fa29-496a-bbaa-d15144cb2027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:47.384953 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae7b83-fa29-496a-bbaa-d15144cb2027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:47.386585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbae7b83-fa29-496a-bbaa-d15144cb2027 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:47.398329 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 635/1243] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:47.404246 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73070480-1eb1-454f-ae30-46d99c7832b5 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:47.507568 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73070480-1eb1-454f-ae30-46d99c7832b5 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:47.544514 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95623f0e-8a73-4b64-b873-c2efc1c3b38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:47.545312 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95623f0e-8a73-4b64-b873-c2efc1c3b38d None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:47.545696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95623f0e-8a73-4b64-b873-c2efc1c3b38d None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:47.545977 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95623f0e-8a73-4b64-b873-c2efc1c3b38d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:47.554919 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95623f0e-8a73-4b64-b873-c2efc1c3b38d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:47.556650 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95623f0e-8a73-4b64-b873-c2efc1c3b38d None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:47.572277 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-95623f0e-8a73-4b64-b873-c2efc1c3b38d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:40:47.574066 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 609/1244] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:40:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:47.579803 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae7b83-fa29-496a-bbaa-d15144cb2027 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:47.684009 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbae7b83-fa29-496a-bbaa-d15144cb2027 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:47.717986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc1035-56b2-4bc3-b520-4b30405213fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:47.718737 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc1035-56b2-4bc3-b520-4b30405213fa None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:47.719049 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc1035-56b2-4bc3-b520-4b30405213fa None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:47.719287 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc1035-56b2-4bc3-b520-4b30405213fa None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:47.720065 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc1035-56b2-4bc3-b520-4b30405213fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:47.720365 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc1035-56b2-4bc3-b520-4b30405213fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:47.721853 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc1035-56b2-4bc3-b520-4b30405213fa None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:47.734855 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 636/1245] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:40:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:47.740910 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95623f0e-8a73-4b64-b873-c2efc1c3b38d None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:47.848508 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95623f0e-8a73-4b64-b873-c2efc1c3b38d None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:47.888485 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6459885-d62d-4d84-b4c0-7d9d79f50923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:47.889231 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6459885-d62d-4d84-b4c0-7d9d79f50923 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:47.889603 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6459885-d62d-4d84-b4c0-7d9d79f50923 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:47.889971 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6459885-d62d-4d84-b4c0-7d9d79f50923 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:47.890930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6459885-d62d-4d84-b4c0-7d9d79f50923 None admin] RBAC: Adding query filter params (role.id=16dc6f09d53447fd9e4a95fb1df71d9d, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=85f5ef8708f54401af7e8defa8d13141) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:47.891317 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6459885-d62d-4d84-b4c0-7d9d79f50923 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:47.893271 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6459885-d62d-4d84-b4c0-7d9d79f50923 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:47.900392 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 610/1246] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:40:47 2022] GET /identity/v3/role_assignments?user.id=85f5ef8708f54401af7e8defa8d13141&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=16dc6f09d53447fd9e4a95fb1df71d9d => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:50.269384 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b25327-cd01-4eda-b088-0cd26ee37470 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:50.269916 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b25327-cd01-4eda-b088-0cd26ee37470 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:50.269916 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b25327-cd01-4eda-b088-0cd26ee37470 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:50.271264 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 637/1247] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:40:50.276962 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a3ae4-4fa3-4446-a68c-1651ff4027d5 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:50.277492 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a3ae4-4fa3-4446-a68c-1651ff4027d5 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:50.277492 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a3ae4-4fa3-4446-a68c-1651ff4027d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:50.295170 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-502a3ae4-4fa3-4446-a68c-1651ff4027d5 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:40:50.296376 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-502a3ae4-4fa3-4446-a68c-1651ff4027d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:40:50.364575 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 611/1248] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:40:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:40:50.390315 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b25327-cd01-4eda-b088-0cd26ee37470 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:50.490638 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b25327-cd01-4eda-b088-0cd26ee37470 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:50.524063 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116efbe-6dc6-4fd6-959b-7164b6c481f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:50.524775 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116efbe-6dc6-4fd6-959b-7164b6c481f9 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:50.525056 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116efbe-6dc6-4fd6-959b-7164b6c481f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:50.525331 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116efbe-6dc6-4fd6-959b-7164b6c481f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:50.535121 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116efbe-6dc6-4fd6-959b-7164b6c481f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:40:50.542010 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-d116efbe-6dc6-4fd6-959b-7164b6c481f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:40:50.546875 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 638/1249] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:40:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:50.549378 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a3ae4-4fa3-4446-a68c-1651ff4027d5 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:50.645641 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a3ae4-4fa3-4446-a68c-1651ff4027d5 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:50.679011 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718fd8b-e752-4c3f-aa9b-670b43348a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:50.679675 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718fd8b-e752-4c3f-aa9b-670b43348a83 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:50.679958 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718fd8b-e752-4c3f-aa9b-670b43348a83 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:50.680229 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6718fd8b-e752-4c3f-aa9b-670b43348a83 None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:50.681043 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718fd8b-e752-4c3f-aa9b-670b43348a83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:50.681339 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718fd8b-e752-4c3f-aa9b-670b43348a83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:50.682718 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6718fd8b-e752-4c3f-aa9b-670b43348a83 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:50.690868 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 612/1250] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:40:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:50.696385 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116efbe-6dc6-4fd6-959b-7164b6c481f9 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:50.789554 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116efbe-6dc6-4fd6-959b-7164b6c481f9 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:50.820369 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088de643-cfc4-4f86-a2cb-d77dd64e2a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:50.821140 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088de643-cfc4-4f86-a2cb-d77dd64e2a93 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:50.821417 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088de643-cfc4-4f86-a2cb-d77dd64e2a93 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:50.821687 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088de643-cfc4-4f86-a2cb-d77dd64e2a93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:50.832042 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088de643-cfc4-4f86-a2cb-d77dd64e2a93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:50.833470 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088de643-cfc4-4f86-a2cb-d77dd64e2a93 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:50.848914 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-088de643-cfc4-4f86-a2cb-d77dd64e2a93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:40:50.850059 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 639/1251] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:40:50.856304 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718fd8b-e752-4c3f-aa9b-670b43348a83 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:50.971664 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6718fd8b-e752-4c3f-aa9b-670b43348a83 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:51.003155 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78373a7c-eec8-4e1a-9a20-abb1854ab268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:51.003797 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78373a7c-eec8-4e1a-9a20-abb1854ab268 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:51.004075 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78373a7c-eec8-4e1a-9a20-abb1854ab268 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:51.004345 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78373a7c-eec8-4e1a-9a20-abb1854ab268 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:51.005073 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78373a7c-eec8-4e1a-9a20-abb1854ab268 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:51.005375 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78373a7c-eec8-4e1a-9a20-abb1854ab268 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:51.006744 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78373a7c-eec8-4e1a-9a20-abb1854ab268 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:51.017917 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 613/1252] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:40:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:51.023542 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088de643-cfc4-4f86-a2cb-d77dd64e2a93 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:51.115691 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088de643-cfc4-4f86-a2cb-d77dd64e2a93 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:51.147270 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037486c-0927-45dd-9454-559ad66a7e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:51.148053 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037486c-0927-45dd-9454-559ad66a7e64 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:51.148332 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037486c-0927-45dd-9454-559ad66a7e64 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:51.148606 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3037486c-0927-45dd-9454-559ad66a7e64 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:51.156293 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037486c-0927-45dd-9454-559ad66a7e64 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:51.157719 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3037486c-0927-45dd-9454-559ad66a7e64 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:51.170701 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-3037486c-0927-45dd-9454-559ad66a7e64 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 16:40:51.171853 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 640/1253] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:51.177599 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78373a7c-eec8-4e1a-9a20-abb1854ab268 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:51.269528 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78373a7c-eec8-4e1a-9a20-abb1854ab268 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:51.300045 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285246d-f8ed-435f-81a6-f8151bedcc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:51.300689 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285246d-f8ed-435f-81a6-f8151bedcc81 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:51.300968 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285246d-f8ed-435f-81a6-f8151bedcc81 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:51.301240 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285246d-f8ed-435f-81a6-f8151bedcc81 None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:51.302050 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285246d-f8ed-435f-81a6-f8151bedcc81 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:51.302355 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285246d-f8ed-435f-81a6-f8151bedcc81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:51.303785 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285246d-f8ed-435f-81a6-f8151bedcc81 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:51.320092 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 614/1254] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Apr 11 16:40:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:51.326117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037486c-0927-45dd-9454-559ad66a7e64 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:51.419702 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3037486c-0927-45dd-9454-559ad66a7e64 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:51.451410 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef57483-e952-471c-be97-bf959ed36716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:51.452034 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef57483-e952-471c-be97-bf959ed36716 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:51.452313 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef57483-e952-471c-be97-bf959ed36716 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:51.452584 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef57483-e952-471c-be97-bf959ed36716 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:51.515045 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef57483-e952-471c-be97-bf959ed36716 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:51.516481 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef57483-e952-471c-be97-bf959ed36716 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:51.606174 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 641/1255] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:40:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:40:51.611952 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285246d-f8ed-435f-81a6-f8151bedcc81 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:51.703628 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285246d-f8ed-435f-81a6-f8151bedcc81 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:51.735503 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62039157-ec38-4331-8c42-6c1200093d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:51.736265 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62039157-ec38-4331-8c42-6c1200093d17 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:51.736540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62039157-ec38-4331-8c42-6c1200093d17 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:51.736808 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62039157-ec38-4331-8c42-6c1200093d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:51.746057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62039157-ec38-4331-8c42-6c1200093d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:51.748029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62039157-ec38-4331-8c42-6c1200093d17 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:51.764127 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-62039157-ec38-4331-8c42-6c1200093d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:40:51.765251 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 615/1256] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 16:40:51.770705 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef57483-e952-471c-be97-bf959ed36716 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:51.861301 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef57483-e952-471c-be97-bf959ed36716 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:51.892835 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac8ddf-da8d-4ee7-89b1-385f852dcef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:51.893467 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac8ddf-da8d-4ee7-89b1-385f852dcef4 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:51.893745 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac8ddf-da8d-4ee7-89b1-385f852dcef4 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:51.894017 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac8ddf-da8d-4ee7-89b1-385f852dcef4 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:51.894743 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac8ddf-da8d-4ee7-89b1-385f852dcef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:51.895045 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac8ddf-da8d-4ee7-89b1-385f852dcef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:51.896393 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac8ddf-da8d-4ee7-89b1-385f852dcef4 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:51.913847 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 642/1257] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:40:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:51.922966 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62039157-ec38-4331-8c42-6c1200093d17 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:52.020350 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62039157-ec38-4331-8c42-6c1200093d17 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:52.052011 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e45cd-9eeb-4307-8546-79eeb2dff0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:52.052782 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e45cd-9eeb-4307-8546-79eeb2dff0ee None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:52.053059 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e45cd-9eeb-4307-8546-79eeb2dff0ee None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:52.053330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e45cd-9eeb-4307-8546-79eeb2dff0ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:52.059593 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e45cd-9eeb-4307-8546-79eeb2dff0ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:52.061011 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973e45cd-9eeb-4307-8546-79eeb2dff0ee None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:52.073467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-973e45cd-9eeb-4307-8546-79eeb2dff0ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:40:52.074657 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 616/1258] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:40:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:52.080480 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac8ddf-da8d-4ee7-89b1-385f852dcef4 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:52.173479 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac8ddf-da8d-4ee7-89b1-385f852dcef4 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:52.204139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3514e3-1bc3-4eef-a4de-5c5d9f614fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:52.204774 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3514e3-1bc3-4eef-a4de-5c5d9f614fe4 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:52.205054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3514e3-1bc3-4eef-a4de-5c5d9f614fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:52.205330 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3514e3-1bc3-4eef-a4de-5c5d9f614fe4 None admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:52.206091 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3514e3-1bc3-4eef-a4de-5c5d9f614fe4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:52.206395 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3514e3-1bc3-4eef-a4de-5c5d9f614fe4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:52.208247 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3514e3-1bc3-4eef-a4de-5c5d9f614fe4 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:52.220354 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 643/1259] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:40:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:52.226341 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e45cd-9eeb-4307-8546-79eeb2dff0ee None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:52.318164 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e45cd-9eeb-4307-8546-79eeb2dff0ee None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:52.348744 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cbee9f-81a6-4b39-9469-dff063e00b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:52.349368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbee9f-81a6-4b39-9469-dff063e00b8f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:52.349647 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbee9f-81a6-4b39-9469-dff063e00b8f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:52.349917 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cbee9f-81a6-4b39-9469-dff063e00b8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:52.350754 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbee9f-81a6-4b39-9469-dff063e00b8f None admin] RBAC: Adding query filter params (role.id=13de1ce875d44fcc988cc31b3a0639be, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=85f5ef8708f54401af7e8defa8d13141) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:52.351059 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbee9f-81a6-4b39-9469-dff063e00b8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:52.352445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cbee9f-81a6-4b39-9469-dff063e00b8f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:52.358088 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 617/1260] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:40:52 2022] GET /identity/v3/role_assignments?user.id=85f5ef8708f54401af7e8defa8d13141&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 259 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:54.600550 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9220603-7a25-40fa-9700-0e9223c1cc16 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:54.601080 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9220603-7a25-40fa-9700-0e9223c1cc16 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:54.601080 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9220603-7a25-40fa-9700-0e9223c1cc16 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:54.602457 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 644/1261] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:40:54.608352 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647f84f-de75-4fc7-9aef-d1d622e98e68 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:54.608779 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647f84f-de75-4fc7-9aef-d1d622e98e68 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:54.608903 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647f84f-de75-4fc7-9aef-d1d622e98e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:54.624979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-4647f84f-de75-4fc7-9aef-d1d622e98e68 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:40:54.626133 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4647f84f-de75-4fc7-9aef-d1d622e98e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:40:54.687755 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 618/1262] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:40:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:40:54.709781 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9220603-7a25-40fa-9700-0e9223c1cc16 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:54.803503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9220603-7a25-40fa-9700-0e9223c1cc16 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:54.834674 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28921a-0445-43d0-b055-79a16cd0b6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:54.835435 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28921a-0445-43d0-b055-79a16cd0b6c2 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:54.835712 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28921a-0445-43d0-b055-79a16cd0b6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:54.835982 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e28921a-0445-43d0-b055-79a16cd0b6c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:54.846058 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e28921a-0445-43d0-b055-79a16cd0b6c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:40:54.852835 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-3e28921a-0445-43d0-b055-79a16cd0b6c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:40:54.853929 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 645/1263] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:40:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:54.861152 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647f84f-de75-4fc7-9aef-d1d622e98e68 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:54.960177 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647f84f-de75-4fc7-9aef-d1d622e98e68 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:54.997640 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7bdd0-0748-48da-8b50-5f81f193af8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:54.998295 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7bdd0-0748-48da-8b50-5f81f193af8c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:54.998578 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7bdd0-0748-48da-8b50-5f81f193af8c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:54.998883 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac7bdd0-0748-48da-8b50-5f81f193af8c None admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:54.999618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7bdd0-0748-48da-8b50-5f81f193af8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:54.999921 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7bdd0-0748-48da-8b50-5f81f193af8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:55.001277 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac7bdd0-0748-48da-8b50-5f81f193af8c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:55.008881 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 619/1264] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:40:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:55.015632 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28921a-0445-43d0-b055-79a16cd0b6c2 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:55.106838 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e28921a-0445-43d0-b055-79a16cd0b6c2 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:55.138091 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2297a-e463-4ae9-85e4-5b745b79f449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:55.138873 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2297a-e463-4ae9-85e4-5b745b79f449 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:55.139147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2297a-e463-4ae9-85e4-5b745b79f449 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:55.139411 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2297a-e463-4ae9-85e4-5b745b79f449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:55.149085 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2297a-e463-4ae9-85e4-5b745b79f449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:55.150503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e2297a-e463-4ae9-85e4-5b745b79f449 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:55.165735 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-c5e2297a-e463-4ae9-85e4-5b745b79f449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:40:55.166893 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 646/1265] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:55.172455 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7bdd0-0748-48da-8b50-5f81f193af8c None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:55.265656 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac7bdd0-0748-48da-8b50-5f81f193af8c None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:55.296168 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6efe32-5ad9-466d-bba5-393f730e5c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:55.296803 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6efe32-5ad9-466d-bba5-393f730e5c21 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:55.297083 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6efe32-5ad9-466d-bba5-393f730e5c21 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:55.297359 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6efe32-5ad9-466d-bba5-393f730e5c21 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:55.298059 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6efe32-5ad9-466d-bba5-393f730e5c21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:55.298367 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6efe32-5ad9-466d-bba5-393f730e5c21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:55.299737 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6efe32-5ad9-466d-bba5-393f730e5c21 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:55.311718 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 620/1266] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:55.317267 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2297a-e463-4ae9-85e4-5b745b79f449 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:55.409934 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e2297a-e463-4ae9-85e4-5b745b79f449 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:55.441323 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954a38f-2220-418f-bcf0-37b1f1b31d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:55.442097 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954a38f-2220-418f-bcf0-37b1f1b31d84 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:55.442376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954a38f-2220-418f-bcf0-37b1f1b31d84 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:55.442672 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954a38f-2220-418f-bcf0-37b1f1b31d84 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:55.449604 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954a38f-2220-418f-bcf0-37b1f1b31d84 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:55.451074 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954a38f-2220-418f-bcf0-37b1f1b31d84 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:55.463934 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-2954a38f-2220-418f-bcf0-37b1f1b31d84 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 16:40:55.465091 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 647/1267] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:55.470562 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6efe32-5ad9-466d-bba5-393f730e5c21 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:55.563025 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6efe32-5ad9-466d-bba5-393f730e5c21 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:55.593643 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69c671-2431-4026-aabf-efd95d6c335e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:55.594289 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69c671-2431-4026-aabf-efd95d6c335e None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:55.594565 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69c671-2431-4026-aabf-efd95d6c335e None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:55.594862 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69c671-2431-4026-aabf-efd95d6c335e None admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:55.595681 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69c671-2431-4026-aabf-efd95d6c335e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:55.595986 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69c671-2431-4026-aabf-efd95d6c335e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:55.597388 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69c671-2431-4026-aabf-efd95d6c335e None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:55.613777 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 621/1268] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Apr 11 16:40:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:55.619236 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954a38f-2220-418f-bcf0-37b1f1b31d84 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:55.713064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954a38f-2220-418f-bcf0-37b1f1b31d84 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:55.744289 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fca156-c645-4a43-b177-419006c302dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:55.745060 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fca156-c645-4a43-b177-419006c302dc None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:55.745340 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fca156-c645-4a43-b177-419006c302dc None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:55.745615 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fca156-c645-4a43-b177-419006c302dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:55.756106 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fca156-c645-4a43-b177-419006c302dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:55.757536 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fca156-c645-4a43-b177-419006c302dc None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:55.773407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-b9fca156-c645-4a43-b177-419006c302dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:40:55.774539 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 648/1269] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:55.780750 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69c671-2431-4026-aabf-efd95d6c335e None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:55.872895 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69c671-2431-4026-aabf-efd95d6c335e None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:55.909164 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799c0f4-fa84-4cf8-b0c2-a7ed54e61939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:55.910402 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799c0f4-fa84-4cf8-b0c2-a7ed54e61939 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:55.910720 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799c0f4-fa84-4cf8-b0c2-a7ed54e61939 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:55.911218 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799c0f4-fa84-4cf8-b0c2-a7ed54e61939 None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:55.912225 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799c0f4-fa84-4cf8-b0c2-a7ed54e61939 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:55.912607 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799c0f4-fa84-4cf8-b0c2-a7ed54e61939 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:55.914920 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799c0f4-fa84-4cf8-b0c2-a7ed54e61939 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:55.934366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 622/1270] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:55.940127 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fca156-c645-4a43-b177-419006c302dc None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:56.032879 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fca156-c645-4a43-b177-419006c302dc None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:56.063861 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5c0ba-0342-4a0b-accb-914ca98a87b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:56.064622 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5c0ba-0342-4a0b-accb-914ca98a87b3 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:56.064904 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5c0ba-0342-4a0b-accb-914ca98a87b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:56.065176 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac5c0ba-0342-4a0b-accb-914ca98a87b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:56.071403 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5c0ba-0342-4a0b-accb-914ca98a87b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:56.072838 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac5c0ba-0342-4a0b-accb-914ca98a87b3 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:56.085839 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-dac5c0ba-0342-4a0b-accb-914ca98a87b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:40:56.087001 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 649/1271] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:40:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:56.093197 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799c0f4-fa84-4cf8-b0c2-a7ed54e61939 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:56.186244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799c0f4-fa84-4cf8-b0c2-a7ed54e61939 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:56.218506 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ca645-9970-4658-8715-f0d803c8876f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:56.219168 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ca645-9970-4658-8715-f0d803c8876f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:56.219451 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ca645-9970-4658-8715-f0d803c8876f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:56.219726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ca645-9970-4658-8715-f0d803c8876f None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:56.220498 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ca645-9970-4658-8715-f0d803c8876f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:56.220805 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ca645-9970-4658-8715-f0d803c8876f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:56.222221 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ca645-9970-4658-8715-f0d803c8876f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:56.233624 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 623/1272] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:40:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:56.240344 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5c0ba-0342-4a0b-accb-914ca98a87b3 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:56.337953 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac5c0ba-0342-4a0b-accb-914ca98a87b3 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:56.369114 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0a8d99-d0f4-4e9b-bd34-aaabf2004d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:56.370002 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a8d99-d0f4-4e9b-bd34-aaabf2004d90 None admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:56.370280 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a8d99-d0f4-4e9b-bd34-aaabf2004d90 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:56.370553 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0a8d99-d0f4-4e9b-bd34-aaabf2004d90 None admin] PATH_INFO: `/v3/projects/c1eb8559ca744abda7039b767af5818f/users/85f5ef8708f54401af7e8defa8d13141/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:56.372496 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a8d99-d0f4-4e9b-bd34-aaabf2004d90 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1eb8559ca744abda7039b767af5818f, user_id=85f5ef8708f54401af7e8defa8d13141, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:56.373909 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0a8d99-d0f4-4e9b-bd34-aaabf2004d90 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:56.387760 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 650/1273] 10.222.0.73 () {58 vars in 1439 bytes} [Mon Apr 11 16:40:56 2022] PUT /identity/v3/projects/c1eb8559ca744abda7039b767af5818f/users/85f5ef8708f54401af7e8defa8d13141/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:40:58.653207 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0888e-3de9-43d5-8e1f-ced913d913d7 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:58.653762 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0888e-3de9-43d5-8e1f-ced913d913d7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:58.653762 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e0888e-3de9-43d5-8e1f-ced913d913d7 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:58.655122 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 624/1274] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:40:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:40:58.660374 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366615d-2a0d-4d61-a3b9-91cbefc6220b None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:58.660749 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366615d-2a0d-4d61-a3b9-91cbefc6220b None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:58.660918 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366615d-2a0d-4d61-a3b9-91cbefc6220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:58.676843 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-f366615d-2a0d-4d61-a3b9-91cbefc6220b None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:40:58.678005 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f366615d-2a0d-4d61-a3b9-91cbefc6220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:40:58.739003 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 651/1275] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:40:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:40:58.764448 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0888e-3de9-43d5-8e1f-ced913d913d7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:58.856425 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e0888e-3de9-43d5-8e1f-ced913d913d7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:58.888062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88770ddc-da79-42f8-8d3a-b9c64603e908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:58.888831 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88770ddc-da79-42f8-8d3a-b9c64603e908 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:58.889111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88770ddc-da79-42f8-8d3a-b9c64603e908 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:58.889383 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88770ddc-da79-42f8-8d3a-b9c64603e908 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:58.898724 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88770ddc-da79-42f8-8d3a-b9c64603e908 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 16:40:58.906056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-88770ddc-da79-42f8-8d3a-b9c64603e908 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 16:40:58.907303 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 625/1276] 10.222.0.73 () {56 vars in 1096 bytes} [Mon Apr 11 16:40:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:58.913398 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366615d-2a0d-4d61-a3b9-91cbefc6220b None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:59.015226 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366615d-2a0d-4d61-a3b9-91cbefc6220b None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:59.045823 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059c7d9-e08e-4d52-b6be-f70eba3806c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:59.046474 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059c7d9-e08e-4d52-b6be-f70eba3806c8 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:59.046785 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059c7d9-e08e-4d52-b6be-f70eba3806c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:59.047074 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2059c7d9-e08e-4d52-b6be-f70eba3806c8 None admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:59.047788 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059c7d9-e08e-4d52-b6be-f70eba3806c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:59.048089 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059c7d9-e08e-4d52-b6be-f70eba3806c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:59.049444 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2059c7d9-e08e-4d52-b6be-f70eba3806c8 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:59.056967 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 652/1277] 10.222.0.73 () {56 vars in 1099 bytes} [Mon Apr 11 16:40:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:59.063160 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88770ddc-da79-42f8-8d3a-b9c64603e908 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:59.156903 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88770ddc-da79-42f8-8d3a-b9c64603e908 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:59.188697 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8210eb0-eb6f-46d7-a4d8-9614ae0dca0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:59.189459 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8210eb0-eb6f-46d7-a4d8-9614ae0dca0f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:59.189734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8210eb0-eb6f-46d7-a4d8-9614ae0dca0f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:59.190003 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8210eb0-eb6f-46d7-a4d8-9614ae0dca0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:59.199480 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8210eb0-eb6f-46d7-a4d8-9614ae0dca0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:59.200888 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8210eb0-eb6f-46d7-a4d8-9614ae0dca0f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:59.216768 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-c8210eb0-eb6f-46d7-a4d8-9614ae0dca0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:40:59.217895 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 626/1278] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:59.223478 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059c7d9-e08e-4d52-b6be-f70eba3806c8 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:59.317839 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2059c7d9-e08e-4d52-b6be-f70eba3806c8 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:59.348396 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d985b-9902-44b2-81b8-4d5b5a0d5f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:59.349036 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d985b-9902-44b2-81b8-4d5b5a0d5f88 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:59.349313 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d985b-9902-44b2-81b8-4d5b5a0d5f88 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:59.349584 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d985b-9902-44b2-81b8-4d5b5a0d5f88 None admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:59.350285 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d985b-9902-44b2-81b8-4d5b5a0d5f88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:59.350610 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d985b-9902-44b2-81b8-4d5b5a0d5f88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:59.351952 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d985b-9902-44b2-81b8-4d5b5a0d5f88 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:59.363410 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 653/1279] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:40:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:59.369035 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8210eb0-eb6f-46d7-a4d8-9614ae0dca0f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:59.462497 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8210eb0-eb6f-46d7-a4d8-9614ae0dca0f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:59.494604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e97692-6ac5-4dfb-a199-74fec39a82e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:59.495414 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e97692-6ac5-4dfb-a199-74fec39a82e2 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:59.495693 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e97692-6ac5-4dfb-a199-74fec39a82e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:59.496531 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e97692-6ac5-4dfb-a199-74fec39a82e2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:59.503211 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e97692-6ac5-4dfb-a199-74fec39a82e2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:59.504769 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e97692-6ac5-4dfb-a199-74fec39a82e2 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:59.518523 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-e0e97692-6ac5-4dfb-a199-74fec39a82e2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 16:40:59.519703 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 627/1280] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:40:59.525435 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d985b-9902-44b2-81b8-4d5b5a0d5f88 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:59.617749 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d985b-9902-44b2-81b8-4d5b5a0d5f88 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:59.648845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11a565-1911-4e4a-84f2-30e0e0a9fc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:59.649485 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11a565-1911-4e4a-84f2-30e0e0a9fc58 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:59.649759 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11a565-1911-4e4a-84f2-30e0e0a9fc58 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:59.650027 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11a565-1911-4e4a-84f2-30e0e0a9fc58 None admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:59.650862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11a565-1911-4e4a-84f2-30e0e0a9fc58 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:40:59.651163 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11a565-1911-4e4a-84f2-30e0e0a9fc58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:59.653099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11a565-1911-4e4a-84f2-30e0e0a9fc58 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:59.669835 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 654/1281] 10.222.0.73 () {56 vars in 1143 bytes} [Mon Apr 11 16:40:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:40:59.675762 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e97692-6ac5-4dfb-a199-74fec39a82e2 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:40:59.768987 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e97692-6ac5-4dfb-a199-74fec39a82e2 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:40:59.801128 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be2364-d5fa-4e17-82ab-3c3921b958e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:40:59.801756 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be2364-d5fa-4e17-82ab-3c3921b958e3 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:40:59.802042 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be2364-d5fa-4e17-82ab-3c3921b958e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:40:59.802318 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be2364-d5fa-4e17-82ab-3c3921b958e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:40:59.865327 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be2364-d5fa-4e17-82ab-3c3921b958e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:40:59.866798 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1be2364-d5fa-4e17-82ab-3c3921b958e3 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:40:59.963896 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 628/1282] 10.222.0.73 () {58 vars in 1282 bytes} [Mon Apr 11 16:40:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 16:40:59.970437 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11a565-1911-4e4a-84f2-30e0e0a9fc58 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:00.062637 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11a565-1911-4e4a-84f2-30e0e0a9fc58 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:00.094849 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25a513-e77f-46a8-abfc-bf84f9766d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:00.095621 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25a513-e77f-46a8-abfc-bf84f9766d3b None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:00.095897 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25a513-e77f-46a8-abfc-bf84f9766d3b None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:00.096166 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25a513-e77f-46a8-abfc-bf84f9766d3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:00.105533 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25a513-e77f-46a8-abfc-bf84f9766d3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:00.106977 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f25a513-e77f-46a8-abfc-bf84f9766d3b None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:00.122801 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-3f25a513-e77f-46a8-abfc-bf84f9766d3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 16:41:00.123956 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 655/1283] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:40:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:41:00.129807 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be2364-d5fa-4e17-82ab-3c3921b958e3 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:00.223506 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be2364-d5fa-4e17-82ab-3c3921b958e3 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:00.255706 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676601d4-d9d3-4c46-9585-79a28f9730de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:00.256349 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676601d4-d9d3-4c46-9585-79a28f9730de None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:00.256628 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676601d4-d9d3-4c46-9585-79a28f9730de None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:00.256901 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676601d4-d9d3-4c46-9585-79a28f9730de None admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:00.257604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676601d4-d9d3-4c46-9585-79a28f9730de None admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:41:00.257905 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676601d4-d9d3-4c46-9585-79a28f9730de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:00.259278 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676601d4-d9d3-4c46-9585-79a28f9730de None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:00.270569 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 629/1284] 10.222.0.73 () {56 vars in 1109 bytes} [Mon Apr 11 16:41:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:41:00.276140 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25a513-e77f-46a8-abfc-bf84f9766d3b None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:00.373596 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25a513-e77f-46a8-abfc-bf84f9766d3b None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:00.405459 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ca6d1-6559-4dc2-be83-41842a3a826d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:00.406227 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ca6d1-6559-4dc2-be83-41842a3a826d None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:00.406504 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ca6d1-6559-4dc2-be83-41842a3a826d None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:00.406798 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08ca6d1-6559-4dc2-be83-41842a3a826d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:00.413035 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ca6d1-6559-4dc2-be83-41842a3a826d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:00.414468 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08ca6d1-6559-4dc2-be83-41842a3a826d None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:00.427018 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING keystone.server.flask.application [None req-d08ca6d1-6559-4dc2-be83-41842a3a826d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 16:41:00.428171 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 656/1285] 10.222.0.73 () {56 vars in 1111 bytes} [Mon Apr 11 16:41:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:41:00.434400 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676601d4-d9d3-4c46-9585-79a28f9730de None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:00.527129 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676601d4-d9d3-4c46-9585-79a28f9730de None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:00.557343 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a4d62-46e0-4afb-ab8a-b6bbf3129f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:00.557986 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a4d62-46e0-4afb-ab8a-b6bbf3129f8c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:00.558812 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a4d62-46e0-4afb-ab8a-b6bbf3129f8c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:00.559087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a4d62-46e0-4afb-ab8a-b6bbf3129f8c None admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:00.559854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a4d62-46e0-4afb-ab8a-b6bbf3129f8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:41:00.560158 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a4d62-46e0-4afb-ab8a-b6bbf3129f8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:00.561558 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380a4d62-46e0-4afb-ab8a-b6bbf3129f8c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:00.572740 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 630/1286] 10.222.0.73 () {56 vars in 1148 bytes} [Mon Apr 11 16:41:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:41:00.578644 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ca6d1-6559-4dc2-be83-41842a3a826d None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:00.671936 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08ca6d1-6559-4dc2-be83-41842a3a826d None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:00.702563 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328b8f5-5aae-40ee-873e-849324249ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:00.703218 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328b8f5-5aae-40ee-873e-849324249ff4 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:00.703497 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328b8f5-5aae-40ee-873e-849324249ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:00.703771 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328b8f5-5aae-40ee-873e-849324249ff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:00.704580 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328b8f5-5aae-40ee-873e-849324249ff4 None admin] RBAC: Adding query filter params (role.id=13de1ce875d44fcc988cc31b3a0639be, scope.project.id=c1eb8559ca744abda7039b767af5818f, user.id=85f5ef8708f54401af7e8defa8d13141) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:41:00.704884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328b8f5-5aae-40ee-873e-849324249ff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:00.706283 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7328b8f5-5aae-40ee-873e-849324249ff4 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:00.711812 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 657/1287] 10.222.0.73 () {56 vars in 1374 bytes} [Mon Apr 11 16:41:00 2022] GET /identity/v3/role_assignments?user.id=85f5ef8708f54401af7e8defa8d13141&scope.project.id=c1eb8559ca744abda7039b767af5818f&role.id=13de1ce875d44fcc988cc31b3a0639be => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:41:03.005861 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd6d71-a4fd-4e8c-9af3-5a6e09790b86 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:03.006405 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd6d71-a4fd-4e8c-9af3-5a6e09790b86 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:03.006405 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd6d71-a4fd-4e8c-9af3-5a6e09790b86 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:03.007791 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 631/1288] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:41:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:41:03.013207 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88503280-e634-47f9-be8c-8b8ad7b60571 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:03.013595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88503280-e634-47f9-be8c-8b8ad7b60571 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:03.013751 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88503280-e634-47f9-be8c-8b8ad7b60571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:03.029748 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-88503280-e634-47f9-be8c-8b8ad7b60571 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:41:03.030930 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-88503280-e634-47f9-be8c-8b8ad7b60571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:41:03.092541 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 658/1289] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:41:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:41:03.114512 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd6d71-a4fd-4e8c-9af3-5a6e09790b86 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:03.209356 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd6d71-a4fd-4e8c-9af3-5a6e09790b86 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:03.240472 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df300e-2046-4fde-bc65-b3759216e40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:03.241244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df300e-2046-4fde-bc65-b3759216e40f None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:03.241523 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df300e-2046-4fde-bc65-b3759216e40f None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:03.241794 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df300e-2046-4fde-bc65-b3759216e40f None admin] PATH_INFO: `/v3/services/placement` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:03.242427 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df300e-2046-4fde-bc65-b3759216e40f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:03.243780 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36df300e-2046-4fde-bc65-b3759216e40f None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:03.254849 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-36df300e-2046-4fde-bc65-b3759216e40f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 11 16:41:03.255978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 632/1290] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Apr 11 16:41:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:41:03.263397 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88503280-e634-47f9-be8c-8b8ad7b60571 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:03.354397 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88503280-e634-47f9-be8c-8b8ad7b60571 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:03.385883 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33d1c4-b310-4537-8efb-25d8570252fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:03.386563 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33d1c4-b310-4537-8efb-25d8570252fd None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:03.386876 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33d1c4-b310-4537-8efb-25d8570252fd None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:03.387147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33d1c4-b310-4537-8efb-25d8570252fd None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:03.387833 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33d1c4-b310-4537-8efb-25d8570252fd None admin] RBAC: Adding query filter params (name=placement) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:41:03.388130 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33d1c4-b310-4537-8efb-25d8570252fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:03.389480 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33d1c4-b310-4537-8efb-25d8570252fd None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:03.394030 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 659/1291] 10.222.0.73 () {56 vars in 1116 bytes} [Mon Apr 11 16:41:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:41:03.399632 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df300e-2046-4fde-bc65-b3759216e40f None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:03.492459 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df300e-2046-4fde-bc65-b3759216e40f None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:03.524184 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c8969-8986-49c0-a57a-f2633cfd3661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:03.524813 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c8969-8986-49c0-a57a-f2633cfd3661 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:03.525091 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c8969-8986-49c0-a57a-f2633cfd3661 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:03.525363 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c8969-8986-49c0-a57a-f2633cfd3661 None admin] PATH_INFO: `/v3/services` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:03.526047 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c8969-8986-49c0-a57a-f2633cfd3661 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:41:03.526349 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c8969-8986-49c0-a57a-f2633cfd3661 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:03.527744 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c8969-8986-49c0-a57a-f2633cfd3661 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:03.531873 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 633/1292] 10.222.0.73 () {56 vars in 1116 bytes} [Mon Apr 11 16:41:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:41:05.792740 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a0207-fa20-4df9-a85c-15dbecfa3b97 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:05.793261 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a0207-fa20-4df9-a85c-15dbecfa3b97 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:05.793261 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a0207-fa20-4df9-a85c-15dbecfa3b97 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:05.794653 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 660/1293] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:41:05.799803 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6605b-8d07-42fe-a988-640758079630 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:05.800209 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6605b-8d07-42fe-a988-640758079630 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:05.800361 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b6605b-8d07-42fe-a988-640758079630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:05.817002 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-89b6605b-8d07-42fe-a988-640758079630 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:41:05.818179 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-89b6605b-8d07-42fe-a988-640758079630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:41:05.880816 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 634/1294] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:41:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:41:05.904868 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a0207-fa20-4df9-a85c-15dbecfa3b97 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:06.005890 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a0207-fa20-4df9-a85c-15dbecfa3b97 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:06.037752 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185537fb-3c0a-43c6-bd17-8e6a4497ab34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:06.038403 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185537fb-3c0a-43c6-bd17-8e6a4497ab34 None admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:06.038715 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185537fb-3c0a-43c6-bd17-8e6a4497ab34 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:06.038991 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185537fb-3c0a-43c6-bd17-8e6a4497ab34 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:06.039700 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185537fb-3c0a-43c6-bd17-8e6a4497ab34 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:06.041061 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185537fb-3c0a-43c6-bd17-8e6a4497ab34 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:06.053711 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 661/1295] 10.222.0.73 () {60 vars in 1141 bytes} [Mon Apr 11 16:41:05 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:41:08.316754 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed280f-e1b0-46b9-90ff-efeb790aa219 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:08.317244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed280f-e1b0-46b9-90ff-efeb790aa219 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:08.317244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed280f-e1b0-46b9-90ff-efeb790aa219 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:08.318619 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 635/1296] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:41:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:41:08.324096 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3114e9a-4b07-4170-8806-371b53340da3 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:08.324461 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3114e9a-4b07-4170-8806-371b53340da3 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:08.324631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3114e9a-4b07-4170-8806-371b53340da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:08.341909 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-c3114e9a-4b07-4170-8806-371b53340da3 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:41:08.343091 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-c3114e9a-4b07-4170-8806-371b53340da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:41:08.410419 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 662/1297] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:41:08 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:41:08.435087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed280f-e1b0-46b9-90ff-efeb790aa219 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:08.529048 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed280f-e1b0-46b9-90ff-efeb790aa219 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:08.560559 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f43f67-5455-4cd0-91f5-c2e1d42bc1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:08.561338 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f43f67-5455-4cd0-91f5-c2e1d42bc1b6 None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:08.561622 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f43f67-5455-4cd0-91f5-c2e1d42bc1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:08.561899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f43f67-5455-4cd0-91f5-c2e1d42bc1b6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:08.562541 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f43f67-5455-4cd0-91f5-c2e1d42bc1b6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:08.563917 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f43f67-5455-4cd0-91f5-c2e1d42bc1b6 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:08.574610 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-74f43f67-5455-4cd0-91f5-c2e1d42bc1b6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 11 16:41:08.575698 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 636/1298] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Apr 11 16:41:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:41:08.581569 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3114e9a-4b07-4170-8806-371b53340da3 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:08.673456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3114e9a-4b07-4170-8806-371b53340da3 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:08.704356 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009c638-71e6-4836-a53c-9a3488cbdc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:08.704999 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009c638-71e6-4836-a53c-9a3488cbdc53 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:08.705284 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009c638-71e6-4836-a53c-9a3488cbdc53 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:08.705562 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009c638-71e6-4836-a53c-9a3488cbdc53 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:08.706256 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009c638-71e6-4836-a53c-9a3488cbdc53 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:41:08.706562 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009c638-71e6-4836-a53c-9a3488cbdc53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:08.707947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009c638-71e6-4836-a53c-9a3488cbdc53 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:08.712800 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 663/1299] 10.222.0.73 () {56 vars in 1116 bytes} [Mon Apr 11 16:41:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:41:08.718993 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f43f67-5455-4cd0-91f5-c2e1d42bc1b6 None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:08.812812 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f43f67-5455-4cd0-91f5-c2e1d42bc1b6 None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:08.843569 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d2b22-cc16-4ecb-9fdf-fab7d845053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:08.844140 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d2b22-cc16-4ecb-9fdf-fab7d845053c None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:08.844417 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d2b22-cc16-4ecb-9fdf-fab7d845053c None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:08.844687 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d2b22-cc16-4ecb-9fdf-fab7d845053c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:08.845449 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d2b22-cc16-4ecb-9fdf-fab7d845053c None admin] RBAC: Adding query filter params (interface=public, service_id=894c6c0736284a359e28bdb0cc47a018, region_id=RegionOne) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:41:08.845755 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d2b22-cc16-4ecb-9fdf-fab7d845053c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:08.847188 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6d2b22-cc16-4ecb-9fdf-fab7d845053c None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:08.851883 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 637/1300] 10.222.0.73 () {56 vars in 1251 bytes} [Mon Apr 11 16:41:08 2022] GET /identity/v3/endpoints?service_id=894c6c0736284a359e28bdb0cc47a018&interface=public®ion_id=RegionOne => generated 194 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:41:08.857754 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009c638-71e6-4836-a53c-9a3488cbdc53 None admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:08.948787 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009c638-71e6-4836-a53c-9a3488cbdc53 None admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:08.980489 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223d0a5-1aa4-442e-9334-2b4badd93df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:08.981138 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223d0a5-1aa4-442e-9334-2b4badd93df1 None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:08.981420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223d0a5-1aa4-442e-9334-2b4badd93df1 None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:08.981696 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223d0a5-1aa4-442e-9334-2b4badd93df1 None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:08.982360 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223d0a5-1aa4-442e-9334-2b4badd93df1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:08.983754 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223d0a5-1aa4-442e-9334-2b4badd93df1 None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:08.990243 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 664/1301] 10.222.0.73 () {56 vars in 1087 bytes} [Mon Apr 11 16:41:08 2022] GET /identity/v3/services => generated 2191 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:41:11.238403 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0701e3-9968-4cec-a495-6035220b2125 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:11.239029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0701e3-9968-4cec-a495-6035220b2125 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:11.239029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0701e3-9968-4cec-a495-6035220b2125 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:11.240236 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 638/1302] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:41:11.245369 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b193fc7-9b06-4c2c-9c05-02849c39c33d None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:11.245730 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b193fc7-9b06-4c2c-9c05-02849c39c33d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:11.245918 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b193fc7-9b06-4c2c-9c05-02849c39c33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:11.262628 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-4b193fc7-9b06-4c2c-9c05-02849c39c33d None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:41:11.263781 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4b193fc7-9b06-4c2c-9c05-02849c39c33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:41:11.324891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 665/1303] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:41:11 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 16:41:11.348303 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0701e3-9968-4cec-a495-6035220b2125 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:11.443357 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0701e3-9968-4cec-a495-6035220b2125 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:11.473830 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce651a-bcf1-4de9-8726-6236184b40dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:11.474618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce651a-bcf1-4de9-8726-6236184b40dd None admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:11.474913 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce651a-bcf1-4de9-8726-6236184b40dd None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:11.475187 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce651a-bcf1-4de9-8726-6236184b40dd None admin] PATH_INFO: `/v3/services/placement` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:11.475825 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce651a-bcf1-4de9-8726-6236184b40dd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:11.477168 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce651a-bcf1-4de9-8726-6236184b40dd None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:11.488276 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING keystone.server.flask.application [None req-d0ce651a-bcf1-4de9-8726-6236184b40dd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 11 16:41:11.489447 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 639/1304] 10.222.0.73 () {56 vars in 1117 bytes} [Mon Apr 11 16:41:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 16:41:11.495334 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b193fc7-9b06-4c2c-9c05-02849c39c33d None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:11.590231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b193fc7-9b06-4c2c-9c05-02849c39c33d None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:11.621566 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e031b-0359-42a9-bd2c-f71f6dfda47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:11.622202 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e031b-0359-42a9-bd2c-f71f6dfda47e None admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:11.622479 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e031b-0359-42a9-bd2c-f71f6dfda47e None admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:11.622775 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e031b-0359-42a9-bd2c-f71f6dfda47e None admin] PATH_INFO: `/v3/services` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:11.623462 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e031b-0359-42a9-bd2c-f71f6dfda47e None admin] RBAC: Adding query filter params (name=placement) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:41:11.623761 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e031b-0359-42a9-bd2c-f71f6dfda47e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:11.625116 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81e031b-0359-42a9-bd2c-f71f6dfda47e None admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:11.629939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 666/1305] 10.222.0.73 () {56 vars in 1116 bytes} [Mon Apr 11 16:41:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:41:11.636305 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce651a-bcf1-4de9-8726-6236184b40dd None admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:41:11.728319 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce651a-bcf1-4de9-8726-6236184b40dd None admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:41:11.759333 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eb316e-c1a6-4d54-97aa-b72a60d57e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:41:11.760171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb316e-c1a6-4d54-97aa-b72a60d57e13 None admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:41:11.760452 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb316e-c1a6-4d54-97aa-b72a60d57e13 None admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:41:11.761267 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eb316e-c1a6-4d54-97aa-b72a60d57e13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:41:11.761981 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb316e-c1a6-4d54-97aa-b72a60d57e13 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:41:11.763345 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eb316e-c1a6-4d54-97aa-b72a60d57e13 None admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:41:11.780253 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 640/1306] 10.222.0.73 () {60 vars in 1144 bytes} [Mon Apr 11 16:41:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:42:15.383305 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb11eb-0a0c-477c-b1c5-675fb02832c8 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:15.383882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb11eb-0a0c-477c-b1c5-675fb02832c8 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:15.383882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb11eb-0a0c-477c-b1c5-675fb02832c8 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:15.390708 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9de5d2-f58e-4919-9ca9-2424474b2906 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:15.391142 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9de5d2-f58e-4919-9ca9-2424474b2906 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:15.391365 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9de5d2-f58e-4919-9ca9-2424474b2906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:15.393409 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 667/1307] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:42:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:42:15.474027 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-7f9de5d2-f58e-4919-9ca9-2424474b2906 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:42:15.475170 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7f9de5d2-f58e-4919-9ca9-2424474b2906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:15.606974 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 641/1308] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:42:15.649211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7cda0-8138-4aa1-afa1-adfbd5f6e07f None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:15.649499 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7cda0-8138-4aa1-afa1-adfbd5f6e07f None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:15.650345 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7cda0-8138-4aa1-afa1-adfbd5f6e07f None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:15.652037 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 668/1309] 10.222.0.73 () {54 vars in 964 bytes} [Mon Apr 11 16:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:42:15.672399 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0cbaf-9649-43ee-949e-4b9bd720cb60 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:15.673912 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0cbaf-9649-43ee-949e-4b9bd720cb60 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:15.674380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0cbaf-9649-43ee-949e-4b9bd720cb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:15.847089 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-90c0cbaf-9649-43ee-949e-4b9bd720cb60 None None] MFA Rules not processed for user `7990c92f59454156bbd99445387ca889`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:42:15.848288 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-90c0cbaf-9649-43ee-949e-4b9bd720cb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:15.988175 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 642/1310] 10.222.0.73 () {58 vars in 1061 bytes} [Mon Apr 11 16:42:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:42:15.988711 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7cda0-8138-4aa1-afa1-adfbd5f6e07f None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:42:15.990487 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-69d7cda0-8138-4aa1-afa1-adfbd5f6e07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:16.107670 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7cda0-8138-4aa1-afa1-adfbd5f6e07f None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:42:16.180396 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414c7a8-0661-4911-8c3b-f3dcd04cfdf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:42:16.181830 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414c7a8-0661-4911-8c3b-f3dcd04cfdf9 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:16.182260 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414c7a8-0661-4911-8c3b-f3dcd04cfdf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:16.182704 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414c7a8-0661-4911-8c3b-f3dcd04cfdf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:16.184510 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-c414c7a8-0661-4911-8c3b-f3dcd04cfdf9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:16.296008 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414c7a8-0661-4911-8c3b-f3dcd04cfdf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:42:16.297693 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414c7a8-0661-4911-8c3b-f3dcd04cfdf9 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:42:16.317187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 669/1311] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:42:18.957556 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798e8ff-f67f-4e3b-97b8-05d5b34005af None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:18.958332 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798e8ff-f67f-4e3b-97b8-05d5b34005af None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:18.958332 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798e8ff-f67f-4e3b-97b8-05d5b34005af None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:18.959568 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 643/1312] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:42:18.966362 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f65d1b-d9a1-4415-8295-6f96b199b32c None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:18.967726 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f65d1b-d9a1-4415-8295-6f96b199b32c None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:18.968308 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f65d1b-d9a1-4415-8295-6f96b199b32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:19.047376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-a1f65d1b-d9a1-4415-8295-6f96b199b32c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:42:19.048681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a1f65d1b-d9a1-4415-8295-6f96b199b32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:19.142126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 670/1313] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:42:19.181868 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798e8ff-f67f-4e3b-97b8-05d5b34005af None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:42:19.183439 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6798e8ff-f67f-4e3b-97b8-05d5b34005af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:19.282147 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798e8ff-f67f-4e3b-97b8-05d5b34005af None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:42:19.351092 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acfe6e8-fd61-4db5-b620-42b9281a7a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:42:19.351647 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfe6e8-fd61-4db5-b620-42b9281a7a8f service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:19.351924 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfe6e8-fd61-4db5-b620-42b9281a7a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:19.352193 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acfe6e8-fd61-4db5-b620-42b9281a7a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:19.354368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4acfe6e8-fd61-4db5-b620-42b9281a7a8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:19.456722 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfe6e8-fd61-4db5-b620-42b9281a7a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:42:19.458056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acfe6e8-fd61-4db5-b620-42b9281a7a8f service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:42:19.477120 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 644/1314] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:42:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:42:22.072276 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199f386-52b2-41a7-9e44-9039b7282f87 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:22.072845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199f386-52b2-41a7-9e44-9039b7282f87 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:22.072845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199f386-52b2-41a7-9e44-9039b7282f87 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:22.074188 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 671/1315] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:42:22.079359 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7126d86-5308-4611-b2d3-5ffca41a8a4d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:22.079809 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7126d86-5308-4611-b2d3-5ffca41a8a4d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:22.079912 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7126d86-5308-4611-b2d3-5ffca41a8a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:22.142241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a7126d86-5308-4611-b2d3-5ffca41a8a4d None None] MFA Rules not processed for user `fe3cab871edd46f6ad5f0e3022f6c8c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:42:22.143465 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a7126d86-5308-4611-b2d3-5ffca41a8a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:22.235217 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 645/1316] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:42:22 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:42:22.275802 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199f386-52b2-41a7-9e44-9039b7282f87 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:42:22.277299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a199f386-52b2-41a7-9e44-9039b7282f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:22.377043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199f386-52b2-41a7-9e44-9039b7282f87 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:42:22.445080 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fce943-8e8a-4f2c-a90d-e6020a6802b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:42:22.445709 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fce943-8e8a-4f2c-a90d-e6020a6802b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:22.445985 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fce943-8e8a-4f2c-a90d-e6020a6802b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:22.446253 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fce943-8e8a-4f2c-a90d-e6020a6802b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:22.447980 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-71fce943-8e8a-4f2c-a90d-e6020a6802b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:22.549726 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fce943-8e8a-4f2c-a90d-e6020a6802b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:42:22.551121 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fce943-8e8a-4f2c-a90d-e6020a6802b0 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:42:22.568462 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 672/1317] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:42:22 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:42:25.382826 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6035c-fbaf-4413-8f78-29dbe4bb6d82 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:25.383356 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6035c-fbaf-4413-8f78-29dbe4bb6d82 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:25.383356 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d6035c-fbaf-4413-8f78-29dbe4bb6d82 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:25.384787 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 646/1318] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:42:25.390129 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a23569-3281-4ed1-835a-0bf1f94efa79 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:25.390498 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a23569-3281-4ed1-835a-0bf1f94efa79 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:25.390728 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a23569-3281-4ed1-835a-0bf1f94efa79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:25.451944 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-a0a23569-3281-4ed1-835a-0bf1f94efa79 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:42:25.453120 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a0a23569-3281-4ed1-835a-0bf1f94efa79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:25.543922 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 673/1319] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:42:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:42:25.583694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6035c-fbaf-4413-8f78-29dbe4bb6d82 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:42:25.585193 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-03d6035c-fbaf-4413-8f78-29dbe4bb6d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:25.682821 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d6035c-fbaf-4413-8f78-29dbe4bb6d82 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:42:25.749636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f1950-84ca-4eb1-90f2-e702719ea121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:42:25.750261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f1950-84ca-4eb1-90f2-e702719ea121 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:25.750537 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f1950-84ca-4eb1-90f2-e702719ea121 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:25.750835 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f1950-84ca-4eb1-90f2-e702719ea121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:25.752509 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c17f1950-84ca-4eb1-90f2-e702719ea121 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:25.854139 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f1950-84ca-4eb1-90f2-e702719ea121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:42:25.855562 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f1950-84ca-4eb1-90f2-e702719ea121 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:42:25.872651 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 647/1320] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:42:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:42:28.769333 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabd43e-500b-4764-a546-0bf57b700878 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:28.769866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabd43e-500b-4764-a546-0bf57b700878 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:28.769866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabd43e-500b-4764-a546-0bf57b700878 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:28.771262 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 674/1321] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:42:28.776921 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2783559-f1e9-44d6-9728-5d02798f970a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:28.777362 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2783559-f1e9-44d6-9728-5d02798f970a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:28.777467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2783559-f1e9-44d6-9728-5d02798f970a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:28.843369 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f2783559-f1e9-44d6-9728-5d02798f970a None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:42:28.844538 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f2783559-f1e9-44d6-9728-5d02798f970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:28.940158 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 648/1322] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:42:28.988148 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b660b-0484-490d-bd21-82f4ca6fa8f6 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:28.988424 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b660b-0484-490d-bd21-82f4ca6fa8f6 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:28.988867 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b660b-0484-490d-bd21-82f4ca6fa8f6 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:28.990236 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 675/1323] 10.222.0.73 () {54 vars in 964 bytes} [Mon Apr 11 16:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:42:28.996190 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815dcb2-f8f7-4531-97a2-cb920c08cb27 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:28.996500 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815dcb2-f8f7-4531-97a2-cb920c08cb27 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:28.996776 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815dcb2-f8f7-4531-97a2-cb920c08cb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:29.068187 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-5815dcb2-f8f7-4531-97a2-cb920c08cb27 None None] MFA Rules not processed for user `7990c92f59454156bbd99445387ca889`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:42:29.069275 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5815dcb2-f8f7-4531-97a2-cb920c08cb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:29.142767 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 649/1324] 10.222.0.73 () {58 vars in 1061 bytes} [Mon Apr 11 16:42:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:42:29.152489 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b660b-0484-490d-bd21-82f4ca6fa8f6 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:42:29.154014 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4e3b660b-0484-490d-bd21-82f4ca6fa8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:29.253081 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b660b-0484-490d-bd21-82f4ca6fa8f6 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:42:29.325625 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16c4318-d5d8-44bb-ba56-54b838aa7eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:42:29.326160 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c4318-d5d8-44bb-ba56-54b838aa7eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:29.326434 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c4318-d5d8-44bb-ba56-54b838aa7eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:29.326739 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c4318-d5d8-44bb-ba56-54b838aa7eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:29.328339 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f16c4318-d5d8-44bb-ba56-54b838aa7eb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:29.433989 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c4318-d5d8-44bb-ba56-54b838aa7eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:42:29.435482 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16c4318-d5d8-44bb-ba56-54b838aa7eb9 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:42:29.453348 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 676/1325] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:42:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:42:32.059460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cd2c8-91ed-47ba-8c3d-cacc0782a61d None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:32.059974 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cd2c8-91ed-47ba-8c3d-cacc0782a61d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:32.060063 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30cd2c8-91ed-47ba-8c3d-cacc0782a61d None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:32.061412 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 650/1326] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:42:32.066512 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09658181-b7d5-4754-8569-5d22045c8d25 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:32.066975 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09658181-b7d5-4754-8569-5d22045c8d25 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:32.067086 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09658181-b7d5-4754-8569-5d22045c8d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:32.129131 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-09658181-b7d5-4754-8569-5d22045c8d25 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:42:32.130282 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-09658181-b7d5-4754-8569-5d22045c8d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:32.222677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 677/1327] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:42:32.258355 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cd2c8-91ed-47ba-8c3d-cacc0782a61d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:42:32.260539 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a30cd2c8-91ed-47ba-8c3d-cacc0782a61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:32.359995 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30cd2c8-91ed-47ba-8c3d-cacc0782a61d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:42:32.430543 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e18fe8e-2f26-4841-b92b-fb86aed7493b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:42:32.431708 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18fe8e-2f26-4841-b92b-fb86aed7493b service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:32.431984 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18fe8e-2f26-4841-b92b-fb86aed7493b service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:32.432259 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e18fe8e-2f26-4841-b92b-fb86aed7493b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:32.433872 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4e18fe8e-2f26-4841-b92b-fb86aed7493b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:32.542918 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18fe8e-2f26-4841-b92b-fb86aed7493b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:42:32.544309 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e18fe8e-2f26-4841-b92b-fb86aed7493b service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:42:32.562353 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 651/1328] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:42:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:42:34.908530 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30060512-c4e7-49c5-b600-652c8e7aff00 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:34.909093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30060512-c4e7-49c5-b600-652c8e7aff00 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:34.909093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30060512-c4e7-49c5-b600-652c8e7aff00 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:34.910437 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 678/1329] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:42:34.915490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017b0e2-9c5b-4046-a113-3369daec6dc5 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:34.915898 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017b0e2-9c5b-4046-a113-3369daec6dc5 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:34.916046 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017b0e2-9c5b-4046-a113-3369daec6dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:34.979325 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f017b0e2-9c5b-4046-a113-3369daec6dc5 None None] MFA Rules not processed for user `fe3cab871edd46f6ad5f0e3022f6c8c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:42:34.980529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f017b0e2-9c5b-4046-a113-3369daec6dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:35.072324 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 652/1330] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:42:34 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:42:35.111076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30060512-c4e7-49c5-b600-652c8e7aff00 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:42:35.112633 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-30060512-c4e7-49c5-b600-652c8e7aff00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:35.209899 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30060512-c4e7-49c5-b600-652c8e7aff00 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:42:35.278759 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c53c2d-65f5-4737-955d-a38180d1beb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:42:35.279399 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c53c2d-65f5-4737-955d-a38180d1beb6 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:35.279676 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c53c2d-65f5-4737-955d-a38180d1beb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:35.279945 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c53c2d-65f5-4737-955d-a38180d1beb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:35.281543 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-86c53c2d-65f5-4737-955d-a38180d1beb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:35.386493 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c53c2d-65f5-4737-955d-a38180d1beb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:42:35.387961 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c53c2d-65f5-4737-955d-a38180d1beb6 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:42:35.405397 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 679/1331] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:42:35 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:42:37.915286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb48cd-0d0e-4586-99ae-cc4e093ee6f8 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:37.915825 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb48cd-0d0e-4586-99ae-cc4e093ee6f8 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:37.915825 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bb48cd-0d0e-4586-99ae-cc4e093ee6f8 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:37.917177 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 653/1332] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:42:37.922741 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a732759-7035-469e-a03c-be41727641bc None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:37.923192 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a732759-7035-469e-a03c-be41727641bc None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:37.923467 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a732759-7035-469e-a03c-be41727641bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:37.994521 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-8a732759-7035-469e-a03c-be41727641bc None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:42:37.995783 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-8a732759-7035-469e-a03c-be41727641bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:38.095891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 680/1333] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:42:38.131677 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb48cd-0d0e-4586-99ae-cc4e093ee6f8 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:42:38.133219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-50bb48cd-0d0e-4586-99ae-cc4e093ee6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:38.237940 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bb48cd-0d0e-4586-99ae-cc4e093ee6f8 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:42:38.309316 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1f699-3452-4d2f-a58a-a7c2deee3c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:42:38.309954 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1f699-3452-4d2f-a58a-a7c2deee3c31 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:38.310234 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1f699-3452-4d2f-a58a-a7c2deee3c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:38.310506 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1f699-3452-4d2f-a58a-a7c2deee3c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:38.312152 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-26e1f699-3452-4d2f-a58a-a7c2deee3c31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:38.415848 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1f699-3452-4d2f-a58a-a7c2deee3c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:42:38.417277 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1f699-3452-4d2f-a58a-a7c2deee3c31 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:42:38.435513 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 654/1334] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:42:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:42:40.754445 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9091098-8252-46d4-907f-511fab461be4 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:40.754997 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9091098-8252-46d4-907f-511fab461be4 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:40.755119 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9091098-8252-46d4-907f-511fab461be4 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:40.756387 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 681/1335] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:42:40.761837 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59de6ef-d22f-4a89-9932-86ad4df2a618 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:40.762227 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59de6ef-d22f-4a89-9932-86ad4df2a618 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:40.762411 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59de6ef-d22f-4a89-9932-86ad4df2a618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:40.824586 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b59de6ef-d22f-4a89-9932-86ad4df2a618 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:42:40.825796 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b59de6ef-d22f-4a89-9932-86ad4df2a618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:40.919668 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 655/1336] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:42:40.960173 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9091098-8252-46d4-907f-511fab461be4 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:42:40.961676 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b9091098-8252-46d4-907f-511fab461be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:41.061595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9091098-8252-46d4-907f-511fab461be4 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:42:41.135525 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15750c-ac7f-4520-93e9-414f72281d0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:42:41.136675 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15750c-ac7f-4520-93e9-414f72281d0b service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:41.137135 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15750c-ac7f-4520-93e9-414f72281d0b service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:41.137405 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15750c-ac7f-4520-93e9-414f72281d0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:41.139056 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4a15750c-ac7f-4520-93e9-414f72281d0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:41.245815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15750c-ac7f-4520-93e9-414f72281d0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:42:41.247287 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15750c-ac7f-4520-93e9-414f72281d0b service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:42:41.266631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 682/1337] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:42:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:42:43.837996 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9aec2a-542f-4f9d-911d-7413cb626752 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:43.838643 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9aec2a-542f-4f9d-911d-7413cb626752 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:43.838643 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9aec2a-542f-4f9d-911d-7413cb626752 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:43.839928 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 656/1338] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:42:43.845093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd18b50-0e07-4f81-9a77-157fd2584b2a None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:43.845517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd18b50-0e07-4f81-9a77-157fd2584b2a None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:43.845653 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd18b50-0e07-4f81-9a77-157fd2584b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:43.909320 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-abd18b50-0e07-4f81-9a77-157fd2584b2a None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:42:43.910292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-abd18b50-0e07-4f81-9a77-157fd2584b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:44.002644 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 683/1339] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:42:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:42:44.038385 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9aec2a-542f-4f9d-911d-7413cb626752 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:42:44.039979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7e9aec2a-542f-4f9d-911d-7413cb626752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:44.138092 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9aec2a-542f-4f9d-911d-7413cb626752 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:42:44.206916 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf72f14-4ed3-488d-b22a-78aece150dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:42:44.207511 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf72f14-4ed3-488d-b22a-78aece150dea service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:44.207833 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf72f14-4ed3-488d-b22a-78aece150dea service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:44.208140 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf72f14-4ed3-488d-b22a-78aece150dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:44.209775 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bbf72f14-4ed3-488d-b22a-78aece150dea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:44.313395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf72f14-4ed3-488d-b22a-78aece150dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:42:44.314874 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf72f14-4ed3-488d-b22a-78aece150dea service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:42:44.332438 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 657/1340] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:42:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:42:48.541233 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ea552-bd71-42e8-9158-e04b1a4a2ebc None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:48.541748 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ea552-bd71-42e8-9158-e04b1a4a2ebc None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:48.541748 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ea552-bd71-42e8-9158-e04b1a4a2ebc None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:48.543101 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 684/1341] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:42:48.548214 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966179c7-5097-4d03-a430-17fbc6c56c0d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:48.548674 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966179c7-5097-4d03-a430-17fbc6c56c0d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:48.548783 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966179c7-5097-4d03-a430-17fbc6c56c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:48.619241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-966179c7-5097-4d03-a430-17fbc6c56c0d None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:42:48.620406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-966179c7-5097-4d03-a430-17fbc6c56c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:48.721089 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 658/1342] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:42:48.761196 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ea552-bd71-42e8-9158-e04b1a4a2ebc None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:42:48.763596 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-784ea552-bd71-42e8-9158-e04b1a4a2ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:48.854820 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784ea552-bd71-42e8-9158-e04b1a4a2ebc None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:42:48.858282 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9c232-ca05-4444-845e-e574e45bf9d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:42:48.858961 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9c232-ca05-4444-845e-e574e45bf9d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:48.859243 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9c232-ca05-4444-845e-e574e45bf9d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:48.859520 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9c232-ca05-4444-845e-e574e45bf9d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:48.868788 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9c232-ca05-4444-845e-e574e45bf9d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:42:48.870213 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9c232-ca05-4444-845e-e574e45bf9d8 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:42:48.879291 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 685/1343] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:42:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:42:51.779731 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3277457-ee5a-482f-a106-c01db9077662 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:51.780242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3277457-ee5a-482f-a106-c01db9077662 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:51.780242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3277457-ee5a-482f-a106-c01db9077662 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:51.781578 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 659/1344] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:42:51.786899 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da77444-91ee-4b78-a89f-7a1bf2422987 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:51.787294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da77444-91ee-4b78-a89f-7a1bf2422987 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:51.787570 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da77444-91ee-4b78-a89f-7a1bf2422987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:51.814559 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-3da77444-91ee-4b78-a89f-7a1bf2422987 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:42:51.815735 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3da77444-91ee-4b78-a89f-7a1bf2422987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:51.889343 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 686/1345] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:42:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:42:51.929855 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3277457-ee5a-482f-a106-c01db9077662 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:42:51.932251 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d3277457-ee5a-482f-a106-c01db9077662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:51.948420 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3277457-ee5a-482f-a106-c01db9077662 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:42:51.953216 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc90693-d89e-4504-8049-99425dcd5001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:42:51.953875 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc90693-d89e-4504-8049-99425dcd5001 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:51.954293 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc90693-d89e-4504-8049-99425dcd5001 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:51.954612 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc90693-d89e-4504-8049-99425dcd5001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:51.964692 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc90693-d89e-4504-8049-99425dcd5001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:42:51.966114 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc90693-d89e-4504-8049-99425dcd5001 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:42:51.975678 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 660/1346] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:42:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:42:56.911448 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db9e83-4a98-4e4b-a2e0-17a1bbc891b5 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:56.911951 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db9e83-4a98-4e4b-a2e0-17a1bbc891b5 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:56.912047 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db9e83-4a98-4e4b-a2e0-17a1bbc891b5 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:56.913460 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 687/1347] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:42:56.918898 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af06e42-6ba5-46de-bae2-4291b43c57ef None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:56.919334 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af06e42-6ba5-46de-bae2-4291b43c57ef None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:56.919490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af06e42-6ba5-46de-bae2-4291b43c57ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:56.937515 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-2af06e42-6ba5-46de-bae2-4291b43c57ef None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:42:56.938758 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2af06e42-6ba5-46de-bae2-4291b43c57ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:42:56.947314 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 661/1348] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:42:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:42:56.985562 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db9e83-4a98-4e4b-a2e0-17a1bbc891b5 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:42:56.996295 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db9e83-4a98-4e4b-a2e0-17a1bbc891b5 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:42:56.999855 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0810af-1350-4157-8309-2ceb5ff16934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:42:57.000486 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0810af-1350-4157-8309-2ceb5ff16934 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:42:57.000772 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0810af-1350-4157-8309-2ceb5ff16934 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:42:57.001046 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0810af-1350-4157-8309-2ceb5ff16934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:42:57.010564 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0810af-1350-4157-8309-2ceb5ff16934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:42:57.012288 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0810af-1350-4157-8309-2ceb5ff16934 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:42:57.021945 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 688/1349] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:42:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:02.360149 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d0dea-c53a-4dd2-b3dc-54befa8adcd4 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:02.361078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d0dea-c53a-4dd2-b3dc-54befa8adcd4 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:02.361549 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d0dea-c53a-4dd2-b3dc-54befa8adcd4 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:02.363400 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 662/1350] 10.222.0.73 () {54 vars in 921 bytes} [Mon Apr 11 16:43:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:02.369054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1732315-b79d-46ee-9425-b1c246334b0e None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:02.369436 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1732315-b79d-46ee-9425-b1c246334b0e None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:02.369590 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1732315-b79d-46ee-9425-b1c246334b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:02.440396 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-f1732315-b79d-46ee-9425-b1c246334b0e None None] MFA Rules not processed for user `85f5ef8708f54401af7e8defa8d13141`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:02.441871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f1732315-b79d-46ee-9425-b1c246334b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:02.517309 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 689/1351] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Apr 11 16:43:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:06.770652 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2b987-f86e-452c-a8d0-e3d59229dcbf None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:06.771136 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2b987-f86e-452c-a8d0-e3d59229dcbf None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:06.771136 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2b987-f86e-452c-a8d0-e3d59229dcbf None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:06.772459 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 663/1352] 10.222.0.73 () {54 vars in 921 bytes} [Mon Apr 11 16:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:06.777963 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733680ee-10de-496a-afdd-32c4c84c42aa None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:06.778870 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733680ee-10de-496a-afdd-32c4c84c42aa None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:06.779396 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733680ee-10de-496a-afdd-32c4c84c42aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:06.798307 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-733680ee-10de-496a-afdd-32c4c84c42aa None None] MFA Rules not processed for user `85f5ef8708f54401af7e8defa8d13141`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:06.799559 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-733680ee-10de-496a-afdd-32c4c84c42aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:06.808296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 690/1353] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Apr 11 16:43:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:08.585992 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59e39e-db03-42cf-8c35-5f7f182ef292 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:08.586493 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59e39e-db03-42cf-8c35-5f7f182ef292 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:08.586661 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59e39e-db03-42cf-8c35-5f7f182ef292 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:08.587957 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 664/1354] 10.222.0.73 () {54 vars in 921 bytes} [Mon Apr 11 16:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:08.593201 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba9048-ce48-4d5b-8575-a9d93ee44024 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:08.593620 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba9048-ce48-4d5b-8575-a9d93ee44024 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:08.593807 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba9048-ce48-4d5b-8575-a9d93ee44024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:08.613117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-69ba9048-ce48-4d5b-8575-a9d93ee44024 None None] MFA Rules not processed for user `85f5ef8708f54401af7e8defa8d13141`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:08.614277 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-69ba9048-ce48-4d5b-8575-a9d93ee44024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:08.623327 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 691/1355] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Apr 11 16:43:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:12.352972 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239f0e-b925-4981-acf1-2297e6fabcaf None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.353491 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239f0e-b925-4981-acf1-2297e6fabcaf None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.353703 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16239f0e-b925-4981-acf1-2297e6fabcaf None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.355353 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 665/1356] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:12.360241 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190f927-a6e2-42d4-ace3-23171faa7891 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.360620 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190f927-a6e2-42d4-ace3-23171faa7891 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.360788 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1190f927-a6e2-42d4-ace3-23171faa7891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.378400 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-1190f927-a6e2-42d4-ace3-23171faa7891 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:12.379807 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-1190f927-a6e2-42d4-ace3-23171faa7891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:12.388546 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 692/1357] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:12.438055 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97e325-a42d-4ad4-857b-79f4e11e37da None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.438344 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97e325-a42d-4ad4-857b-79f4e11e37da None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.438634 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc97e325-a42d-4ad4-857b-79f4e11e37da None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.440242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 666/1358] 10.222.0.73 () {54 vars in 960 bytes} [Mon Apr 11 16:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:12.446634 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d739315-eb02-41c4-87e7-5f64eb79ec81 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.447083 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d739315-eb02-41c4-87e7-5f64eb79ec81 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.447355 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d739315-eb02-41c4-87e7-5f64eb79ec81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.505220 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-9d739315-eb02-41c4-87e7-5f64eb79ec81 None None] MFA Rules not processed for user `ba3665d046864985916fdd6c4a4edcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:12.506652 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9d739315-eb02-41c4-87e7-5f64eb79ec81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:12.590519 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 693/1359] 10.222.0.73 () {58 vars in 1057 bytes} [Mon Apr 11 16:43:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:12.598632 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97e325-a42d-4ad4-857b-79f4e11e37da None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:12.615189 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc97e325-a42d-4ad4-857b-79f4e11e37da None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:12.621051 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40182f5d-780b-48c1-8a8c-7618caee3e20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:12.621795 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182f5d-780b-48c1-8a8c-7618caee3e20 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:12.622175 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182f5d-780b-48c1-8a8c-7618caee3e20 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:12.622546 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182f5d-780b-48c1-8a8c-7618caee3e20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:12.631882 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40182f5d-780b-48c1-8a8c-7618caee3e20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:12.634273 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40182f5d-780b-48c1-8a8c-7618caee3e20 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:12.645177 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 667/1360] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:43:15.265477 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765ea7a-f824-4b2b-ba73-d372ad3afd43 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.266062 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765ea7a-f824-4b2b-ba73-d372ad3afd43 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.266062 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1765ea7a-f824-4b2b-ba73-d372ad3afd43 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.267398 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 694/1361] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:15.272719 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5a802-2f9f-484c-936f-bc8fcbbace5d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.273170 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5a802-2f9f-484c-936f-bc8fcbbace5d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.273279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5a802-2f9f-484c-936f-bc8fcbbace5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.292572 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-1bd5a802-2f9f-484c-936f-bc8fcbbace5d None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:15.293727 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1bd5a802-2f9f-484c-936f-bc8fcbbace5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:15.301567 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 668/1362] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:15.346154 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765ea7a-f824-4b2b-ba73-d372ad3afd43 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:15.361441 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1765ea7a-f824-4b2b-ba73-d372ad3afd43 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:15.366804 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faea2a4-0a27-453a-bab1-aaae50bbec0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:15.367543 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea2a4-0a27-453a-bab1-aaae50bbec0f service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:15.367829 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea2a4-0a27-453a-bab1-aaae50bbec0f service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:15.368149 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faea2a4-0a27-453a-bab1-aaae50bbec0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:15.377201 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faea2a4-0a27-453a-bab1-aaae50bbec0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:15.378797 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faea2a4-0a27-453a-bab1-aaae50bbec0f service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:15.388782 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 695/1363] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:18.011671 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727af2de-3af4-48ad-ae32-298f3893a247 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:18.012446 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727af2de-3af4-48ad-ae32-298f3893a247 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:18.012557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727af2de-3af4-48ad-ae32-298f3893a247 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:18.013888 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 669/1364] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:18.019277 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ece139-7d41-4a49-8160-eb619d964b42 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:18.019700 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ece139-7d41-4a49-8160-eb619d964b42 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:18.019814 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ece139-7d41-4a49-8160-eb619d964b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:18.037643 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-95ece139-7d41-4a49-8160-eb619d964b42 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:18.038858 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-95ece139-7d41-4a49-8160-eb619d964b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:18.047641 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 696/1365] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:18.093880 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5f8a0-b0fa-4992-a656-1f62f4ee0f61 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:18.094455 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5f8a0-b0fa-4992-a656-1f62f4ee0f61 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:18.094951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb5f8a0-b0fa-4992-a656-1f62f4ee0f61 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:18.096412 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 670/1366] 10.222.0.73 () {54 vars in 960 bytes} [Mon Apr 11 16:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:18.101716 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f772b-af67-45b6-bcf5-caa75cbf1b68 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:18.102003 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f772b-af67-45b6-bcf5-caa75cbf1b68 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:18.102286 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f772b-af67-45b6-bcf5-caa75cbf1b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:18.120688 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-e24f772b-af67-45b6-bcf5-caa75cbf1b68 None None] MFA Rules not processed for user `ba3665d046864985916fdd6c4a4edcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:18.121864 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-e24f772b-af67-45b6-bcf5-caa75cbf1b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:18.131274 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 697/1367] 10.222.0.73 () {58 vars in 1057 bytes} [Mon Apr 11 16:43:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:18.139229 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5f8a0-b0fa-4992-a656-1f62f4ee0f61 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:18.153897 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb5f8a0-b0fa-4992-a656-1f62f4ee0f61 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:18.159401 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c1798-6586-4347-a658-b08a38107683 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:18.160034 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c1798-6586-4347-a658-b08a38107683 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:18.160324 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c1798-6586-4347-a658-b08a38107683 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:18.160604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c1798-6586-4347-a658-b08a38107683 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:18.169601 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c1798-6586-4347-a658-b08a38107683 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:18.171237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c1798-6586-4347-a658-b08a38107683 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:18.184776 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 671/1368] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:20.575571 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7546ea-e93d-4b30-a4c2-472c9c2c3afc None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:20.576137 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7546ea-e93d-4b30-a4c2-472c9c2c3afc None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:20.576137 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7546ea-e93d-4b30-a4c2-472c9c2c3afc None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:20.577725 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 698/1369] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:20.583672 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bb8d8-9615-4700-a82e-8751e140221f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:20.584186 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bb8d8-9615-4700-a82e-8751e140221f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:20.584450 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0bb8d8-9615-4700-a82e-8751e140221f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:20.602213 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6c0bb8d8-9615-4700-a82e-8751e140221f None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:20.604217 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6c0bb8d8-9615-4700-a82e-8751e140221f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:20.612437 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 672/1370] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:20.628254 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2495d-f66d-45aa-bad4-7604bf6071e4 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:20.628536 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2495d-f66d-45aa-bad4-7604bf6071e4 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:20.628806 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2495d-f66d-45aa-bad4-7604bf6071e4 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:20.630499 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 699/1371] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:20.636083 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c51f9-11b3-4c63-904b-6d646761b622 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:20.636485 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c51f9-11b3-4c63-904b-6d646761b622 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:20.636869 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4c51f9-11b3-4c63-904b-6d646761b622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:20.655972 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-8d4c51f9-11b3-4c63-904b-6d646761b622 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:20.657277 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8d4c51f9-11b3-4c63-904b-6d646761b622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:20.658996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2495d-f66d-45aa-bad4-7604bf6071e4 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:20.666285 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 673/1372] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:20.673498 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2495d-f66d-45aa-bad4-7604bf6071e4 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:20.678913 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e59bc0-a40e-461f-b2ae-5f608ce7e2a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:20.679545 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e59bc0-a40e-461f-b2ae-5f608ce7e2a7 service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:20.679822 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e59bc0-a40e-461f-b2ae-5f608ce7e2a7 service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:20.680094 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e59bc0-a40e-461f-b2ae-5f608ce7e2a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:20.689021 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e59bc0-a40e-461f-b2ae-5f608ce7e2a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:20.690626 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e59bc0-a40e-461f-b2ae-5f608ce7e2a7 service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:20.700306 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 700/1373] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:43:20.983241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390529e-a81f-4b50-b83e-c9de9dacf0b9 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:20.983241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390529e-a81f-4b50-b83e-c9de9dacf0b9 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:20.983241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390529e-a81f-4b50-b83e-c9de9dacf0b9 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:20.984452 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 674/1374] 10.222.0.73 () {54 vars in 962 bytes} [Mon Apr 11 16:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:20.989436 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d943b9-85f5-404b-a576-f50fdf4d5e0a None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:20.989702 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d943b9-85f5-404b-a576-f50fdf4d5e0a None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:20.989985 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d943b9-85f5-404b-a576-f50fdf4d5e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:21.039281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-80d943b9-85f5-404b-a576-f50fdf4d5e0a None None] MFA Rules not processed for user `a4531e7936634508bb4cbfaaaca5bbde`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:21.041025 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-80d943b9-85f5-404b-a576-f50fdf4d5e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:21.099249 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 701/1375] 10.222.0.73 () {58 vars in 1059 bytes} [Mon Apr 11 16:43:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:21.107508 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390529e-a81f-4b50-b83e-c9de9dacf0b9 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:21.118100 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390529e-a81f-4b50-b83e-c9de9dacf0b9 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:21.121983 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d38fa5-169f-4fb4-aa46-f68c72c1c8b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:21.122649 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d38fa5-169f-4fb4-aa46-f68c72c1c8b3 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:21.123133 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d38fa5-169f-4fb4-aa46-f68c72c1c8b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:21.123414 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d38fa5-169f-4fb4-aa46-f68c72c1c8b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:21.132729 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d38fa5-169f-4fb4-aa46-f68c72c1c8b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:21.134382 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d38fa5-169f-4fb4-aa46-f68c72c1c8b3 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:21.144008 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 675/1376] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:43:23.036898 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478df18-6dd2-4f85-9755-586980686f9d None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:23.037431 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478df18-6dd2-4f85-9755-586980686f9d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:23.037627 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478df18-6dd2-4f85-9755-586980686f9d None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:23.039056 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 702/1377] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:23.044976 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a563f-292c-41f0-bcb7-c7d3daf1a44d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:23.045397 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a563f-292c-41f0-bcb7-c7d3daf1a44d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:23.045521 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6a563f-292c-41f0-bcb7-c7d3daf1a44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:23.064051 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-4d6a563f-292c-41f0-bcb7-c7d3daf1a44d None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:23.065223 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4d6a563f-292c-41f0-bcb7-c7d3daf1a44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:23.073105 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 676/1378] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:43:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:23.117807 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478df18-6dd2-4f85-9755-586980686f9d None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:23.132922 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478df18-6dd2-4f85-9755-586980686f9d None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:23.138582 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5690490-9abf-4fe7-8740-89405a07ba93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:23.139271 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5690490-9abf-4fe7-8740-89405a07ba93 service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:23.139556 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5690490-9abf-4fe7-8740-89405a07ba93 service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:23.139834 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5690490-9abf-4fe7-8740-89405a07ba93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:23.148320 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5690490-9abf-4fe7-8740-89405a07ba93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:23.149902 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5690490-9abf-4fe7-8740-89405a07ba93 service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:23.159408 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 703/1379] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:25.517196 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486e4d9-0b03-485a-b204-a5535bd020ca None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:25.518050 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486e4d9-0b03-485a-b204-a5535bd020ca None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:25.518499 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486e4d9-0b03-485a-b204-a5535bd020ca None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:25.520077 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 677/1380] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:25.525216 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d981924-fd78-4ec4-9374-37a095edaab2 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:25.525614 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d981924-fd78-4ec4-9374-37a095edaab2 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:25.525750 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d981924-fd78-4ec4-9374-37a095edaab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:25.543822 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-3d981924-fd78-4ec4-9374-37a095edaab2 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:25.545170 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3d981924-fd78-4ec4-9374-37a095edaab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:25.553042 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 704/1381] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:25.597935 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486e4d9-0b03-485a-b204-a5535bd020ca None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:25.612112 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486e4d9-0b03-485a-b204-a5535bd020ca None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:25.617751 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f773c-1c6e-4560-b80d-9d5ed9511691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:25.619231 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f773c-1c6e-4560-b80d-9d5ed9511691 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:25.619716 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f773c-1c6e-4560-b80d-9d5ed9511691 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:25.620164 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f773c-1c6e-4560-b80d-9d5ed9511691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:25.628679 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f773c-1c6e-4560-b80d-9d5ed9511691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:25.630977 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f773c-1c6e-4560-b80d-9d5ed9511691 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:25.641551 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 678/1382] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:27.958320 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6903be-5457-4ca5-90b6-e2f0a6f24179 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:27.958874 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6903be-5457-4ca5-90b6-e2f0a6f24179 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:27.958874 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6903be-5457-4ca5-90b6-e2f0a6f24179 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:27.960236 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 705/1383] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:27.966094 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38f67f-6e04-4a68-ad60-c33390629804 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:27.966513 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38f67f-6e04-4a68-ad60-c33390629804 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:27.966685 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38f67f-6e04-4a68-ad60-c33390629804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:27.985693 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9e38f67f-6e04-4a68-ad60-c33390629804 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:27.988258 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9e38f67f-6e04-4a68-ad60-c33390629804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:27.996979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 679/1384] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:28.044533 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6903be-5457-4ca5-90b6-e2f0a6f24179 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:28.059435 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6903be-5457-4ca5-90b6-e2f0a6f24179 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:28.065516 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a1b5e-4df2-4aa5-8096-db5d12d3dc6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:28.066513 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a1b5e-4df2-4aa5-8096-db5d12d3dc6f service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:28.067056 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a1b5e-4df2-4aa5-8096-db5d12d3dc6f service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:28.067606 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a1b5e-4df2-4aa5-8096-db5d12d3dc6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:28.077865 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a1b5e-4df2-4aa5-8096-db5d12d3dc6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:28.079844 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a1b5e-4df2-4aa5-8096-db5d12d3dc6f service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:28.101964 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 706/1385] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:30.435512 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcce5d-1310-4e27-9af7-35abd32c144b None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:30.436095 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcce5d-1310-4e27-9af7-35abd32c144b None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:30.436517 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcce5d-1310-4e27-9af7-35abd32c144b None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:30.439080 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 680/1386] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:43:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:30.444371 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f4e40-3f26-477c-89a5-1c1d31bf0c42 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:30.444781 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f4e40-3f26-477c-89a5-1c1d31bf0c42 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:30.444948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f4e40-3f26-477c-89a5-1c1d31bf0c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:30.464754 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-a10f4e40-3f26-477c-89a5-1c1d31bf0c42 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:30.465990 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a10f4e40-3f26-477c-89a5-1c1d31bf0c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:30.474334 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 707/1387] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:30.520656 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcce5d-1310-4e27-9af7-35abd32c144b None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:30.539834 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcce5d-1310-4e27-9af7-35abd32c144b None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:30.549053 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd1ac85-e888-42e1-8d48-6e708568091e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:30.550197 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1ac85-e888-42e1-8d48-6e708568091e service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:30.550768 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1ac85-e888-42e1-8d48-6e708568091e service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:30.551304 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1ac85-e888-42e1-8d48-6e708568091e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:30.565441 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1ac85-e888-42e1-8d48-6e708568091e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:30.568368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd1ac85-e888-42e1-8d48-6e708568091e service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:30.585880 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 681/1388] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:34.461935 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cae8f6-ea14-4326-87c2-8bee57752c6c None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:34.462472 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cae8f6-ea14-4326-87c2-8bee57752c6c None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:34.462608 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cae8f6-ea14-4326-87c2-8bee57752c6c None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:34.464076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 708/1389] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:34.471646 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb6b68-d279-43da-a90d-71ab65ae350d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:34.472426 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb6b68-d279-43da-a90d-71ab65ae350d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:34.472426 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb6b68-d279-43da-a90d-71ab65ae350d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:34.491673 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-89bb6b68-d279-43da-a90d-71ab65ae350d None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:34.493477 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-89bb6b68-d279-43da-a90d-71ab65ae350d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:34.501786 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 682/1390] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:34.550671 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cae8f6-ea14-4326-87c2-8bee57752c6c None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:34.572508 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cae8f6-ea14-4326-87c2-8bee57752c6c None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:34.578121 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd52794-0fc4-4bbd-9fa2-8eac8f8ff540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:34.578821 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd52794-0fc4-4bbd-9fa2-8eac8f8ff540 service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:34.579110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd52794-0fc4-4bbd-9fa2-8eac8f8ff540 service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:34.579403 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd52794-0fc4-4bbd-9fa2-8eac8f8ff540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:34.588255 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd52794-0fc4-4bbd-9fa2-8eac8f8ff540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:34.589910 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd52794-0fc4-4bbd-9fa2-8eac8f8ff540 service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:34.599612 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 709/1391] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:36.941084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70cedc-5abf-4290-af54-c1d7ad9b8f43 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:36.941665 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70cedc-5abf-4290-af54-c1d7ad9b8f43 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:36.941665 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70cedc-5abf-4290-af54-c1d7ad9b8f43 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:36.943310 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 683/1392] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:36.948442 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2b453-3515-4ada-a561-2df51cf23baf None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:36.948850 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2b453-3515-4ada-a561-2df51cf23baf None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:36.948984 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2b453-3515-4ada-a561-2df51cf23baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:36.967699 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-b8c2b453-3515-4ada-a561-2df51cf23baf None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:36.968871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b8c2b453-3515-4ada-a561-2df51cf23baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:36.976614 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 710/1393] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:37.021898 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70cedc-5abf-4290-af54-c1d7ad9b8f43 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:37.037163 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70cedc-5abf-4290-af54-c1d7ad9b8f43 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:37.042368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a341e-4993-45cd-b32c-0974e7df6be6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:37.043036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a341e-4993-45cd-b32c-0974e7df6be6 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:37.043321 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a341e-4993-45cd-b32c-0974e7df6be6 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:37.043594 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a341e-4993-45cd-b32c-0974e7df6be6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:37.051920 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a341e-4993-45cd-b32c-0974e7df6be6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:37.053484 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a341e-4993-45cd-b32c-0974e7df6be6 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:37.062230 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb198d-0ffd-41e5-9983-b4856f9fa0ba None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:37.062513 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb198d-0ffd-41e5-9983-b4856f9fa0ba None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:37.062818 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb198d-0ffd-41e5-9983-b4856f9fa0ba None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:37.063024 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 684/1394] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:43:37.064221 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 711/1395] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:43:37.069204 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882fc11-bfc7-4726-8d6b-881e72272c37 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:37.069486 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882fc11-bfc7-4726-8d6b-881e72272c37 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:37.069759 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c882fc11-bfc7-4726-8d6b-881e72272c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:37.088544 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c882fc11-bfc7-4726-8d6b-881e72272c37 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:37.089715 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c882fc11-bfc7-4726-8d6b-881e72272c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:37.097633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 685/1396] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:43:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:43:37.162138 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41874867-8ab0-4865-8c2d-c996c852b43a None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:37.162417 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41874867-8ab0-4865-8c2d-c996c852b43a None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:37.162744 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41874867-8ab0-4865-8c2d-c996c852b43a None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:37.164169 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 712/1397] 10.222.0.73 () {54 vars in 961 bytes} [Mon Apr 11 16:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:37.169724 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b61862-e367-41f2-a85f-8c53f186cafc None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:37.170099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b61862-e367-41f2-a85f-8c53f186cafc None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:37.170461 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b61862-e367-41f2-a85f-8c53f186cafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:37.229147 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a3b61862-e367-41f2-a85f-8c53f186cafc None None] MFA Rules not processed for user `92dc1464c4b24c6c8ea5dfcc796f0279`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:37.230268 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a3b61862-e367-41f2-a85f-8c53f186cafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:37.293171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 686/1398] 10.222.0.73 () {58 vars in 1058 bytes} [Mon Apr 11 16:43:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:37.301018 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41874867-8ab0-4865-8c2d-c996c852b43a None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:37.311662 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41874867-8ab0-4865-8c2d-c996c852b43a None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:37.315114 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9f41c-0581-4c26-9c54-0990b7680b56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92dc1464c4b24c6c8ea5dfcc796f0279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:37.315741 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9f41c-0581-4c26-9c54-0990b7680b56 service glance] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:37.316020 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9f41c-0581-4c26-9c54-0990b7680b56 service glance] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:37.316291 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9f41c-0581-4c26-9c54-0990b7680b56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:37.325505 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9f41c-0581-4c26-9c54-0990b7680b56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:37.326967 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9f41c-0581-4c26-9c54-0990b7680b56 service glance] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:37.336084 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 713/1399] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:37.754576 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cbe37-1904-49db-b320-a71a9e925220 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:37.754576 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cbe37-1904-49db-b320-a71a9e925220 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:37.754576 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8cbe37-1904-49db-b320-a71a9e925220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:37.801487 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-1e8cbe37-1904-49db-b320-a71a9e925220 None None] MFA Rules not processed for user `e0653575c0a24603bb9287e6222313de`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:37.802620 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1e8cbe37-1904-49db-b320-a71a9e925220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:37.863183 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 687/1400] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Apr 11 16:43:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:37.906661 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849e4f0-fa47-409b-942e-dca730d910ef None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:37.907051 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849e4f0-fa47-409b-942e-dca730d910ef None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:37.907296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849e4f0-fa47-409b-942e-dca730d910ef None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:37.908672 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 714/1401] 10.222.0.73 () {54 vars in 942 bytes} [Mon Apr 11 16:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:37.915378 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944616a-d641-48c9-a240-f8f5435449c3 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:37.915896 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944616a-d641-48c9-a240-f8f5435449c3 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:37.916440 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944616a-d641-48c9-a240-f8f5435449c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:37.979896 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6944616a-d641-48c9-a240-f8f5435449c3 None None] MFA Rules not processed for user `1f6659c6661840a79ba9ff1c3c9e93c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:37.981298 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6944616a-d641-48c9-a240-f8f5435449c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:38.051736 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 688/1402] 10.222.0.73 () {58 vars in 1039 bytes} [Mon Apr 11 16:43:37 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:38.061382 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849e4f0-fa47-409b-942e-dca730d910ef None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:38.074424 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849e4f0-fa47-409b-942e-dca730d910ef None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:38.079343 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f578a0-eb95-4c68-942e-2f3de19a643c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6659c6661840a79ba9ff1c3c9e93c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:38.079999 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f578a0-eb95-4c68-942e-2f3de19a643c service swift] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:38.080273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f578a0-eb95-4c68-942e-2f3de19a643c service swift] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:38.080564 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f578a0-eb95-4c68-942e-2f3de19a643c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:38.088525 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f578a0-eb95-4c68-942e-2f3de19a643c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:38.090086 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f578a0-eb95-4c68-942e-2f3de19a643c service swift] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:38.098229 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 715/1403] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Apr 11 16:43:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:43:39.422240 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cda1ce-1739-46dd-a171-420dd3b14663 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:39.422787 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cda1ce-1739-46dd-a171-420dd3b14663 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:39.422787 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cda1ce-1739-46dd-a171-420dd3b14663 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:39.424382 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 689/1404] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:39.429480 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f20015-ca1e-4b61-bebb-3c8f46bc3404 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:39.429950 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f20015-ca1e-4b61-bebb-3c8f46bc3404 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:39.430043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f20015-ca1e-4b61-bebb-3c8f46bc3404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:39.448104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-a6f20015-ca1e-4b61-bebb-3c8f46bc3404 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:39.449284 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a6f20015-ca1e-4b61-bebb-3c8f46bc3404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:39.457135 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 716/1405] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:39.504116 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cda1ce-1739-46dd-a171-420dd3b14663 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:39.521932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cda1ce-1739-46dd-a171-420dd3b14663 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:39.527725 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68304033-ec94-4896-ab26-08edcab1896a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:39.528368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68304033-ec94-4896-ab26-08edcab1896a service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:39.528652 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68304033-ec94-4896-ab26-08edcab1896a service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:39.528937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68304033-ec94-4896-ab26-08edcab1896a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:39.537283 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68304033-ec94-4896-ab26-08edcab1896a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:39.538897 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68304033-ec94-4896-ab26-08edcab1896a service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:39.553895 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 690/1406] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:43:41.949502 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e623f6-9e80-4d4f-9650-211604a408f3 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:41.949939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e623f6-9e80-4d4f-9650-211604a408f3 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:41.950034 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e623f6-9e80-4d4f-9650-211604a408f3 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:41.951421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 717/1407] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:43:41.956507 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b7cfb-cabd-43aa-b634-2c4dcc400e5a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:41.957341 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b7cfb-cabd-43aa-b634-2c4dcc400e5a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:41.957630 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b7cfb-cabd-43aa-b634-2c4dcc400e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:41.979487 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-157b7cfb-cabd-43aa-b634-2c4dcc400e5a None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:43:41.980809 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-157b7cfb-cabd-43aa-b634-2c4dcc400e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:43:41.996204 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 691/1408] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:43:42.042707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e623f6-9e80-4d4f-9650-211604a408f3 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:43:42.058149 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e623f6-9e80-4d4f-9650-211604a408f3 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:43:42.064149 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf449bf-ba4e-4866-8ab9-f45481b86523 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:43:42.064787 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf449bf-ba4e-4866-8ab9-f45481b86523 service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:43:42.065069 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf449bf-ba4e-4866-8ab9-f45481b86523 service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:43:42.065452 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf449bf-ba4e-4866-8ab9-f45481b86523 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:43:42.073993 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf449bf-ba4e-4866-8ab9-f45481b86523 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:43:42.075748 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf449bf-ba4e-4866-8ab9-f45481b86523 service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:43:42.086187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 718/1409] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:43:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:01.214874 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d150898-5e6a-49f7-8ee6-80412ff18409 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:01.215871 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d150898-5e6a-49f7-8ee6-80412ff18409 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:01.215871 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d150898-5e6a-49f7-8ee6-80412ff18409 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:01.216725 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 692/1410] 10.222.0.73 () {54 vars in 918 bytes} [Mon Apr 11 16:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:01.221796 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7157eb-da58-4477-a4b9-bb452b13ccb9 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:01.222280 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7157eb-da58-4477-a4b9-bb452b13ccb9 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:01.222392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7157eb-da58-4477-a4b9-bb452b13ccb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:01.240199 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-9b7157eb-da58-4477-a4b9-bb452b13ccb9 None None] MFA Rules not processed for user `85f5ef8708f54401af7e8defa8d13141`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:01.241365 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9b7157eb-da58-4477-a4b9-bb452b13ccb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:01.250517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 719/1411] 10.222.0.73 () {58 vars in 1015 bytes} [Mon Apr 11 16:44:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:01.265144 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095519b-2e2a-468c-9257-4fb013d78947 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:01.265548 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095519b-2e2a-468c-9257-4fb013d78947 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:01.265896 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8095519b-2e2a-468c-9257-4fb013d78947 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:01.267753 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 693/1412] 10.222.0.73 () {54 vars in 918 bytes} [Mon Apr 11 16:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:01.272454 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1f5a4-bbae-41e6-af44-1ae7ea226d3b None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:01.272745 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1f5a4-bbae-41e6-af44-1ae7ea226d3b None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:01.273024 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1f5a4-bbae-41e6-af44-1ae7ea226d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:01.290765 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-7ec1f5a4-bbae-41e6-af44-1ae7ea226d3b None None] MFA Rules not processed for user `ba3665d046864985916fdd6c4a4edcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:01.291939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-7ec1f5a4-bbae-41e6-af44-1ae7ea226d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:01.300911 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 720/1413] 10.222.0.73 () {58 vars in 1015 bytes} [Mon Apr 11 16:44:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:44:04.093941 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacdbd8-d697-48b1-aa8b-555d01d59028 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:04.094552 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacdbd8-d697-48b1-aa8b-555d01d59028 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:04.094552 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cacdbd8-d697-48b1-aa8b-555d01d59028 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:04.095865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 694/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:04.101009 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1537886-9eb9-4b0d-ab28-6d5113d52dc6 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:04.102041 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1537886-9eb9-4b0d-ab28-6d5113d52dc6 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:04.102041 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1537886-9eb9-4b0d-ab28-6d5113d52dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:04.120355 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-e1537886-9eb9-4b0d-ab28-6d5113d52dc6 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:04.121532 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-e1537886-9eb9-4b0d-ab28-6d5113d52dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:04.129649 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 721/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:44:04.173189 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacdbd8-d697-48b1-aa8b-555d01d59028 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:04.187546 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cacdbd8-d697-48b1-aa8b-555d01d59028 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:04.192734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf4a7b-1fc5-4456-a538-71076ce0cc9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:04.193410 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf4a7b-1fc5-4456-a538-71076ce0cc9c service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:04.193629 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf4a7b-1fc5-4456-a538-71076ce0cc9c service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:04.193899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf4a7b-1fc5-4456-a538-71076ce0cc9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:04.201787 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf4a7b-1fc5-4456-a538-71076ce0cc9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:04.203366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf4a7b-1fc5-4456-a538-71076ce0cc9c service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:04.212312 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 695/1416] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:05.564355 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f744c-570c-4076-b237-765f62d1d2e7 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:05.564928 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f744c-570c-4076-b237-765f62d1d2e7 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:05.564928 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f744c-570c-4076-b237-765f62d1d2e7 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:05.566298 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 722/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:05.571892 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119906f-e7ef-4909-8f07-363e1457ae7e None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:05.572301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119906f-e7ef-4909-8f07-363e1457ae7e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:05.572421 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119906f-e7ef-4909-8f07-363e1457ae7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:05.591399 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-1119906f-e7ef-4909-8f07-363e1457ae7e None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:05.592584 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1119906f-e7ef-4909-8f07-363e1457ae7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:05.600243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 696/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:05.770405 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f744c-570c-4076-b237-765f62d1d2e7 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:05.784721 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f744c-570c-4076-b237-765f62d1d2e7 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:05.790039 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf37148-b4ff-44f4-a9ad-e96ff0a8e6d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:05.790702 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf37148-b4ff-44f4-a9ad-e96ff0a8e6d9 service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:05.790983 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf37148-b4ff-44f4-a9ad-e96ff0a8e6d9 service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:05.791256 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf37148-b4ff-44f4-a9ad-e96ff0a8e6d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:05.799043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf37148-b4ff-44f4-a9ad-e96ff0a8e6d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:05.800609 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf37148-b4ff-44f4-a9ad-e96ff0a8e6d9 service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:05.809535 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 723/1419] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:07.116053 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581710e-93c1-4d80-b019-a29de1dca3cd None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:07.116588 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581710e-93c1-4d80-b019-a29de1dca3cd None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:07.116708 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8581710e-93c1-4d80-b019-a29de1dca3cd None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:07.118003 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 697/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:07.123081 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697b1eb-a077-41a2-aa05-49a311f8c126 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:07.123486 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697b1eb-a077-41a2-aa05-49a311f8c126 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:07.123656 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7697b1eb-a077-41a2-aa05-49a311f8c126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:07.141739 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-7697b1eb-a077-41a2-aa05-49a311f8c126 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:07.142941 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-7697b1eb-a077-41a2-aa05-49a311f8c126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:07.151147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 724/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:07.299180 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581710e-93c1-4d80-b019-a29de1dca3cd None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:07.313058 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8581710e-93c1-4d80-b019-a29de1dca3cd None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:07.318636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc980d9-2984-4a2d-9924-512282d0d9aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:07.319273 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc980d9-2984-4a2d-9924-512282d0d9aa service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:07.319562 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc980d9-2984-4a2d-9924-512282d0d9aa service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:07.319835 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc980d9-2984-4a2d-9924-512282d0d9aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:07.328555 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc980d9-2984-4a2d-9924-512282d0d9aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:07.330124 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc980d9-2984-4a2d-9924-512282d0d9aa service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:07.340266 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 698/1422] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:08.630368 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed434f13-c233-4b8e-a8fe-02fa7f196a28 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:08.630930 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed434f13-c233-4b8e-a8fe-02fa7f196a28 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:08.630930 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed434f13-c233-4b8e-a8fe-02fa7f196a28 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:08.632315 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 725/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:08.637944 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c104a9e-1c43-4ba5-8813-04293fea8dd2 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:08.638701 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c104a9e-1c43-4ba5-8813-04293fea8dd2 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:08.638811 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c104a9e-1c43-4ba5-8813-04293fea8dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:08.656729 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-1c104a9e-1c43-4ba5-8813-04293fea8dd2 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:08.657894 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1c104a9e-1c43-4ba5-8813-04293fea8dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:08.665957 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 699/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:08.814296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed434f13-c233-4b8e-a8fe-02fa7f196a28 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:08.828675 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed434f13-c233-4b8e-a8fe-02fa7f196a28 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:08.833933 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccda47-c51f-4050-8473-90db01bd242d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:08.834556 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccda47-c51f-4050-8473-90db01bd242d service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:08.834866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccda47-c51f-4050-8473-90db01bd242d service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:08.835139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccda47-c51f-4050-8473-90db01bd242d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:08.843603 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccda47-c51f-4050-8473-90db01bd242d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:08.845189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccda47-c51f-4050-8473-90db01bd242d service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:08.854802 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 726/1425] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:10.145989 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a55f96-f3ce-4406-8da6-1bae2bd2f6ef None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:10.146581 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a55f96-f3ce-4406-8da6-1bae2bd2f6ef None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:10.146581 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a55f96-f3ce-4406-8da6-1bae2bd2f6ef None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:10.148051 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 700/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:10.153225 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f794-cbfa-4edf-8ea1-cb29b0cf7a4f None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:10.153652 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f794-cbfa-4edf-8ea1-cb29b0cf7a4f None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:10.153781 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f794-cbfa-4edf-8ea1-cb29b0cf7a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:10.171915 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-2974f794-cbfa-4edf-8ea1-cb29b0cf7a4f None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:10.173116 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-2974f794-cbfa-4edf-8ea1-cb29b0cf7a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:10.181386 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 727/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:10.329208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a55f96-f3ce-4406-8da6-1bae2bd2f6ef None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:10.343135 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a55f96-f3ce-4406-8da6-1bae2bd2f6ef None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:10.348445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6be4c-a0ac-40b9-9425-f411fb125569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:10.349076 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6be4c-a0ac-40b9-9425-f411fb125569 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:10.349359 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6be4c-a0ac-40b9-9425-f411fb125569 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:10.349634 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6be4c-a0ac-40b9-9425-f411fb125569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:10.357993 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6be4c-a0ac-40b9-9425-f411fb125569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:10.359611 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6be4c-a0ac-40b9-9425-f411fb125569 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:10.369666 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 701/1428] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:11.608194 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be2f1e-24a9-47ac-8b2d-9c7e047c7474 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:11.608774 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be2f1e-24a9-47ac-8b2d-9c7e047c7474 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:11.608774 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be2f1e-24a9-47ac-8b2d-9c7e047c7474 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:11.610112 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 728/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:11.615242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364676d-381f-4201-ac15-ff15db0e74a0 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:11.615627 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364676d-381f-4201-ac15-ff15db0e74a0 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:11.615796 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364676d-381f-4201-ac15-ff15db0e74a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:11.633611 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6364676d-381f-4201-ac15-ff15db0e74a0 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:11.634822 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6364676d-381f-4201-ac15-ff15db0e74a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:11.642724 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 702/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:11.793397 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be2f1e-24a9-47ac-8b2d-9c7e047c7474 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:11.807340 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be2f1e-24a9-47ac-8b2d-9c7e047c7474 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:11.812595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa7700-4617-4f15-bfa8-540af3624590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:11.813217 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa7700-4617-4f15-bfa8-540af3624590 service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:11.813497 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa7700-4617-4f15-bfa8-540af3624590 service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:11.813770 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa7700-4617-4f15-bfa8-540af3624590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:11.821996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa7700-4617-4f15-bfa8-540af3624590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:11.823609 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa7700-4617-4f15-bfa8-540af3624590 service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:11.832567 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 729/1431] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:13.074572 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27b6d3-81ee-41be-be8c-f38a4aa9afd4 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:13.075146 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27b6d3-81ee-41be-be8c-f38a4aa9afd4 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:13.075146 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa27b6d3-81ee-41be-be8c-f38a4aa9afd4 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:13.076539 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 703/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:13.081655 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d611aaf-ee60-4f82-bea8-2f6d373080c1 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:13.082079 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d611aaf-ee60-4f82-bea8-2f6d373080c1 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:13.082186 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d611aaf-ee60-4f82-bea8-2f6d373080c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:13.100472 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-7d611aaf-ee60-4f82-bea8-2f6d373080c1 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:13.101683 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-7d611aaf-ee60-4f82-bea8-2f6d373080c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:13.109499 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 730/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:13.258530 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27b6d3-81ee-41be-be8c-f38a4aa9afd4 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:13.272728 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa27b6d3-81ee-41be-be8c-f38a4aa9afd4 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:13.278744 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4ab43-4bd1-4365-ba0e-0b477312a497 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:13.279376 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4ab43-4bd1-4365-ba0e-0b477312a497 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:13.279658 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4ab43-4bd1-4365-ba0e-0b477312a497 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:13.279934 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4ab43-4bd1-4365-ba0e-0b477312a497 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:13.288003 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4ab43-4bd1-4365-ba0e-0b477312a497 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:13.289619 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4ab43-4bd1-4365-ba0e-0b477312a497 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:13.298953 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 704/1434] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:14.545042 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68083b-576d-4b1d-8073-147758530577 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:14.545559 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68083b-576d-4b1d-8073-147758530577 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:14.545652 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68083b-576d-4b1d-8073-147758530577 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:14.547046 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 731/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:14.552052 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e02af1-6b3b-4761-ae90-104abb4a58e6 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:14.552504 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e02af1-6b3b-4761-ae90-104abb4a58e6 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:14.552614 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e02af1-6b3b-4761-ae90-104abb4a58e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:14.570530 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-28e02af1-6b3b-4761-ae90-104abb4a58e6 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:14.571745 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-28e02af1-6b3b-4761-ae90-104abb4a58e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:14.579991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 705/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:14.729448 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68083b-576d-4b1d-8073-147758530577 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:14.743989 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68083b-576d-4b1d-8073-147758530577 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:14.749285 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef59398-bf8c-4e91-b9bf-cf6f31f447c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:14.749911 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef59398-bf8c-4e91-b9bf-cf6f31f447c0 service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:14.750192 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef59398-bf8c-4e91-b9bf-cf6f31f447c0 service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:14.750465 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef59398-bf8c-4e91-b9bf-cf6f31f447c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:14.758284 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef59398-bf8c-4e91-b9bf-cf6f31f447c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:14.759893 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef59398-bf8c-4e91-b9bf-cf6f31f447c0 service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:14.769158 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 732/1437] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:16.007495 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ea3d1-ee36-494a-ac36-8e816ef73d89 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:16.008620 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ea3d1-ee36-494a-ac36-8e816ef73d89 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:16.008730 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ea3d1-ee36-494a-ac36-8e816ef73d89 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:16.010062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 706/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:44:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:16.015424 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b1c2c-2d30-44e9-b4f9-df2ea9033c46 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:16.015852 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b1c2c-2d30-44e9-b4f9-df2ea9033c46 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:16.015972 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b1c2c-2d30-44e9-b4f9-df2ea9033c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:16.033417 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-891b1c2c-2d30-44e9-b4f9-df2ea9033c46 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:16.034585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-891b1c2c-2d30-44e9-b4f9-df2ea9033c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:16.042759 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 733/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:16.190508 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ea3d1-ee36-494a-ac36-8e816ef73d89 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:16.204306 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ea3d1-ee36-494a-ac36-8e816ef73d89 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:16.209446 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41fb01-6c4b-491e-863b-1edfd3214a40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:16.210065 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41fb01-6c4b-491e-863b-1edfd3214a40 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:16.210342 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41fb01-6c4b-491e-863b-1edfd3214a40 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:16.210660 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41fb01-6c4b-491e-863b-1edfd3214a40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:16.218337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41fb01-6c4b-491e-863b-1edfd3214a40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:16.219925 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41fb01-6c4b-491e-863b-1edfd3214a40 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:16.229610 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 707/1440] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:18.404078 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d6f77-3a12-43af-b41c-06299921a5d0 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:18.404595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d6f77-3a12-43af-b41c-06299921a5d0 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:18.404712 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5d6f77-3a12-43af-b41c-06299921a5d0 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:18.405997 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 734/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:18.411238 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4c707-2cf5-41f5-92bb-52ae4dbe6d11 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:18.411648 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4c707-2cf5-41f5-92bb-52ae4dbe6d11 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:18.411786 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4c707-2cf5-41f5-92bb-52ae4dbe6d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:18.428832 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-e7a4c707-2cf5-41f5-92bb-52ae4dbe6d11 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:18.430045 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e7a4c707-2cf5-41f5-92bb-52ae4dbe6d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:18.437762 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 708/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:18.477179 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d6f77-3a12-43af-b41c-06299921a5d0 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:18.487599 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5d6f77-3a12-43af-b41c-06299921a5d0 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:18.491122 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081edaef-7161-4c3b-b87c-04ad0e1b8bac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:18.491751 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081edaef-7161-4c3b-b87c-04ad0e1b8bac service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:18.492120 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081edaef-7161-4c3b-b87c-04ad0e1b8bac service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:18.492400 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081edaef-7161-4c3b-b87c-04ad0e1b8bac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:18.501016 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081edaef-7161-4c3b-b87c-04ad0e1b8bac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:18.502438 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081edaef-7161-4c3b-b87c-04ad0e1b8bac service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:18.512108 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 735/1443] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:20.943126 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10163083-664e-430f-a42c-a2f96ce89dc4 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:20.943496 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10163083-664e-430f-a42c-a2f96ce89dc4 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:20.943496 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10163083-664e-430f-a42c-a2f96ce89dc4 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:20.944784 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 709/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:20.950719 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccb9f3-dbdc-4097-9f02-7e71f27f2bfa None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:20.951126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccb9f3-dbdc-4097-9f02-7e71f27f2bfa None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:20.955324 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccb9f3-dbdc-4097-9f02-7e71f27f2bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:20.972500 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-66ccb9f3-dbdc-4097-9f02-7e71f27f2bfa None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:20.973674 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-66ccb9f3-dbdc-4097-9f02-7e71f27f2bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:20.981357 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 736/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:21.020557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10163083-664e-430f-a42c-a2f96ce89dc4 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:21.031028 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10163083-664e-430f-a42c-a2f96ce89dc4 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:21.034420 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9729c69-3911-4494-b25c-040ca13c71af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:21.035073 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9729c69-3911-4494-b25c-040ca13c71af service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:21.035355 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9729c69-3911-4494-b25c-040ca13c71af service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:21.035620 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9729c69-3911-4494-b25c-040ca13c71af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:21.044192 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9729c69-3911-4494-b25c-040ca13c71af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:21.045591 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9729c69-3911-4494-b25c-040ca13c71af service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:21.055119 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 710/1446] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:23.639084 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01feb04-8971-43db-adda-bf6ddfa6f52b None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:23.639709 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01feb04-8971-43db-adda-bf6ddfa6f52b None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:23.639709 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01feb04-8971-43db-adda-bf6ddfa6f52b None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:23.640997 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 737/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:23.646483 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f89189-c0e3-42cb-aff2-f993599bb4e3 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:23.647311 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f89189-c0e3-42cb-aff2-f993599bb4e3 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:23.647602 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f89189-c0e3-42cb-aff2-f993599bb4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:23.665189 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-60f89189-c0e3-42cb-aff2-f993599bb4e3 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:23.666358 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-60f89189-c0e3-42cb-aff2-f993599bb4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:23.674015 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 711/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:23.713217 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01feb04-8971-43db-adda-bf6ddfa6f52b None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:23.723507 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01feb04-8971-43db-adda-bf6ddfa6f52b None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:23.727403 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a34cba-a865-42e7-97c6-da5d74f1335c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:23.728020 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a34cba-a865-42e7-97c6-da5d74f1335c service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:23.728293 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a34cba-a865-42e7-97c6-da5d74f1335c service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:23.728561 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a34cba-a865-42e7-97c6-da5d74f1335c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:23.736985 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a34cba-a865-42e7-97c6-da5d74f1335c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:23.738394 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a34cba-a865-42e7-97c6-da5d74f1335c service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:23.747947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 738/1449] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:26.147525 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ff49e-88bd-4169-822e-88f61b248ffb None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:26.148646 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ff49e-88bd-4169-822e-88f61b248ffb None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:26.148757 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ff49e-88bd-4169-822e-88f61b248ffb None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:26.150033 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 712/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:44:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:26.155328 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c6433-7e56-48a1-aa5a-1c4a88848981 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:26.155741 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c6433-7e56-48a1-aa5a-1c4a88848981 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:26.155857 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c6433-7e56-48a1-aa5a-1c4a88848981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:26.172781 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-114c6433-7e56-48a1-aa5a-1c4a88848981 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:26.173933 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-114c6433-7e56-48a1-aa5a-1c4a88848981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:26.182018 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 739/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:26.221226 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ff49e-88bd-4169-822e-88f61b248ffb None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:26.231730 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ff49e-88bd-4169-822e-88f61b248ffb None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:26.235154 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65df93b5-1d3f-415e-af74-4006bc16cf20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:26.235851 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df93b5-1d3f-415e-af74-4006bc16cf20 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:26.236137 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df93b5-1d3f-415e-af74-4006bc16cf20 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:26.236407 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65df93b5-1d3f-415e-af74-4006bc16cf20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:26.245436 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df93b5-1d3f-415e-af74-4006bc16cf20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:26.246887 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65df93b5-1d3f-415e-af74-4006bc16cf20 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:26.255873 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 713/1452] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:28.578610 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75972202-805d-409c-89d0-493a114d4980 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:28.579175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75972202-805d-409c-89d0-493a114d4980 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:28.579175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75972202-805d-409c-89d0-493a114d4980 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:28.580539 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 740/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:28.586331 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30cf42-10ba-4ced-b89e-56ac9be0a1a8 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:28.586760 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30cf42-10ba-4ced-b89e-56ac9be0a1a8 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:28.586907 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d30cf42-10ba-4ced-b89e-56ac9be0a1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:28.604843 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-1d30cf42-10ba-4ced-b89e-56ac9be0a1a8 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:28.606019 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1d30cf42-10ba-4ced-b89e-56ac9be0a1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:28.613676 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 714/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:28.652520 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75972202-805d-409c-89d0-493a114d4980 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:28.663016 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75972202-805d-409c-89d0-493a114d4980 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:28.667131 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e68c4-6858-40d7-8c5a-66f8c51ec31e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:28.667754 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e68c4-6858-40d7-8c5a-66f8c51ec31e service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:28.668033 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e68c4-6858-40d7-8c5a-66f8c51ec31e service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:28.668303 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e68c4-6858-40d7-8c5a-66f8c51ec31e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:28.676836 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e68c4-6858-40d7-8c5a-66f8c51ec31e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:28.678248 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e68c4-6858-40d7-8c5a-66f8c51ec31e service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:28.687423 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 741/1455] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:31.017141 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878be46-2213-4df0-98a5-02922554047b None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:31.017677 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878be46-2213-4df0-98a5-02922554047b None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:31.017677 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878be46-2213-4df0-98a5-02922554047b None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:31.019094 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 715/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:31.024327 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a132000-0c4d-444f-8b04-ebdc8d7c4fca None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:31.024760 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a132000-0c4d-444f-8b04-ebdc8d7c4fca None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:31.024875 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a132000-0c4d-444f-8b04-ebdc8d7c4fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:31.042296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-3a132000-0c4d-444f-8b04-ebdc8d7c4fca None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:31.043505 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3a132000-0c4d-444f-8b04-ebdc8d7c4fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:31.051067 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 742/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:44:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:31.089157 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878be46-2213-4df0-98a5-02922554047b None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:31.099636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878be46-2213-4df0-98a5-02922554047b None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:31.103703 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306c68d-59db-4f1d-a731-9e8eec50d541 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:31.104326 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306c68d-59db-4f1d-a731-9e8eec50d541 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:31.104602 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306c68d-59db-4f1d-a731-9e8eec50d541 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:31.104874 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306c68d-59db-4f1d-a731-9e8eec50d541 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:31.113468 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306c68d-59db-4f1d-a731-9e8eec50d541 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:31.114909 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306c68d-59db-4f1d-a731-9e8eec50d541 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:31.124493 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 716/1458] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:33.471391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69556a4-df6b-441f-b5e3-1e875ea705e5 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:33.471930 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69556a4-df6b-441f-b5e3-1e875ea705e5 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:33.472048 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69556a4-df6b-441f-b5e3-1e875ea705e5 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:33.473359 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 743/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:44:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:33.479322 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ca169-b2c6-40cb-8234-5180568d9759 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:33.479753 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ca169-b2c6-40cb-8234-5180568d9759 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:33.479876 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ca169-b2c6-40cb-8234-5180568d9759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:33.497746 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-767ca169-b2c6-40cb-8234-5180568d9759 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:33.499013 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-767ca169-b2c6-40cb-8234-5180568d9759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:33.506852 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 717/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:33.545764 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69556a4-df6b-441f-b5e3-1e875ea705e5 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:33.556970 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69556a4-df6b-441f-b5e3-1e875ea705e5 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:33.560422 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349b342-9c20-4779-ab9a-46552235e6f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:33.561045 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349b342-9c20-4779-ab9a-46552235e6f4 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:33.561326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349b342-9c20-4779-ab9a-46552235e6f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:33.561604 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349b342-9c20-4779-ab9a-46552235e6f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:33.570153 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349b342-9c20-4779-ab9a-46552235e6f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:33.571587 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349b342-9c20-4779-ab9a-46552235e6f4 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:33.580558 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 744/1461] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:35.915331 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e821c-8364-48a1-aab0-7a6caf931a04 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:35.915876 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e821c-8364-48a1-aab0-7a6caf931a04 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:35.915876 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e821c-8364-48a1-aab0-7a6caf931a04 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:35.917269 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 718/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:44:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:35.922492 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908fb1a-6e15-4d21-b481-9eb37425bf1d None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:35.922947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908fb1a-6e15-4d21-b481-9eb37425bf1d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:35.923075 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5908fb1a-6e15-4d21-b481-9eb37425bf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:35.941591 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-5908fb1a-6e15-4d21-b481-9eb37425bf1d None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:35.943052 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-5908fb1a-6e15-4d21-b481-9eb37425bf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:35.950807 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 745/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:35.989599 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e821c-8364-48a1-aab0-7a6caf931a04 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:36.000137 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e821c-8364-48a1-aab0-7a6caf931a04 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:36.003587 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d161765-b10a-4c2a-b9a0-ba53845a458d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:36.004217 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d161765-b10a-4c2a-b9a0-ba53845a458d service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:36.004502 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d161765-b10a-4c2a-b9a0-ba53845a458d service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:36.004776 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d161765-b10a-4c2a-b9a0-ba53845a458d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:36.013897 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d161765-b10a-4c2a-b9a0-ba53845a458d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:36.015382 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d161765-b10a-4c2a-b9a0-ba53845a458d service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:36.024926 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 719/1464] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:38.333044 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eb9ed-ce3c-4482-bd44-43f664b28e64 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:38.333623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eb9ed-ce3c-4482-bd44-43f664b28e64 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:38.333623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1eb9ed-ce3c-4482-bd44-43f664b28e64 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:38.334997 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 746/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:38.340261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40084f-9c71-44cb-8521-d9fdbd579e7e None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:38.340696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40084f-9c71-44cb-8521-d9fdbd579e7e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:38.340872 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40084f-9c71-44cb-8521-d9fdbd579e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:38.358137 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ae40084f-9c71-44cb-8521-d9fdbd579e7e None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:38.359336 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ae40084f-9c71-44cb-8521-d9fdbd579e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:38.367595 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 720/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:38.405246 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1eb9ed-ce3c-4482-bd44-43f664b28e64 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:38.415549 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1eb9ed-ce3c-4482-bd44-43f664b28e64 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:38.418931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fb73d-7922-4403-b903-0c9081f4a9c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:38.419548 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fb73d-7922-4403-b903-0c9081f4a9c1 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:38.419823 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fb73d-7922-4403-b903-0c9081f4a9c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:38.420115 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fb73d-7922-4403-b903-0c9081f4a9c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:38.429481 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fb73d-7922-4403-b903-0c9081f4a9c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:38.430924 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fb73d-7922-4403-b903-0c9081f4a9c1 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:38.440308 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 747/1467] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:44:40.743983 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde7d5d-4a25-43bd-adc4-01942487e647 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:40.744552 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde7d5d-4a25-43bd-adc4-01942487e647 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:40.744552 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfde7d5d-4a25-43bd-adc4-01942487e647 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:40.745895 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 721/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:44:40.751160 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2350c-cbd1-4608-8cc7-cbf5c87d506b None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:40.751586 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2350c-cbd1-4608-8cc7-cbf5c87d506b None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:40.751749 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2350c-cbd1-4608-8cc7-cbf5c87d506b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:40.768976 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-56b2350c-cbd1-4608-8cc7-cbf5c87d506b None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:44:40.770134 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-56b2350c-cbd1-4608-8cc7-cbf5c87d506b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:44:40.778289 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 748/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:44:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:44:40.815371 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde7d5d-4a25-43bd-adc4-01942487e647 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:44:40.826437 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfde7d5d-4a25-43bd-adc4-01942487e647 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:44:40.829823 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8e8e0-64a3-4838-a242-607bce62507e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:44:40.830450 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8e8e0-64a3-4838-a242-607bce62507e service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:44:40.830768 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8e8e0-64a3-4838-a242-607bce62507e service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:44:40.831040 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8e8e0-64a3-4838-a242-607bce62507e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:44:40.840054 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8e8e0-64a3-4838-a242-607bce62507e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:44:40.841467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8e8e0-64a3-4838-a242-607bce62507e service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:44:40.850345 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 722/1470] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:44:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:45:14.316665 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b7afe-aa06-4fda-8c58-231e5d02a4a1 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:14.317255 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b7afe-aa06-4fda-8c58-231e5d02a4a1 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:14.317255 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523b7afe-aa06-4fda-8c58-231e5d02a4a1 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:14.319409 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 749/1471] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:45:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:45:14.324828 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085745b-71e9-4752-a053-98f4037dd1b6 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:14.325213 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085745b-71e9-4752-a053-98f4037dd1b6 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:14.325383 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085745b-71e9-4752-a053-98f4037dd1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:14.342289 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6085745b-71e9-4752-a053-98f4037dd1b6 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:14.343486 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6085745b-71e9-4752-a053-98f4037dd1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:14.351143 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 723/1472] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:14.397882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad2546-f9cf-4c67-be28-91a864a3f77d None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:14.398171 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad2546-f9cf-4c67-be28-91a864a3f77d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:14.398443 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad2546-f9cf-4c67-be28-91a864a3f77d None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:14.399950 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 750/1473] 10.222.0.73 () {54 vars in 961 bytes} [Mon Apr 11 16:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:45:14.404515 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0d597-1742-4d3b-b4f6-45414252ae63 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:14.404802 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0d597-1742-4d3b-b4f6-45414252ae63 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:14.405076 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0d597-1742-4d3b-b4f6-45414252ae63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:14.422169 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c9c0d597-1742-4d3b-b4f6-45414252ae63 None None] MFA Rules not processed for user `92dc1464c4b24c6c8ea5dfcc796f0279`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:14.423293 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c9c0d597-1742-4d3b-b4f6-45414252ae63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:14.430010 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 724/1474] 10.222.0.73 () {58 vars in 1058 bytes} [Mon Apr 11 16:45:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:14.436869 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad2546-f9cf-4c67-be28-91a864a3f77d None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:14.447609 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad2546-f9cf-4c67-be28-91a864a3f77d None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:14.451058 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb8c33-fbda-4be4-b35c-0a109609ffcd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92dc1464c4b24c6c8ea5dfcc796f0279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:14.451674 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb8c33-fbda-4be4-b35c-0a109609ffcd service glance] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:14.451952 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb8c33-fbda-4be4-b35c-0a109609ffcd service glance] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:14.452225 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb8c33-fbda-4be4-b35c-0a109609ffcd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:14.460696 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb8c33-fbda-4be4-b35c-0a109609ffcd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:14.462107 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb8c33-fbda-4be4-b35c-0a109609ffcd service glance] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:14.471070 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 751/1475] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:45:16.861384 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c3d85-ed92-450f-bac4-474c0c8f509d None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:16.861960 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c3d85-ed92-450f-bac4-474c0c8f509d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:16.861960 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c3d85-ed92-450f-bac4-474c0c8f509d None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:16.863386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 725/1476] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:45:16.869177 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed92550-e52f-4c97-85eb-a3cbffea275f None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:16.869623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed92550-e52f-4c97-85eb-a3cbffea275f None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:16.869744 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed92550-e52f-4c97-85eb-a3cbffea275f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:16.886629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-3ed92550-e52f-4c97-85eb-a3cbffea275f None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:16.887794 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3ed92550-e52f-4c97-85eb-a3cbffea275f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:16.895537 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 752/1477] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:16.919221 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c3d85-ed92-450f-bac4-474c0c8f509d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:16.932568 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c3d85-ed92-450f-bac4-474c0c8f509d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:16.936955 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2cb429-e0e4-4bce-93c5-1f1ac9e95db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:16.937604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cb429-e0e4-4bce-93c5-1f1ac9e95db9 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:16.937888 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cb429-e0e4-4bce-93c5-1f1ac9e95db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:16.938163 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2cb429-e0e4-4bce-93c5-1f1ac9e95db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:16.938929 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cb429-e0e4-4bce-93c5-1f1ac9e95db9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:16.940636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING py.warnings [None req-cf2cb429-e0e4-4bce-93c5-1f1ac9e95db9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:45:16.940636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: warnings.warn(msg) Apr 11 16:45:16.940636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: Apr 11 16:45:16.941791 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2cb429-e0e4-4bce-93c5-1f1ac9e95db9 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:16.960932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 726/1478] 10.222.0.73 () {56 vars in 1108 bytes} [Mon Apr 11 16:45:16 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:45:19.270666 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bf77b-3ac5-4203-8f7e-8a5dd861c467 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:19.271198 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bf77b-3ac5-4203-8f7e-8a5dd861c467 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:19.271198 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bf77b-3ac5-4203-8f7e-8a5dd861c467 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:19.272590 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 753/1479] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:45:19.277727 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419e229-76ef-4269-bc86-db6803867995 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:19.278171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419e229-76ef-4269-bc86-db6803867995 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:19.278315 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419e229-76ef-4269-bc86-db6803867995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:19.297158 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f419e229-76ef-4269-bc86-db6803867995 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:19.298329 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f419e229-76ef-4269-bc86-db6803867995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:19.306562 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 727/1480] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:45:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:19.347447 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bf77b-3ac5-4203-8f7e-8a5dd861c467 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:19.361872 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bf77b-3ac5-4203-8f7e-8a5dd861c467 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:19.367737 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36433a0d-36e9-408c-82ec-6ec914d83c2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:19.368363 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36433a0d-36e9-408c-82ec-6ec914d83c2f service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:19.368641 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36433a0d-36e9-408c-82ec-6ec914d83c2f service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:19.368914 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36433a0d-36e9-408c-82ec-6ec914d83c2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:19.376708 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36433a0d-36e9-408c-82ec-6ec914d83c2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:19.378274 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36433a0d-36e9-408c-82ec-6ec914d83c2f service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:19.387405 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 754/1481] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:45:21.854569 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d53c63-2824-49f4-9341-a29dd27b26fc None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:21.855141 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d53c63-2824-49f4-9341-a29dd27b26fc None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:21.855141 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d53c63-2824-49f4-9341-a29dd27b26fc None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:21.856551 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 728/1482] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:45:21.861978 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd835de-cbeb-480a-8087-3ab65051f60b None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:21.862386 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd835de-cbeb-480a-8087-3ab65051f60b None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:21.862534 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd835de-cbeb-480a-8087-3ab65051f60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:21.880180 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-4bd835de-cbeb-480a-8087-3ab65051f60b None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:21.881989 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4bd835de-cbeb-480a-8087-3ab65051f60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:21.890027 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 755/1483] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:21.925771 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d53c63-2824-49f4-9341-a29dd27b26fc None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:21.937595 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d53c63-2824-49f4-9341-a29dd27b26fc None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:21.941283 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2d974-70bc-40de-bc1e-9c91c4a821da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:21.941933 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2d974-70bc-40de-bc1e-9c91c4a821da service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:21.942345 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2d974-70bc-40de-bc1e-9c91c4a821da service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:21.943002 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2d974-70bc-40de-bc1e-9c91c4a821da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:21.952853 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2d974-70bc-40de-bc1e-9c91c4a821da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:21.954272 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2d974-70bc-40de-bc1e-9c91c4a821da service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:21.963643 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 729/1484] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:45:24.319871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a1e7b-9b6f-499f-9e3f-f37df71b0f6c None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:24.320443 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a1e7b-9b6f-499f-9e3f-f37df71b0f6c None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:24.320443 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a1e7b-9b6f-499f-9e3f-f37df71b0f6c None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:24.321815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 756/1485] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:45:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:45:24.327242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e7267-42f7-4f77-acb3-6897f7978045 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:24.327645 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e7267-42f7-4f77-acb3-6897f7978045 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:24.327797 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1e7267-42f7-4f77-acb3-6897f7978045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:24.345599 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ea1e7267-42f7-4f77-acb3-6897f7978045 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:24.346807 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ea1e7267-42f7-4f77-acb3-6897f7978045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:24.354478 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 730/1486] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:45:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:24.392100 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a1e7b-9b6f-499f-9e3f-f37df71b0f6c None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:24.403536 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a1e7b-9b6f-499f-9e3f-f37df71b0f6c None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:24.407024 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85169676-b16e-4565-bba9-cf2b3124a105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:24.407682 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85169676-b16e-4565-bba9-cf2b3124a105 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:24.407960 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85169676-b16e-4565-bba9-cf2b3124a105 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:24.408229 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85169676-b16e-4565-bba9-cf2b3124a105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:24.417021 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85169676-b16e-4565-bba9-cf2b3124a105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:24.418435 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85169676-b16e-4565-bba9-cf2b3124a105 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:24.427640 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 757/1487] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:45:26.901178 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba509c1f-02e9-42ef-9104-49663e5a32c7 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:26.901761 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba509c1f-02e9-42ef-9104-49663e5a32c7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:26.901761 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba509c1f-02e9-42ef-9104-49663e5a32c7 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:26.903123 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 731/1488] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:45:26.908475 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783537b3-fff8-4b24-be20-ccc28a620348 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:26.908911 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783537b3-fff8-4b24-be20-ccc28a620348 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:26.909028 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783537b3-fff8-4b24-be20-ccc28a620348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:26.926374 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-783537b3-fff8-4b24-be20-ccc28a620348 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:26.928097 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-783537b3-fff8-4b24-be20-ccc28a620348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:26.935844 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 758/1489] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:26.975915 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba509c1f-02e9-42ef-9104-49663e5a32c7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:26.986234 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba509c1f-02e9-42ef-9104-49663e5a32c7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:26.989809 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80adc8-b6fb-4414-a077-5f51f3be3e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:26.990969 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80adc8-b6fb-4414-a077-5f51f3be3e5e service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:26.991257 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80adc8-b6fb-4414-a077-5f51f3be3e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:26.991529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80adc8-b6fb-4414-a077-5f51f3be3e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:27.000415 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80adc8-b6fb-4414-a077-5f51f3be3e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:27.001831 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80adc8-b6fb-4414-a077-5f51f3be3e5e service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:27.011648 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 732/1490] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:45:29.467064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a78544-841e-4da1-8ab9-27c87ca397a4 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:29.467619 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a78544-841e-4da1-8ab9-27c87ca397a4 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:29.467619 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a78544-841e-4da1-8ab9-27c87ca397a4 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:29.468988 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 759/1491] 10.222.0.73 () {54 vars in 926 bytes} [Mon Apr 11 16:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:45:29.474234 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5cfdf-b1b4-49db-b22e-509b0a0ccf45 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:29.474694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5cfdf-b1b4-49db-b22e-509b0a0ccf45 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:29.474805 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5cfdf-b1b4-49db-b22e-509b0a0ccf45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:29.492318 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-94d5cfdf-b1b4-49db-b22e-509b0a0ccf45 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:45:29.493481 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-94d5cfdf-b1b4-49db-b22e-509b0a0ccf45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:45:29.501136 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 733/1492] 10.222.0.73 () {58 vars in 1023 bytes} [Mon Apr 11 16:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:45:29.540103 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a78544-841e-4da1-8ab9-27c87ca397a4 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:45:29.550434 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a78544-841e-4da1-8ab9-27c87ca397a4 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:45:29.554580 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7973ea6-9cef-4502-bfb3-c433cfcc80ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:45:29.555243 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7973ea6-9cef-4502-bfb3-c433cfcc80ba service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:45:29.555528 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7973ea6-9cef-4502-bfb3-c433cfcc80ba service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:45:29.555804 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7973ea6-9cef-4502-bfb3-c433cfcc80ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:45:29.564480 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7973ea6-9cef-4502-bfb3-c433cfcc80ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:45:29.565900 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7973ea6-9cef-4502-bfb3-c433cfcc80ba service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:45:29.575114 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 760/1493] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:45:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:46:58.622742 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143f318-a941-4777-8f44-f4c1266a45bd None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:58.623332 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143f318-a941-4777-8f44-f4c1266a45bd None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:58.623332 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6143f318-a941-4777-8f44-f4c1266a45bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:58.640656 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6143f318-a941-4777-8f44-f4c1266a45bd None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:58.641812 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6143f318-a941-4777-8f44-f4c1266a45bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:58.649891 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 734/1494] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:58.657832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee565758-de98-46a4-8d4d-e465d065fff5 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:58.658289 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee565758-de98-46a4-8d4d-e465d065fff5 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:58.658391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee565758-de98-46a4-8d4d-e465d065fff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:58.675885 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-ee565758-de98-46a4-8d4d-e465d065fff5 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:58.677041 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-ee565758-de98-46a4-8d4d-e465d065fff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:58.684641 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 761/1495] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:46:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:58.689008 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143f318-a941-4777-8f44-f4c1266a45bd None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:58.698143 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6143f318-a941-4777-8f44-f4c1266a45bd None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:58.702532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a53377-8ef5-4ad8-afdd-586ef2a2c278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:58.703202 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a53377-8ef5-4ad8-afdd-586ef2a2c278 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:58.703480 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a53377-8ef5-4ad8-afdd-586ef2a2c278 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:58.703750 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a53377-8ef5-4ad8-afdd-586ef2a2c278 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:58.704460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a53377-8ef5-4ad8-afdd-586ef2a2c278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:46:58.704761 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a53377-8ef5-4ad8-afdd-586ef2a2c278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:58.706264 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING py.warnings [None req-b4a53377-8ef5-4ad8-afdd-586ef2a2c278 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:46:58.706264 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: warnings.warn(msg) Apr 11 16:46:58.706264 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: Apr 11 16:46:58.707159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a53377-8ef5-4ad8-afdd-586ef2a2c278 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:58.718368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 735/1496] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:46:58.726858 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee565758-de98-46a4-8d4d-e465d065fff5 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:58.735702 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee565758-de98-46a4-8d4d-e465d065fff5 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:58.740271 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93b740-b448-4633-92c3-481bb26695d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:58.740854 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93b740-b448-4633-92c3-481bb26695d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:58.741133 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93b740-b448-4633-92c3-481bb26695d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:58.741407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93b740-b448-4633-92c3-481bb26695d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:58.742091 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93b740-b448-4633-92c3-481bb26695d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:58.743860 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING py.warnings [None req-2d93b740-b448-4633-92c3-481bb26695d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:46:58.743860 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: warnings.warn(msg) Apr 11 16:46:58.743860 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: Apr 11 16:46:58.745030 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93b740-b448-4633-92c3-481bb26695d9 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:58.779886 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 762/1497] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:46:58 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:46:58.784584 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a53377-8ef5-4ad8-afdd-586ef2a2c278 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:58.794056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a53377-8ef5-4ad8-afdd-586ef2a2c278 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:58.846104 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc703eb-b582-4ce6-b561-64230f4df5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:58.846784 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc703eb-b582-4ce6-b561-64230f4df5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:58.847064 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc703eb-b582-4ce6-b561-64230f4df5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:58.847333 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc703eb-b582-4ce6-b561-64230f4df5a9 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:58.848005 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc703eb-b582-4ce6-b561-64230f4df5a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:58.848994 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING py.warnings [None req-ffc703eb-b582-4ce6-b561-64230f4df5a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:46:58.848994 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: warnings.warn(msg) Apr 11 16:46:58.848994 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: Apr 11 16:46:58.850163 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc703eb-b582-4ce6-b561-64230f4df5a9 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:58.868698 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 736/1498] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:46:58 2022] POST /identity/v3/users => generated 289 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:46:58.872772 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93b740-b448-4633-92c3-481bb26695d9 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:58.883211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93b740-b448-4633-92c3-481bb26695d9 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:58.887642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2de032-353e-4528-a067-bce8f5344b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:58.888291 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2de032-353e-4528-a067-bce8f5344b67 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:58.888572 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2de032-353e-4528-a067-bce8f5344b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:58.888844 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2de032-353e-4528-a067-bce8f5344b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:58.889815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2de032-353e-4528-a067-bce8f5344b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:58.890872 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING py.warnings [None req-0f2de032-353e-4528-a067-bce8f5344b67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:46:58.890872 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: warnings.warn(msg) Apr 11 16:46:58.890872 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: Apr 11 16:46:58.891751 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2de032-353e-4528-a067-bce8f5344b67 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:58.904653 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 763/1499] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:46:58.908618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc703eb-b582-4ce6-b561-64230f4df5a9 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:58.918133 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc703eb-b582-4ce6-b561-64230f4df5a9 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:58.922488 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd612418-f999-484f-948f-f015d28ea795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:58.923154 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd612418-f999-484f-948f-f015d28ea795 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:58.923456 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd612418-f999-484f-948f-f015d28ea795 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:58.923727 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd612418-f999-484f-948f-f015d28ea795 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:58.924462 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd612418-f999-484f-948f-f015d28ea795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:58.925444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING py.warnings [None req-cd612418-f999-484f-948f-f015d28ea795 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:46:58.925444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: warnings.warn(msg) Apr 11 16:46:58.925444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: Apr 11 16:46:58.926302 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd612418-f999-484f-948f-f015d28ea795 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:58.944383 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 737/1500] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:46:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:46:58.945568 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2de032-353e-4528-a067-bce8f5344b67 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:58.957785 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2de032-353e-4528-a067-bce8f5344b67 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:58.962249 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71f967-11e3-4df3-88b3-b9aea85188eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:58.963147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71f967-11e3-4df3-88b3-b9aea85188eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:58.963419 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71f967-11e3-4df3-88b3-b9aea85188eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:58.963686 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b71f967-11e3-4df3-88b3-b9aea85188eb admin admin] PATH_INFO: `/v3/projects/2bb9d24df1454763a44caf90ed6c65e1/users/1d5364cf75064440966821479f7d0c78/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:58.977365 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71f967-11e3-4df3-88b3-b9aea85188eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bb9d24df1454763a44caf90ed6c65e1, user_id=1d5364cf75064440966821479f7d0c78, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:58.978389 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING py.warnings [None req-2b71f967-11e3-4df3-88b3-b9aea85188eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:46:58.978389 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: warnings.warn(msg) Apr 11 16:46:58.978389 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: Apr 11 16:46:58.980325 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b71f967-11e3-4df3-88b3-b9aea85188eb admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:58.992126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 764/1501] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:46:58 2022] PUT /identity/v3/projects/2bb9d24df1454763a44caf90ed6c65e1/users/1d5364cf75064440966821479f7d0c78/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:46:59.004197 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae26c3d-e45e-48f4-ba1d-2a5926c24595 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:59.004501 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae26c3d-e45e-48f4-ba1d-2a5926c24595 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:59.004771 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae26c3d-e45e-48f4-ba1d-2a5926c24595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:59.030078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-cae26c3d-e45e-48f4-ba1d-2a5926c24595 None None] MFA Rules not processed for user `1d5364cf75064440966821479f7d0c78`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:59.031273 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-cae26c3d-e45e-48f4-ba1d-2a5926c24595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:59.091950 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 738/1502] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:46:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:59.102813 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71f967-11e3-4df3-88b3-b9aea85188eb admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:59.169842 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b71f967-11e3-4df3-88b3-b9aea85188eb admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:59.175686 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0499a55-3236-431b-83b6-e7e156501715 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:59.176317 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0499a55-3236-431b-83b6-e7e156501715 service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:59.176595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0499a55-3236-431b-83b6-e7e156501715 service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:59.176865 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0499a55-3236-431b-83b6-e7e156501715 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:59.184207 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0499a55-3236-431b-83b6-e7e156501715 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:59.185779 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0499a55-3236-431b-83b6-e7e156501715 service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:59.194743 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 765/1503] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:46:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:46:59.264867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef74d7-7a01-410d-9e38-2c23bab46ce7 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:59.265152 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef74d7-7a01-410d-9e38-2c23bab46ce7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:59.265425 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef74d7-7a01-410d-9e38-2c23bab46ce7 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:59.266722 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 739/1504] 10.222.0.73 () {52 vars in 829 bytes} [Mon Apr 11 16:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:46:59.270214 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0499a55-3236-431b-83b6-e7e156501715 service nova] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:59.328875 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0499a55-3236-431b-83b6-e7e156501715 service nova] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:59.333315 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8733633-31cb-4750-bf26-c86629ec39bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:59.334168 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8733633-31cb-4750-bf26-c86629ec39bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:59.334448 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8733633-31cb-4750-bf26-c86629ec39bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:59.334758 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8733633-31cb-4750-bf26-c86629ec39bc admin admin] PATH_INFO: `/v3/users/1d5364cf75064440966821479f7d0c78` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:59.335906 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8733633-31cb-4750-bf26-c86629ec39bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d5364cf75064440966821479f7d0c78)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:59.336908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING py.warnings [None req-d8733633-31cb-4750-bf26-c86629ec39bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:46:59.336908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: warnings.warn(msg) Apr 11 16:46:59.336908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: Apr 11 16:46:59.338082 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8733633-31cb-4750-bf26-c86629ec39bc admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:59.399953 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d8733633-31cb-4750-bf26-c86629ec39bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d5364cf75064440966821479f7d0c78'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:59.400721 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d8733633-31cb-4750-bf26-c86629ec39bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d5364cf75064440966821479f7d0c78'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:59.410777 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d8733633-31cb-4750-bf26-c86629ec39bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d5364cf75064440966821479f7d0c78'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:59.422275 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d8733633-31cb-4750-bf26-c86629ec39bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d5364cf75064440966821479f7d0c78'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:59.440528 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d8733633-31cb-4750-bf26-c86629ec39bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d5364cf75064440966821479f7d0c78'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:46:59.446451 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 766/1505] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:46:59 2022] DELETE /identity/v3/users/1d5364cf75064440966821479f7d0c78 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:46:59.450828 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58594e9b-e2f3-42ac-b986-94296d86c6e5 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:59.451168 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58594e9b-e2f3-42ac-b986-94296d86c6e5 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:59.451448 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58594e9b-e2f3-42ac-b986-94296d86c6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:59.468495 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-58594e9b-e2f3-42ac-b986-94296d86c6e5 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:46:59.469678 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-58594e9b-e2f3-42ac-b986-94296d86c6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:59.525565 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 740/1506] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:46:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:46:59.536372 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8733633-31cb-4750-bf26-c86629ec39bc admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:59.537724 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d8733633-31cb-4750-bf26-c86629ec39bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:59.591028 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8733633-31cb-4750-bf26-c86629ec39bc admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:59.594500 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2d354-69ec-41d6-920d-b9d29667ed9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:59.595154 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2d354-69ec-41d6-920d-b9d29667ed9c service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:59.595432 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2d354-69ec-41d6-920d-b9d29667ed9c service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:59.595703 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2d354-69ec-41d6-920d-b9d29667ed9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:59.604623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2d354-69ec-41d6-920d-b9d29667ed9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:59.606033 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2d354-69ec-41d6-920d-b9d29667ed9c service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:46:59.615562 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 767/1507] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:46:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:46:59.971815 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58594e9b-e2f3-42ac-b986-94296d86c6e5 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:46:59.973838 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-58594e9b-e2f3-42ac-b986-94296d86c6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:46:59.986167 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58594e9b-e2f3-42ac-b986-94296d86c6e5 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:46:59.992058 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cdd948-5790-40c5-94d1-60dfd44b0d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:46:59.992888 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdd948-5790-40c5-94d1-60dfd44b0d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:46:59.993208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdd948-5790-40c5-94d1-60dfd44b0d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:46:59.993523 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cdd948-5790-40c5-94d1-60dfd44b0d1e admin admin] PATH_INFO: `/v3/projects/2bb9d24df1454763a44caf90ed6c65e1` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:46:59.994615 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdd948-5790-40c5-94d1-60dfd44b0d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bb9d24df1454763a44caf90ed6c65e1)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:46:59.995650 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING py.warnings [None req-d1cdd948-5790-40c5-94d1-60dfd44b0d1e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:46:59.995650 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: warnings.warn(msg) Apr 11 16:46:59.995650 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: Apr 11 16:46:59.996965 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cdd948-5790-40c5-94d1-60dfd44b0d1e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:47:00.056396 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d1cdd948-5790-40c5-94d1-60dfd44b0d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bb9d24df1454763a44caf90ed6c65e1', 'request_id': 'req-d1cdd948-5790-40c5-94d1-60dfd44b0d1e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:00.061883 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d1cdd948-5790-40c5-94d1-60dfd44b0d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bb9d24df1454763a44caf90ed6c65e1', 'request_id': 'req-d1cdd948-5790-40c5-94d1-60dfd44b0d1e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:00.075904 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d1cdd948-5790-40c5-94d1-60dfd44b0d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bb9d24df1454763a44caf90ed6c65e1', 'request_id': 'req-d1cdd948-5790-40c5-94d1-60dfd44b0d1e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:00.090080 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d1cdd948-5790-40c5-94d1-60dfd44b0d1e admin admin] The token cache is being invalidate because project 2bb9d24df1454763a44caf90ed6c65e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:47:00.090367 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d1cdd948-5790-40c5-94d1-60dfd44b0d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:00.091092 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d1cdd948-5790-40c5-94d1-60dfd44b0d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:47:00.092632 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 741/1508] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:46:59 2022] DELETE /identity/v3/projects/2bb9d24df1454763a44caf90ed6c65e1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:48:42.974822 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bebe0-dff7-4a7c-bc75-0e809011283d None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:42.975408 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bebe0-dff7-4a7c-bc75-0e809011283d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:42.975408 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1bebe0-dff7-4a7c-bc75-0e809011283d None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:42.976747 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 768/1509] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:48:42.981790 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d2a6c-0e50-4dbf-9db3-c147e74c184a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:42.982235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d2a6c-0e50-4dbf-9db3-c147e74c184a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:42.982357 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d2a6c-0e50-4dbf-9db3-c147e74c184a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:43.000301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-1e1d2a6c-0e50-4dbf-9db3-c147e74c184a None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:48:43.001622 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1e1d2a6c-0e50-4dbf-9db3-c147e74c184a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:43.058849 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 742/1510] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:48:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:48:43.209796 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bebe0-dff7-4a7c-bc75-0e809011283d None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:43.211398 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-1a1bebe0-dff7-4a7c-bc75-0e809011283d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:43.281773 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1bebe0-dff7-4a7c-bc75-0e809011283d None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:43.287590 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d0ab7-54c7-46dc-b750-1eca09db05f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:43.288220 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d0ab7-54c7-46dc-b750-1eca09db05f7 service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:43.288501 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d0ab7-54c7-46dc-b750-1eca09db05f7 service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:43.288776 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d0ab7-54c7-46dc-b750-1eca09db05f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:43.296553 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d0ab7-54c7-46dc-b750-1eca09db05f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:43.298131 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d0ab7-54c7-46dc-b750-1eca09db05f7 service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:43.307250 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 769/1511] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:48:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:48:44.179091 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fef8a-f2e6-4216-bec5-5b4288e636cd None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:44.179657 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fef8a-f2e6-4216-bec5-5b4288e636cd None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:44.179657 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fef8a-f2e6-4216-bec5-5b4288e636cd None None] PATH_INFO: `/v3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:44.180978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 743/1512] 10.222.0.15 () {54 vars in 925 bytes} [Mon Apr 11 16:48:44 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:48:44.187399 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82368df0-2674-49a2-9c5d-545649ac593e None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:44.187827 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82368df0-2674-49a2-9c5d-545649ac593e None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:44.187972 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82368df0-2674-49a2-9c5d-545649ac593e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:44.205526 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-82368df0-2674-49a2-9c5d-545649ac593e None None] MFA Rules not processed for user `85f5ef8708f54401af7e8defa8d13141`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:48:44.206791 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-82368df0-2674-49a2-9c5d-545649ac593e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:44.266806 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 770/1513] 10.222.0.15 () {58 vars in 1015 bytes} [Mon Apr 11 16:48:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:48:44.593948 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea196e-3f0e-4a17-a502-3be9943aa10b None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:44.594158 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea196e-3f0e-4a17-a502-3be9943aa10b None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:44.594417 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea196e-3f0e-4a17-a502-3be9943aa10b None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:44.596462 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 744/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:48:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:48:44.601341 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29725f4-10ac-4b62-a956-161fddf95a2b None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:44.601626 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29725f4-10ac-4b62-a956-161fddf95a2b None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:44.601900 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29725f4-10ac-4b62-a956-161fddf95a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:44.619255 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-c29725f4-10ac-4b62-a956-161fddf95a2b None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:48:44.620430 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-c29725f4-10ac-4b62-a956-161fddf95a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:44.628110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 771/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:48:44.778452 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea196e-3f0e-4a17-a502-3be9943aa10b None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:44.793002 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea196e-3f0e-4a17-a502-3be9943aa10b None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:44.798226 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b08a1e-e2a5-4185-9003-b6bc5569b737 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:44.798890 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b08a1e-e2a5-4185-9003-b6bc5569b737 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:44.799173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b08a1e-e2a5-4185-9003-b6bc5569b737 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:44.799451 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b08a1e-e2a5-4185-9003-b6bc5569b737 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:44.807313 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b08a1e-e2a5-4185-9003-b6bc5569b737 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:44.808883 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b08a1e-e2a5-4185-9003-b6bc5569b737 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:44.817870 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 745/1516] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:48:53.955255 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a8b2f-3fac-4255-a83e-50c04107a783 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:53.955815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a8b2f-3fac-4255-a83e-50c04107a783 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:53.955815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a8b2f-3fac-4255-a83e-50c04107a783 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:53.957962 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 772/1517] 10.222.0.73 () {54 vars in 960 bytes} [Mon Apr 11 16:48:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:48:53.963462 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e760bb-f6aa-4da3-84d3-18bb5d98b5db None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:53.963986 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e760bb-f6aa-4da3-84d3-18bb5d98b5db None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:53.964101 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e760bb-f6aa-4da3-84d3-18bb5d98b5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:53.981997 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c3e760bb-f6aa-4da3-84d3-18bb5d98b5db None None] MFA Rules not processed for user `85f5ef8708f54401af7e8defa8d13141`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:48:53.983223 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c3e760bb-f6aa-4da3-84d3-18bb5d98b5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:53.991668 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 746/1518] 10.222.0.73 () {58 vars in 1057 bytes} [Mon Apr 11 16:48:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:48:53.999394 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a8b2f-3fac-4255-a83e-50c04107a783 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:54.012947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a8b2f-3fac-4255-a83e-50c04107a783 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:54.018067 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a73cc-b31c-4d91-abd3-3bf26795d45b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f5ef8708f54401af7e8defa8d13141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:54.019343 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a73cc-b31c-4d91-abd3-3bf26795d45b service placement] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:54.019648 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a73cc-b31c-4d91-abd3-3bf26795d45b service placement] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:54.019924 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a73cc-b31c-4d91-abd3-3bf26795d45b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:54.028025 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a73cc-b31c-4d91-abd3-3bf26795d45b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:54.029605 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a73cc-b31c-4d91-abd3-3bf26795d45b service placement] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:54.039902 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 773/1519] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:48:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:48:56.486509 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc201d3-aaab-4922-9892-c79a774e07dc None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:56.487113 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc201d3-aaab-4922-9892-c79a774e07dc None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:56.487229 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc201d3-aaab-4922-9892-c79a774e07dc None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:56.488555 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 747/1520] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:48:56.493422 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80379a-3c01-408f-8aef-c0c13eed3e07 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:56.493858 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80379a-3c01-408f-8aef-c0c13eed3e07 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:56.493976 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80379a-3c01-408f-8aef-c0c13eed3e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:56.511418 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-1f80379a-3c01-408f-8aef-c0c13eed3e07 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:48:56.512586 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-1f80379a-3c01-408f-8aef-c0c13eed3e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:56.520991 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 774/1521] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:48:56.670865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc201d3-aaab-4922-9892-c79a774e07dc None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:56.684812 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc201d3-aaab-4922-9892-c79a774e07dc None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:56.690215 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32cc88-6594-4168-875f-c79b4c8e1704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:56.690869 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32cc88-6594-4168-875f-c79b4c8e1704 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:56.691154 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32cc88-6594-4168-875f-c79b4c8e1704 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:56.691431 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32cc88-6594-4168-875f-c79b4c8e1704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:56.699283 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32cc88-6594-4168-875f-c79b4c8e1704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:56.700869 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32cc88-6594-4168-875f-c79b4c8e1704 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:56.711210 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 748/1522] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:48:57.968243 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dccd67-9438-4821-8321-2241c8f856b8 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:57.968730 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dccd67-9438-4821-8321-2241c8f856b8 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:57.969236 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dccd67-9438-4821-8321-2241c8f856b8 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:57.972523 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 775/1523] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 16:48:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:48:57.978374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddd8d5-c936-45c4-a4de-0297d51fac80 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:57.978896 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddd8d5-c936-45c4-a4de-0297d51fac80 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:57.979024 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ddd8d5-c936-45c4-a4de-0297d51fac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:57.996423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-90ddd8d5-c936-45c4-a4de-0297d51fac80 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:48:57.997610 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-90ddd8d5-c936-45c4-a4de-0297d51fac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:48:58.005794 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 749/1524] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 16:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:48:58.155139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dccd67-9438-4821-8321-2241c8f856b8 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:48:58.169632 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dccd67-9438-4821-8321-2241c8f856b8 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:48:58.174940 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba7238-ceb1-4fb3-9488-5309c1dbddc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:48:58.175566 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba7238-ceb1-4fb3-9488-5309c1dbddc6 service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:48:58.175878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba7238-ceb1-4fb3-9488-5309c1dbddc6 service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:48:58.176153 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba7238-ceb1-4fb3-9488-5309c1dbddc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:48:58.183943 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba7238-ceb1-4fb3-9488-5309c1dbddc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:48:58.185510 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba7238-ceb1-4fb3-9488-5309c1dbddc6 service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:48:58.194601 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 776/1525] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:49:02.538921 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b473b7-bbf0-4a61-8307-99a1880a53e4 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:02.539463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b473b7-bbf0-4a61-8307-99a1880a53e4 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:02.539463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b473b7-bbf0-4a61-8307-99a1880a53e4 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:02.540822 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 750/1526] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:49:02.546007 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78a951-0568-4433-8ab8-91e649357230 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:02.546449 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78a951-0568-4433-8ab8-91e649357230 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:02.546556 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78a951-0568-4433-8ab8-91e649357230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:02.563665 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-1f78a951-0568-4433-8ab8-91e649357230 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:49:02.564834 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-1f78a951-0568-4433-8ab8-91e649357230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:49:02.572473 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 777/1527] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:49:02.608925 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b473b7-bbf0-4a61-8307-99a1880a53e4 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:49:02.610584 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b3b473b7-bbf0-4a61-8307-99a1880a53e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:49:02.665876 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b473b7-bbf0-4a61-8307-99a1880a53e4 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:49:02.669337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e780684-d58b-4bf8-8111-687cb16302d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:49:02.669964 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e780684-d58b-4bf8-8111-687cb16302d2 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:02.670244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e780684-d58b-4bf8-8111-687cb16302d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:02.670517 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e780684-d58b-4bf8-8111-687cb16302d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:02.679378 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e780684-d58b-4bf8-8111-687cb16302d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:49:02.680791 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e780684-d58b-4bf8-8111-687cb16302d2 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:49:02.690063 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 751/1528] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:49:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:49:04.966841 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc8090-9653-4f3a-94ba-b11b63496aae None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:04.967346 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc8090-9653-4f3a-94ba-b11b63496aae None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:04.967457 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc8090-9653-4f3a-94ba-b11b63496aae None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:04.968874 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 778/1529] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:49:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:49:04.974843 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cbe74-5dae-45df-9406-f7df234d4318 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:04.975250 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cbe74-5dae-45df-9406-f7df234d4318 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:04.975397 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42cbe74-5dae-45df-9406-f7df234d4318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:04.992887 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f42cbe74-5dae-45df-9406-f7df234d4318 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:49:04.994079 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f42cbe74-5dae-45df-9406-f7df234d4318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:49:05.001879 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 752/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:49:05.038267 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc8090-9653-4f3a-94ba-b11b63496aae None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:49:05.048668 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc8090-9653-4f3a-94ba-b11b63496aae None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:49:05.052165 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f09dcb9-abcc-41bc-904a-c56e36050933 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:49:05.052788 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09dcb9-abcc-41bc-904a-c56e36050933 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:05.053068 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09dcb9-abcc-41bc-904a-c56e36050933 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:05.053342 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f09dcb9-abcc-41bc-904a-c56e36050933 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:05.061826 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09dcb9-abcc-41bc-904a-c56e36050933 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:49:05.063290 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f09dcb9-abcc-41bc-904a-c56e36050933 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:49:05.072846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 779/1531] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:49:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:49:08.747547 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638d5f0-192d-4148-8471-1d9b65490491 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:08.748113 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638d5f0-192d-4148-8471-1d9b65490491 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:08.748113 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638d5f0-192d-4148-8471-1d9b65490491 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:08.749455 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 753/1532] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:49:08.755250 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4dfff-d5e7-43ec-9fe9-7ec0cde7d7b4 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:08.755679 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4dfff-d5e7-43ec-9fe9-7ec0cde7d7b4 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:08.755792 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab4dfff-d5e7-43ec-9fe9-7ec0cde7d7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:08.773320 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-0ab4dfff-d5e7-43ec-9fe9-7ec0cde7d7b4 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:49:08.774615 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-0ab4dfff-d5e7-43ec-9fe9-7ec0cde7d7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:49:08.782165 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 780/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:49:09.054923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638d5f0-192d-4148-8471-1d9b65490491 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:49:09.056605 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1638d5f0-192d-4148-8471-1d9b65490491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:49:09.111114 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638d5f0-192d-4148-8471-1d9b65490491 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:49:09.115142 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3359ad9-5457-4e30-9072-0014428d34a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:49:09.115799 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3359ad9-5457-4e30-9072-0014428d34a0 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:09.116116 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3359ad9-5457-4e30-9072-0014428d34a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:09.116353 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3359ad9-5457-4e30-9072-0014428d34a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:09.124885 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3359ad9-5457-4e30-9072-0014428d34a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:49:09.126286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3359ad9-5457-4e30-9072-0014428d34a0 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:49:09.135326 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 754/1534] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:49:11.450102 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea201a6d-4373-4f59-b9ab-45f010c3d349 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:11.450677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea201a6d-4373-4f59-b9ab-45f010c3d349 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:11.450677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea201a6d-4373-4f59-b9ab-45f010c3d349 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:11.452032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 781/1535] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 16:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:49:11.457061 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe49c4-a6ff-4380-9b94-5e209e53f198 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:11.457540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe49c4-a6ff-4380-9b94-5e209e53f198 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:11.457645 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe49c4-a6ff-4380-9b94-5e209e53f198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:11.475047 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c4fe49c4-a6ff-4380-9b94-5e209e53f198 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:49:11.476212 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c4fe49c4-a6ff-4380-9b94-5e209e53f198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:49:11.483772 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 755/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 16:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:49:11.752894 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77523a4d-f1fd-45ab-a0ba-d65d615c2c27 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:11.753181 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77523a4d-f1fd-45ab-a0ba-d65d615c2c27 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:11.753458 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77523a4d-f1fd-45ab-a0ba-d65d615c2c27 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:11.755461 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 782/1537] 10.222.0.73 () {54 vars in 962 bytes} [Mon Apr 11 16:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:49:11.760255 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0b834-f44f-4573-83f1-20bd549f59c5 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:11.760539 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0b834-f44f-4573-83f1-20bd549f59c5 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:11.760811 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d0b834-f44f-4573-83f1-20bd549f59c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:11.778202 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-d4d0b834-f44f-4573-83f1-20bd549f59c5 None None] MFA Rules not processed for user `a4531e7936634508bb4cbfaaaca5bbde`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:49:11.779386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d4d0b834-f44f-4573-83f1-20bd549f59c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:49:11.786147 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 756/1538] 10.222.0.73 () {58 vars in 1059 bytes} [Mon Apr 11 16:49:11 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:49:11.793598 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77523a4d-f1fd-45ab-a0ba-d65d615c2c27 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:49:11.804600 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77523a4d-f1fd-45ab-a0ba-d65d615c2c27 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:49:11.808015 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f10236-b519-46e1-8215-0bc98b219f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:49:11.808629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f10236-b519-46e1-8215-0bc98b219f99 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:49:11.808909 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f10236-b519-46e1-8215-0bc98b219f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:49:11.809182 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f10236-b519-46e1-8215-0bc98b219f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:49:11.817734 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f10236-b519-46e1-8215-0bc98b219f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:49:11.819200 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f10236-b519-46e1-8215-0bc98b219f99 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:49:11.828195 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 783/1539] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:50:42.572464 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5068f2-2194-49a9-a855-5b1ccac4c6ea None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:42.573094 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5068f2-2194-49a9-a855-5b1ccac4c6ea None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:42.573094 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5068f2-2194-49a9-a855-5b1ccac4c6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:42.607325 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-cc5068f2-2194-49a9-a855-5b1ccac4c6ea None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:42.608538 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-cc5068f2-2194-49a9-a855-5b1ccac4c6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:42.619437 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 757/1540] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:42.630224 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44d448-6bc1-4946-9c2a-450868e6b9ec None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:42.631292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44d448-6bc1-4946-9c2a-450868e6b9ec None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:42.631854 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44d448-6bc1-4946-9c2a-450868e6b9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:42.638001 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527a92d-827f-42d0-81a0-06cc1ae1489c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:42.638311 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527a92d-827f-42d0-81a0-06cc1ae1489c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:42.638546 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3527a92d-827f-42d0-81a0-06cc1ae1489c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:42.662490 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-4a44d448-6bc1-4946-9c2a-450868e6b9ec None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:42.664284 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4a44d448-6bc1-4946-9c2a-450868e6b9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:42.676154 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3527a92d-827f-42d0-81a0-06cc1ae1489c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:42.677084 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 784/1541] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:42.677344 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3527a92d-827f-42d0-81a0-06cc1ae1489c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:42.678842 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76af37-9b90-473a-adea-6b0d678a75a0 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:42.679464 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76af37-9b90-473a-adea-6b0d678a75a0 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:42.679959 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76af37-9b90-473a-adea-6b0d678a75a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:42.691785 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 758/1542] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:50:42.692519 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527a92d-827f-42d0-81a0-06cc1ae1489c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:42.710768 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-de76af37-9b90-473a-adea-6b0d678a75a0 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:42.713144 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-de76af37-9b90-473a-adea-6b0d678a75a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:42.714070 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3527a92d-827f-42d0-81a0-06cc1ae1489c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:42.724145 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6672f3-3b55-447f-9722-de8b496123be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:42.724842 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6672f3-3b55-447f-9722-de8b496123be admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:42.725123 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6672f3-3b55-447f-9722-de8b496123be admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:42.725394 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6672f3-3b55-447f-9722-de8b496123be admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:42.726126 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6672f3-3b55-447f-9722-de8b496123be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:50:42.726428 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6672f3-3b55-447f-9722-de8b496123be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:42.728352 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6672f3-3b55-447f-9722-de8b496123be admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:42.730329 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 785/1543] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:42.732089 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5de0e-87f4-4524-86c8-87028889c35f None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:42.732621 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5de0e-87f4-4524-86c8-87028889c35f None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:42.733242 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5de0e-87f4-4524-86c8-87028889c35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:42.764100 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-dcf5de0e-87f4-4524-86c8-87028889c35f None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:42.765648 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-dcf5de0e-87f4-4524-86c8-87028889c35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:42.766723 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 759/1544] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:50:42.769114 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14908f61-355f-4581-8746-81336d456cbd None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:42.769403 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14908f61-355f-4581-8746-81336d456cbd None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:42.769678 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14908f61-355f-4581-8746-81336d456cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:42.779222 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 786/1545] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:42.784401 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5de0e-87f4-4524-86c8-87028889c35f None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:42.794377 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5de0e-87f4-4524-86c8-87028889c35f None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:42.801949 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-14908f61-355f-4581-8746-81336d456cbd None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:42.804234 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-14908f61-355f-4581-8746-81336d456cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:42.808204 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0a67f-59b7-4cc6-863d-c5047dd799f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:42.808883 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0a67f-59b7-4cc6-863d-c5047dd799f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:42.809158 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0a67f-59b7-4cc6-863d-c5047dd799f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:42.809423 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0a67f-59b7-4cc6-863d-c5047dd799f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:42.810147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0a67f-59b7-4cc6-863d-c5047dd799f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:50:42.810446 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0a67f-59b7-4cc6-863d-c5047dd799f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:42.811509 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING py.warnings [None req-e9c0a67f-59b7-4cc6-863d-c5047dd799f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:50:42.811509 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: warnings.warn(msg) Apr 11 16:50:42.811509 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: Apr 11 16:50:42.812391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0a67f-59b7-4cc6-863d-c5047dd799f7 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:42.834926 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 760/1546] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:42.836352 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14908f61-355f-4581-8746-81336d456cbd None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:42.854840 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 787/1547] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:50:42.856331 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180c6e7-d494-4f88-a676-f4371d262eba None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:42.856630 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180c6e7-d494-4f88-a676-f4371d262eba None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:42.856899 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180c6e7-d494-4f88-a676-f4371d262eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:42.863888 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14908f61-355f-4581-8746-81336d456cbd None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:42.875028 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ec750-72e3-4072-b0d4-81f1bf66b6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:42.875694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ec750-72e3-4072-b0d4-81f1bf66b6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:42.875973 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ec750-72e3-4072-b0d4-81f1bf66b6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:42.876244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ec750-72e3-4072-b0d4-81f1bf66b6a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:42.877120 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ec750-72e3-4072-b0d4-81f1bf66b6a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:42.878668 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING py.warnings [None req-1c7ec750-72e3-4072-b0d4-81f1bf66b6a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:50:42.878668 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: warnings.warn(msg) Apr 11 16:50:42.878668 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: Apr 11 16:50:42.879843 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ec750-72e3-4072-b0d4-81f1bf66b6a7 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:42.884642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-e180c6e7-d494-4f88-a676-f4371d262eba None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:42.885829 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-e180c6e7-d494-4f88-a676-f4371d262eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:42.895052 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 788/1548] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:42.896169 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180c6e7-d494-4f88-a676-f4371d262eba None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:42.908295 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180c6e7-d494-4f88-a676-f4371d262eba None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:42.914444 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eacf16-314e-4733-beca-4914d37daf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:42.915138 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eacf16-314e-4733-beca-4914d37daf7a admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:42.915421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eacf16-314e-4733-beca-4914d37daf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:42.915697 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eacf16-314e-4733-beca-4914d37daf7a admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:42.916412 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eacf16-314e-4733-beca-4914d37daf7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:50:42.916719 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eacf16-314e-4733-beca-4914d37daf7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:42.917249 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 761/1549] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:50:42 2022] POST /identity/v3/projects => generated 375 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:42.918514 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c63f3-0ab7-40b2-afcd-abecd63b54dd None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:42.918673 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eacf16-314e-4733-beca-4914d37daf7a admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:42.922006 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c63f3-0ab7-40b2-afcd-abecd63b54dd None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:42.922300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c63f3-0ab7-40b2-afcd-abecd63b54dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:42.937911 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 789/1550] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:50:42.937911 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eacf16-314e-4733-beca-4914d37daf7a admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:42.944863 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-2d6c63f3-0ab7-40b2-afcd-abecd63b54dd None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:42.946097 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2d6c63f3-0ab7-40b2-afcd-abecd63b54dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:42.952613 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eacf16-314e-4733-beca-4914d37daf7a admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.006557 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1bf33-8f67-4c31-93dd-944b35404a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.007393 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1bf33-8f67-4c31-93dd-944b35404a5b admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.007776 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1bf33-8f67-4c31-93dd-944b35404a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.008155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1bf33-8f67-4c31-93dd-944b35404a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.008935 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1bf33-8f67-4c31-93dd-944b35404a5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.009222 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 762/1551] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:43.010499 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676247c1-7f58-4d5c-aa04-8f60c13052f3 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.010814 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676247c1-7f58-4d5c-aa04-8f60c13052f3 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.011090 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676247c1-7f58-4d5c-aa04-8f60c13052f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.011587 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1bf33-8f67-4c31-93dd-944b35404a5b admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.035713 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-676247c1-7f58-4d5c-aa04-8f60c13052f3 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:43.036826 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-676247c1-7f58-4d5c-aa04-8f60c13052f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:43.042947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 790/1552] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:50:42 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:43.042947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e231fc-2985-4ce7-8200-4f3c514bdc6f None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.042947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e231fc-2985-4ce7-8200-4f3c514bdc6f None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.042947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e231fc-2985-4ce7-8200-4f3c514bdc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.058813 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-29e231fc-2985-4ce7-8200-4f3c514bdc6f None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:43.060004 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-29e231fc-2985-4ce7-8200-4f3c514bdc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:43.093799 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 763/1553] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:43.095266 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6b399-fa8d-4836-9157-d726663674e0 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.095554 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6b399-fa8d-4836-9157-d726663674e0 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.095928 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6b399-fa8d-4836-9157-d726663674e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.116587 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 791/1554] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:43.117400 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e231fc-2985-4ce7-8200-4f3c514bdc6f None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.118585 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f2d6b399-fa8d-4836-9157-d726663674e0 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:43.119788 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f2d6b399-fa8d-4836-9157-d726663674e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:43.126242 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e231fc-2985-4ce7-8200-4f3c514bdc6f None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.128959 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 764/1555] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:43.129728 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6b399-fa8d-4836-9157-d726663674e0 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.130715 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267fd76-b7ce-4017-b24a-76a09b53e04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.131354 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267fd76-b7ce-4017-b24a-76a09b53e04f admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.131632 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267fd76-b7ce-4017-b24a-76a09b53e04f admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.131901 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267fd76-b7ce-4017-b24a-76a09b53e04f admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.132571 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267fd76-b7ce-4017-b24a-76a09b53e04f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.133641 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING py.warnings [None req-4267fd76-b7ce-4017-b24a-76a09b53e04f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:50:43.133641 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: warnings.warn(msg) Apr 11 16:50:43.133641 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: Apr 11 16:50:43.134846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267fd76-b7ce-4017-b24a-76a09b53e04f admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.139232 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6b399-fa8d-4836-9157-d726663674e0 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.144687 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de80bb-63a8-4da6-9ef6-6b600fd1b7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.145478 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de80bb-63a8-4da6-9ef6-6b600fd1b7fb admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.145778 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de80bb-63a8-4da6-9ef6-6b600fd1b7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.146182 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de80bb-63a8-4da6-9ef6-6b600fd1b7fb admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.147188 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de80bb-63a8-4da6-9ef6-6b600fd1b7fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.149446 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de80bb-63a8-4da6-9ef6-6b600fd1b7fb admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.154308 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 792/1556] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/users => generated 288 bytes in 37 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:43.155591 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74732f73-81bd-4b68-bdfa-35bfa4f1c213 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.155875 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74732f73-81bd-4b68-bdfa-35bfa4f1c213 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.156145 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74732f73-81bd-4b68-bdfa-35bfa4f1c213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.174392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-74732f73-81bd-4b68-bdfa-35bfa4f1c213 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:43.174989 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 765/1557] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:43.175732 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-74732f73-81bd-4b68-bdfa-35bfa4f1c213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:43.179302 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695adc75-72fa-49da-86e9-aebb67338e4a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.179587 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695adc75-72fa-49da-86e9-aebb67338e4a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.179871 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695adc75-72fa-49da-86e9-aebb67338e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.196986 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-695adc75-72fa-49da-86e9-aebb67338e4a None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:43.198140 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-695adc75-72fa-49da-86e9-aebb67338e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:43.231607 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 793/1558] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:43.232413 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74732f73-81bd-4b68-bdfa-35bfa4f1c213 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.241227 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74732f73-81bd-4b68-bdfa-35bfa4f1c213 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.245629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122788ea-8dc3-43ee-a6e1-cfa8d3c2aeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.246274 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122788ea-8dc3-43ee-a6e1-cfa8d3c2aeab admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.246559 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122788ea-8dc3-43ee-a6e1-cfa8d3c2aeab admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.246854 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122788ea-8dc3-43ee-a6e1-cfa8d3c2aeab admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.247525 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122788ea-8dc3-43ee-a6e1-cfa8d3c2aeab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.249434 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122788ea-8dc3-43ee-a6e1-cfa8d3c2aeab admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.255880 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 766/1559] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:43.260300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bb8ec-c8aa-4bb4-89c6-5997e362d0c1 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.260708 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bb8ec-c8aa-4bb4-89c6-5997e362d0c1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.261093 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bb8ec-c8aa-4bb4-89c6-5997e362d0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.276304 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 794/1560] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/users => generated 291 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:43.277718 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b75b3-80f5-4432-93cb-97b61a396dd2 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.278106 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b75b3-80f5-4432-93cb-97b61a396dd2 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.278504 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b75b3-80f5-4432-93cb-97b61a396dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.285473 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-fc3bb8ec-c8aa-4bb4-89c6-5997e362d0c1 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:43.286868 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-fc3bb8ec-c8aa-4bb4-89c6-5997e362d0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:43.300310 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 767/1561] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:43.300310 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bb8ec-c8aa-4bb4-89c6-5997e362d0c1 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.301989 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-012b75b3-80f5-4432-93cb-97b61a396dd2 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:43.303388 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-012b75b3-80f5-4432-93cb-97b61a396dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:43.309219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bb8ec-c8aa-4bb4-89c6-5997e362d0c1 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.313143 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 795/1562] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:43.313761 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b75b3-80f5-4432-93cb-97b61a396dd2 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.318584 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfbf8b-9fee-4176-9cfa-5231fa84ae77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.319441 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfbf8b-9fee-4176-9cfa-5231fa84ae77 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.319820 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfbf8b-9fee-4176-9cfa-5231fa84ae77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.320250 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cfbf8b-9fee-4176-9cfa-5231fa84ae77 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.321201 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfbf8b-9fee-4176-9cfa-5231fa84ae77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:50:43.321555 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfbf8b-9fee-4176-9cfa-5231fa84ae77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.323261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cfbf8b-9fee-4176-9cfa-5231fa84ae77 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.323685 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b75b3-80f5-4432-93cb-97b61a396dd2 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.328642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf290917-7800-4044-8e10-e201c57d5e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.329409 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf290917-7800-4044-8e10-e201c57d5e13 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.330252 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf290917-7800-4044-8e10-e201c57d5e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.330621 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf290917-7800-4044-8e10-e201c57d5e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.331394 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf290917-7800-4044-8e10-e201c57d5e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.333037 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf290917-7800-4044-8e10-e201c57d5e13 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.335994 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 768/1563] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:50:43.339454 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfbf8b-9fee-4176-9cfa-5231fa84ae77 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.349337 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 796/1564] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:43.349337 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8a85f-90ce-4749-9284-e65cef097289 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.349337 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8a85f-90ce-4749-9284-e65cef097289 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.349337 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd8a85f-90ce-4749-9284-e65cef097289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.360343 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cfbf8b-9fee-4176-9cfa-5231fa84ae77 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.368421 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0386ba9-f75b-4e3b-bd6c-5c8048605ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.369433 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0386ba9-f75b-4e3b-bd6c-5c8048605ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.369936 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0386ba9-f75b-4e3b-bd6c-5c8048605ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.370439 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0386ba9-f75b-4e3b-bd6c-5c8048605ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.371305 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0386ba9-f75b-4e3b-bd6c-5c8048605ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.371619 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-4bd8a85f-90ce-4749-9284-e65cef097289 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:43.372882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4bd8a85f-90ce-4749-9284-e65cef097289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:43.373904 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0386ba9-f75b-4e3b-bd6c-5c8048605ad3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.381096 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 797/1565] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:43.381976 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8a85f-90ce-4749-9284-e65cef097289 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.392531 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd8a85f-90ce-4749-9284-e65cef097289 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.398490 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183ea50-7a72-42cb-bd1e-86f2df89776c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.399220 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183ea50-7a72-42cb-bd1e-86f2df89776c admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.399504 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183ea50-7a72-42cb-bd1e-86f2df89776c admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.399785 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183ea50-7a72-42cb-bd1e-86f2df89776c admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.400553 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183ea50-7a72-42cb-bd1e-86f2df89776c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:50:43.400949 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183ea50-7a72-42cb-bd1e-86f2df89776c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.402969 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183ea50-7a72-42cb-bd1e-86f2df89776c admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.404060 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 769/1566] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/users => generated 296 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:43.407749 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0386ba9-f75b-4e3b-bd6c-5c8048605ad3 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.418729 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 798/1567] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:50:43.418729 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183ea50-7a72-42cb-bd1e-86f2df89776c admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.418996 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0386ba9-f75b-4e3b-bd6c-5c8048605ad3 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.427721 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38b61a-cf1d-46e3-917c-208bcf01b920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.428720 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38b61a-cf1d-46e3-917c-208bcf01b920 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.429102 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38b61a-cf1d-46e3-917c-208bcf01b920 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.430077 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38b61a-cf1d-46e3-917c-208bcf01b920 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.431237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38b61a-cf1d-46e3-917c-208bcf01b920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.435545 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38b61a-cf1d-46e3-917c-208bcf01b920 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.435688 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183ea50-7a72-42cb-bd1e-86f2df89776c admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.437908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b450ce-44da-4022-a7dc-03fec1751f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.438614 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b450ce-44da-4022-a7dc-03fec1751f0a admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.438993 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b450ce-44da-4022-a7dc-03fec1751f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.439269 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b450ce-44da-4022-a7dc-03fec1751f0a admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.440148 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b450ce-44da-4022-a7dc-03fec1751f0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:50:43.440452 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b450ce-44da-4022-a7dc-03fec1751f0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.442029 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b450ce-44da-4022-a7dc-03fec1751f0a admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.444168 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 770/1568] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:43.444987 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38b61a-cf1d-46e3-917c-208bcf01b920 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.454183 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 799/1569] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:50:43.455038 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b450ce-44da-4022-a7dc-03fec1751f0a admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.456199 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38b61a-cf1d-46e3-917c-208bcf01b920 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.465684 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c32fc-5648-4a52-8ccd-a2d974cbd331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.466346 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c32fc-5648-4a52-8ccd-a2d974cbd331 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.466647 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c32fc-5648-4a52-8ccd-a2d974cbd331 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.466925 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c32fc-5648-4a52-8ccd-a2d974cbd331 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.467641 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c32fc-5648-4a52-8ccd-a2d974cbd331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:50:43.467942 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c32fc-5648-4a52-8ccd-a2d974cbd331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.469548 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0c32fc-5648-4a52-8ccd-a2d974cbd331 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.471565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b450ce-44da-4022-a7dc-03fec1751f0a admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.476102 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf4734-9a46-4d07-914c-c5137f1b4080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.476748 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf4734-9a46-4d07-914c-c5137f1b4080 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.477024 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf4734-9a46-4d07-914c-c5137f1b4080 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.477295 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdf4734-9a46-4d07-914c-c5137f1b4080 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.477968 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf4734-9a46-4d07-914c-c5137f1b4080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.479889 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdf4734-9a46-4d07-914c-c5137f1b4080 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.482290 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 771/1570] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:50:43.483145 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c32fc-5648-4a52-8ccd-a2d974cbd331 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.493128 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c32fc-5648-4a52-8ccd-a2d974cbd331 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.497762 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26ed76-2748-4d0d-8c77-e9a6d0cd302d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.498708 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26ed76-2748-4d0d-8c77-e9a6d0cd302d admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.499055 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26ed76-2748-4d0d-8c77-e9a6d0cd302d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.499396 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26ed76-2748-4d0d-8c77-e9a6d0cd302d admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.500273 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26ed76-2748-4d0d-8c77-e9a6d0cd302d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.501923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26ed76-2748-4d0d-8c77-e9a6d0cd302d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.513919 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 772/1571] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:43.514849 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26ed76-2748-4d0d-8c77-e9a6d0cd302d admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.519897 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 800/1572] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:43.520919 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf4734-9a46-4d07-914c-c5137f1b4080 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.526094 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26ed76-2748-4d0d-8c77-e9a6d0cd302d admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.585123 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdf4734-9a46-4d07-914c-c5137f1b4080 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.589110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d2aef-db63-4bdc-8ed1-ce2642e3de6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.589582 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f974f-1fd9-4bcb-b12a-f920299bdd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.589777 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d2aef-db63-4bdc-8ed1-ce2642e3de6e admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.590055 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d2aef-db63-4bdc-8ed1-ce2642e3de6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.590325 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d2aef-db63-4bdc-8ed1-ce2642e3de6e admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.590429 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f974f-1fd9-4bcb-b12a-f920299bdd53 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.590656 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f974f-1fd9-4bcb-b12a-f920299bdd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.590931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f974f-1fd9-4bcb-b12a-f920299bdd53 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.591082 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d2aef-db63-4bdc-8ed1-ce2642e3de6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:50:43.591386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d2aef-db63-4bdc-8ed1-ce2642e3de6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.591643 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f974f-1fd9-4bcb-b12a-f920299bdd53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.592980 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d2aef-db63-4bdc-8ed1-ce2642e3de6e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.593223 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f974f-1fd9-4bcb-b12a-f920299bdd53 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.602883 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 801/1573] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:43.611985 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 773/1574] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:50:43.611985 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d2aef-db63-4bdc-8ed1-ce2642e3de6e admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.612255 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f974f-1fd9-4bcb-b12a-f920299bdd53 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.616999 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d2aef-db63-4bdc-8ed1-ce2642e3de6e admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.617242 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f974f-1fd9-4bcb-b12a-f920299bdd53 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.621426 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcc631-aed7-494c-8a43-d5ac015f7ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.621696 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab87fe-2b9c-46be-a5cf-7700d70f4de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.622061 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcc631-aed7-494c-8a43-d5ac015f7ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.622319 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab87fe-2b9c-46be-a5cf-7700d70f4de9 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.622438 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcc631-aed7-494c-8a43-d5ac015f7ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.622614 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab87fe-2b9c-46be-a5cf-7700d70f4de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.622726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dcc631-aed7-494c-8a43-d5ac015f7ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.622904 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab87fe-2b9c-46be-a5cf-7700d70f4de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.623331 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dcc631-aed7-494c-8a43-d5ac015f7ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.623569 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab87fe-2b9c-46be-a5cf-7700d70f4de9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.624894 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dcc631-aed7-494c-8a43-d5ac015f7ad7 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.625452 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab87fe-2b9c-46be-a5cf-7700d70f4de9 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.635380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 774/1575] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:43.639482 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcc631-aed7-494c-8a43-d5ac015f7ad7 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.649772 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dcc631-aed7-494c-8a43-d5ac015f7ad7 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.655110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 802/1576] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:43.655110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab87fe-2b9c-46be-a5cf-7700d70f4de9 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.705180 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475efcf-27a3-41d9-932b-701f8bad2f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.705931 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475efcf-27a3-41d9-932b-701f8bad2f61 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.706209 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475efcf-27a3-41d9-932b-701f8bad2f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.706481 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475efcf-27a3-41d9-932b-701f8bad2f61 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.707186 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475efcf-27a3-41d9-932b-701f8bad2f61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.709057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475efcf-27a3-41d9-932b-701f8bad2f61 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.713959 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab87fe-2b9c-46be-a5cf-7700d70f4de9 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.718737 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004067e0-ed3f-48f9-a859-0b0a139d3fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.719394 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004067e0-ed3f-48f9-a859-0b0a139d3fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.719672 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004067e0-ed3f-48f9-a859-0b0a139d3fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.719997 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004067e0-ed3f-48f9-a859-0b0a139d3fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.720677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004067e0-ed3f-48f9-a859-0b0a139d3fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.722649 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004067e0-ed3f-48f9-a859-0b0a139d3fe2 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.733066 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 775/1577] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:43.733905 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475efcf-27a3-41d9-932b-701f8bad2f61 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.751929 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 803/1578] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:43.751929 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004067e0-ed3f-48f9-a859-0b0a139d3fe2 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.792444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475efcf-27a3-41d9-932b-701f8bad2f61 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.811223 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004067e0-ed3f-48f9-a859-0b0a139d3fe2 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.816310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a28f2-58b9-4d40-993d-e7f12275c2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.816970 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a28f2-58b9-4d40-993d-e7f12275c2ac admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.817248 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a28f2-58b9-4d40-993d-e7f12275c2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.817518 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77a28f2-58b9-4d40-993d-e7f12275c2ac admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.818192 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a28f2-58b9-4d40-993d-e7f12275c2ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.820152 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77a28f2-58b9-4d40-993d-e7f12275c2ac admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.842719 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 804/1579] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:43.842719 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a28f2-58b9-4d40-993d-e7f12275c2ac admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.848744 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb87a24-f559-41c2-be15-86d88b4ae4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.849654 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb87a24-f559-41c2-be15-86d88b4ae4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.849770 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77a28f2-58b9-4d40-993d-e7f12275c2ac admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.849984 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb87a24-f559-41c2-be15-86d88b4ae4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.850290 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb87a24-f559-41c2-be15-86d88b4ae4d5 admin admin] PATH_INFO: `/v3/projects/78ebf69e59e04deea8b3929482443b38/users/f202c393a41544debfc5a6faf7281b18/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.854881 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1838a4-f640-4500-a2e4-8563fc504bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.855509 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1838a4-f640-4500-a2e4-8563fc504bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.855790 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1838a4-f640-4500-a2e4-8563fc504bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.856065 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1838a4-f640-4500-a2e4-8563fc504bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.856778 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1838a4-f640-4500-a2e4-8563fc504bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.858353 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1838a4-f640-4500-a2e4-8563fc504bb0 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.865070 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb87a24-f559-41c2-be15-86d88b4ae4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78ebf69e59e04deea8b3929482443b38, user_id=f202c393a41544debfc5a6faf7281b18, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.866243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING py.warnings [None req-4cb87a24-f559-41c2-be15-86d88b4ae4d5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:50:43.866243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: warnings.warn(msg) Apr 11 16:50:43.866243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: Apr 11 16:50:43.868167 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb87a24-f559-41c2-be15-86d88b4ae4d5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.872480 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 805/1580] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:43.873276 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1838a4-f640-4500-a2e4-8563fc504bb0 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.882255 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 776/1581] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:43 2022] PUT /identity/v3/projects/78ebf69e59e04deea8b3929482443b38/users/f202c393a41544debfc5a6faf7281b18/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:43.883254 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb87a24-f559-41c2-be15-86d88b4ae4d5 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.883391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1838a4-f640-4500-a2e4-8563fc504bb0 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.936972 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ccb3a-2c53-4dca-b5de-39b2d2cbdbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.937631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ccb3a-2c53-4dca-b5de-39b2d2cbdbc3 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.937912 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ccb3a-2c53-4dca-b5de-39b2d2cbdbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.938193 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ccb3a-2c53-4dca-b5de-39b2d2cbdbc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.938898 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ccb3a-2c53-4dca-b5de-39b2d2cbdbc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.941410 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ccb3a-2c53-4dca-b5de-39b2d2cbdbc3 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.944082 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb87a24-f559-41c2-be15-86d88b4ae4d5 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:43.948391 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad16812-3cfd-4f6e-a092-478a75aa7941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:43.949508 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad16812-3cfd-4f6e-a092-478a75aa7941 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:43.949796 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad16812-3cfd-4f6e-a092-478a75aa7941 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:43.950104 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad16812-3cfd-4f6e-a092-478a75aa7941 admin admin] PATH_INFO: `/v3/projects/86c699b812e44134b9a8f08dd7bb7257/users/5abbbf5aabab4cf7b1921473b5528955/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:43.966994 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad16812-3cfd-4f6e-a092-478a75aa7941 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c699b812e44134b9a8f08dd7bb7257, user_id=5abbbf5aabab4cf7b1921473b5528955, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:43.969827 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad16812-3cfd-4f6e-a092-478a75aa7941 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:43.974156 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 806/1582] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:43.974156 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ccb3a-2c53-4dca-b5de-39b2d2cbdbc3 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:43.984991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 777/1583] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:43 2022] PUT /identity/v3/projects/86c699b812e44134b9a8f08dd7bb7257/users/5abbbf5aabab4cf7b1921473b5528955/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:43.985901 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad16812-3cfd-4f6e-a092-478a75aa7941 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.039763 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ccb3a-2c53-4dca-b5de-39b2d2cbdbc3 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.045761 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad16812-3cfd-4f6e-a092-478a75aa7941 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.046918 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327472ab-ce59-4275-a674-cc7104f2a614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.047579 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327472ab-ce59-4275-a674-cc7104f2a614 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.047855 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327472ab-ce59-4275-a674-cc7104f2a614 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.048128 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327472ab-ce59-4275-a674-cc7104f2a614 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.048831 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327472ab-ce59-4275-a674-cc7104f2a614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.050771 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22998179-c7ae-4074-911c-66f32c1603a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.050919 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327472ab-ce59-4275-a674-cc7104f2a614 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.051974 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22998179-c7ae-4074-911c-66f32c1603a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.052229 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22998179-c7ae-4074-911c-66f32c1603a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.052503 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22998179-c7ae-4074-911c-66f32c1603a4 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.053189 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22998179-c7ae-4074-911c-66f32c1603a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.055158 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22998179-c7ae-4074-911c-66f32c1603a4 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.074318 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 807/1584] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:44.074318 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327472ab-ce59-4275-a674-cc7104f2a614 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.081685 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 778/1585] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:50:43 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:44.081685 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22998179-c7ae-4074-911c-66f32c1603a4 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.082276 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327472ab-ce59-4275-a674-cc7104f2a614 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.086716 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e047f58e-a3c9-458e-af3a-0de4cf951a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.087358 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047f58e-a3c9-458e-af3a-0de4cf951a8b admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.087634 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047f58e-a3c9-458e-af3a-0de4cf951a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.087908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e047f58e-a3c9-458e-af3a-0de4cf951a8b admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.088569 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047f58e-a3c9-458e-af3a-0de4cf951a8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.089180 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22998179-c7ae-4074-911c-66f32c1603a4 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.090461 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e047f58e-a3c9-458e-af3a-0de4cf951a8b admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.093735 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ee1f8-7e60-4013-8e2c-f3f270879e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.094435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ee1f8-7e60-4013-8e2c-f3f270879e80 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.094754 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ee1f8-7e60-4013-8e2c-f3f270879e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.095031 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ee1f8-7e60-4013-8e2c-f3f270879e80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.095769 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ee1f8-7e60-4013-8e2c-f3f270879e80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.097522 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ee1f8-7e60-4013-8e2c-f3f270879e80 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.110697 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 779/1586] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:44.110697 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ee1f8-7e60-4013-8e2c-f3f270879e80 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.110962 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 808/1587] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:50:44 2022] POST /identity/v3/users => generated 293 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:44.110962 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8b28-fbca-41be-9622-a098bfadf098 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.111406 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8b28-fbca-41be-9622-a098bfadf098 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.111532 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c8b28-fbca-41be-9622-a098bfadf098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.120553 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ee1f8-7e60-4013-8e2c-f3f270879e80 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.125268 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03944148-4d50-4448-bffd-0dbdc50d89b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.126134 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03944148-4d50-4448-bffd-0dbdc50d89b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.126418 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03944148-4d50-4448-bffd-0dbdc50d89b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.126724 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03944148-4d50-4448-bffd-0dbdc50d89b3 admin admin] PATH_INFO: `/v3/projects/3a69ed2513084a06887269c7f55fa8ed/users/9924b7b7dd6448d78bc9d166a2b51927/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.137397 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-044c8b28-fbca-41be-9622-a098bfadf098 None None] MFA Rules not processed for user `f202c393a41544debfc5a6faf7281b18`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:44.138615 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-044c8b28-fbca-41be-9622-a098bfadf098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:44.141788 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03944148-4d50-4448-bffd-0dbdc50d89b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a69ed2513084a06887269c7f55fa8ed, user_id=9924b7b7dd6448d78bc9d166a2b51927, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.145057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03944148-4d50-4448-bffd-0dbdc50d89b3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.157309 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 780/1588] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:44 2022] PUT /identity/v3/projects/3a69ed2513084a06887269c7f55fa8ed/users/9924b7b7dd6448d78bc9d166a2b51927/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:44.158083 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03944148-4d50-4448-bffd-0dbdc50d89b3 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.201056 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 809/1589] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:44.202325 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f650381-8b69-4165-98a4-0134ab47258c None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.202682 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f650381-8b69-4165-98a4-0134ab47258c None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.202945 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f650381-8b69-4165-98a4-0134ab47258c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.221806 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03944148-4d50-4448-bffd-0dbdc50d89b3 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.226342 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe733e6-ef7b-4bc4-bc4f-0b3dd3f0f2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.227356 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe733e6-ef7b-4bc4-bc4f-0b3dd3f0f2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.227356 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe733e6-ef7b-4bc4-bc4f-0b3dd3f0f2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.227606 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe733e6-ef7b-4bc4-bc4f-0b3dd3f0f2b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.228313 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe733e6-ef7b-4bc4-bc4f-0b3dd3f0f2b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.229777 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-1f650381-8b69-4165-98a4-0134ab47258c None None] MFA Rules not processed for user `5abbbf5aabab4cf7b1921473b5528955`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:44.230223 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe733e6-ef7b-4bc4-bc4f-0b3dd3f0f2b8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.230988 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-1f650381-8b69-4165-98a4-0134ab47258c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:44.250767 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 781/1590] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:50:44 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:44.251659 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe733e6-ef7b-4bc4-bc4f-0b3dd3f0f2b8 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.261466 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe733e6-ef7b-4bc4-bc4f-0b3dd3f0f2b8 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.266186 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051bf1e-6904-4b40-b5e2-87ea859f3462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.266861 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051bf1e-6904-4b40-b5e2-87ea859f3462 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.267143 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051bf1e-6904-4b40-b5e2-87ea859f3462 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.267424 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051bf1e-6904-4b40-b5e2-87ea859f3462 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.268198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051bf1e-6904-4b40-b5e2-87ea859f3462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.269772 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051bf1e-6904-4b40-b5e2-87ea859f3462 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.279861 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 782/1591] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:44.280656 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051bf1e-6904-4b40-b5e2-87ea859f3462 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.292063 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051bf1e-6904-4b40-b5e2-87ea859f3462 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.293558 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 810/1592] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:44.294387 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f650381-8b69-4165-98a4-0134ab47258c None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.296828 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b73ed3-73fa-4966-b479-1682f2813ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.297353 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b73ed3-73fa-4966-b479-1682f2813ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.297638 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b73ed3-73fa-4966-b479-1682f2813ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.297914 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b73ed3-73fa-4966-b479-1682f2813ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.298650 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b73ed3-73fa-4966-b479-1682f2813ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.300315 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b73ed3-73fa-4966-b479-1682f2813ac3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.304183 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f650381-8b69-4165-98a4-0134ab47258c None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.309325 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a8c52-6c6f-4be1-8848-b495b03df220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.309953 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a8c52-6c6f-4be1-8848-b495b03df220 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.310233 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a8c52-6c6f-4be1-8848-b495b03df220 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.310545 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a8c52-6c6f-4be1-8848-b495b03df220 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.310983 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 783/1593] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:44.311790 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b73ed3-73fa-4966-b479-1682f2813ac3 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.314380 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a8c52-6c6f-4be1-8848-b495b03df220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.316537 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5a8c52-6c6f-4be1-8848-b495b03df220 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.321393 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b73ed3-73fa-4966-b479-1682f2813ac3 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.325817 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdcf71c-7dae-45ca-bfe6-f8dfd61852ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.326400 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 811/1594] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:44.326525 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcf71c-7dae-45ca-bfe6-f8dfd61852ea admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.326733 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcf71c-7dae-45ca-bfe6-f8dfd61852ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.327350 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdcf71c-7dae-45ca-bfe6-f8dfd61852ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.327456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdd1b1-5414-4be6-8678-fcc57e10964c None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.327734 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdd1b1-5414-4be6-8678-fcc57e10964c None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.328011 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdd1b1-5414-4be6-8678-fcc57e10964c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.328102 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcf71c-7dae-45ca-bfe6-f8dfd61852ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.329588 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdcf71c-7dae-45ca-bfe6-f8dfd61852ea admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.339746 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 784/1595] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:44.341231 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c2d9a-f951-4f33-b155-f5df778fe174 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.341520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c2d9a-f951-4f33-b155-f5df778fe174 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.341796 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c2d9a-f951-4f33-b155-f5df778fe174 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.343054 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 785/1596] 10.222.0.73 () {54 vars in 960 bytes} [Mon Apr 11 16:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:50:44.343846 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c2d9a-f951-4f33-b155-f5df778fe174 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.344784 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-99fdd1b1-5414-4be6-8678-fcc57e10964c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:44.345959 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-99fdd1b1-5414-4be6-8678-fcc57e10964c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:44.353352 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 812/1597] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:44.353352 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdd1b1-5414-4be6-8678-fcc57e10964c None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.358777 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c2d9a-f951-4f33-b155-f5df778fe174 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.363702 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdd1b1-5414-4be6-8678-fcc57e10964c None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.364129 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8967f-ebb4-48d7-b198-ec3bb8c3ac47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.364844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8967f-ebb4-48d7-b198-ec3bb8c3ac47 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.365198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8967f-ebb4-48d7-b198-ec3bb8c3ac47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.365536 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8967f-ebb4-48d7-b198-ec3bb8c3ac47 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.366320 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8967f-ebb4-48d7-b198-ec3bb8c3ac47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.367992 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8967f-ebb4-48d7-b198-ec3bb8c3ac47 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.368184 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8dd69-01d6-41b1-9bb8-44c7dc1d946c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.368824 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8dd69-01d6-41b1-9bb8-44c7dc1d946c admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.369103 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8dd69-01d6-41b1-9bb8-44c7dc1d946c admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.369372 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8dd69-01d6-41b1-9bb8-44c7dc1d946c admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.370110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8dd69-01d6-41b1-9bb8-44c7dc1d946c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.371744 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c8dd69-01d6-41b1-9bb8-44c7dc1d946c admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.378337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 786/1598] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:44.379013 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8967f-ebb4-48d7-b198-ec3bb8c3ac47 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.385230 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 813/1599] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:44.385230 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8dd69-01d6-41b1-9bb8-44c7dc1d946c admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.388485 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8967f-ebb4-48d7-b198-ec3bb8c3ac47 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.393134 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8dd69-01d6-41b1-9bb8-44c7dc1d946c admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.393513 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd2b18-8952-47cf-9fce-7ad99853cac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.394144 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd2b18-8952-47cf-9fce-7ad99853cac6 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.394426 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd2b18-8952-47cf-9fce-7ad99853cac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.394730 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dd2b18-8952-47cf-9fce-7ad99853cac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.395521 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd2b18-8952-47cf-9fce-7ad99853cac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.397389 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dd2b18-8952-47cf-9fce-7ad99853cac6 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.397666 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699694f-b45a-4230-a068-421712a5c6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.398295 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699694f-b45a-4230-a068-421712a5c6fb admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.398579 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699694f-b45a-4230-a068-421712a5c6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.398894 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c699694f-b45a-4230-a068-421712a5c6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.399596 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699694f-b45a-4230-a068-421712a5c6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.401159 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c699694f-b45a-4230-a068-421712a5c6fb admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.411271 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 814/1600] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:44.412065 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699694f-b45a-4230-a068-421712a5c6fb admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.421765 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c699694f-b45a-4230-a068-421712a5c6fb admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.423741 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 787/1601] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:50:44 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:44.424460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd2b18-8952-47cf-9fce-7ad99853cac6 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.476548 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906e177-6277-44c0-a264-22f15db099d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.477424 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906e177-6277-44c0-a264-22f15db099d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.477705 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906e177-6277-44c0-a264-22f15db099d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.477976 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a906e177-6277-44c0-a264-22f15db099d0 admin admin] PATH_INFO: `/v3/projects/d32ccfb9c3574946a051d337dd313f05/users/101a86726b0c407996de8858af3cdabb/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.484582 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dd2b18-8952-47cf-9fce-7ad99853cac6 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.489305 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b3f05-f4e2-4db6-96ea-d8bb0b94e0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.489957 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b3f05-f4e2-4db6-96ea-d8bb0b94e0bc admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.490250 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b3f05-f4e2-4db6-96ea-d8bb0b94e0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.490520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b3f05-f4e2-4db6-96ea-d8bb0b94e0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.491271 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b3f05-f4e2-4db6-96ea-d8bb0b94e0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.491513 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906e177-6277-44c0-a264-22f15db099d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32ccfb9c3574946a051d337dd313f05, user_id=101a86726b0c407996de8858af3cdabb, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.493112 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3b3f05-f4e2-4db6-96ea-d8bb0b94e0bc admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.494810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a906e177-6277-44c0-a264-22f15db099d0 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.503856 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 788/1602] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:44.504826 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54759c2-2762-4b08-abe5-607905ef3475 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.505114 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54759c2-2762-4b08-abe5-607905ef3475 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.505395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54759c2-2762-4b08-abe5-607905ef3475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.514931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 815/1603] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:44 2022] PUT /identity/v3/projects/d32ccfb9c3574946a051d337dd313f05/users/101a86726b0c407996de8858af3cdabb/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:44.515752 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906e177-6277-44c0-a264-22f15db099d0 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.524028 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b54759c2-2762-4b08-abe5-607905ef3475 None None] MFA Rules not processed for user `ba3665d046864985916fdd6c4a4edcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:44.525212 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b54759c2-2762-4b08-abe5-607905ef3475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:44.572283 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a906e177-6277-44c0-a264-22f15db099d0 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.575891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac86c9-d96c-4c8c-8fe4-ee3ad9418fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.576528 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac86c9-d96c-4c8c-8fe4-ee3ad9418fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.576812 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac86c9-d96c-4c8c-8fe4-ee3ad9418fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.577087 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac86c9-d96c-4c8c-8fe4-ee3ad9418fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.589294 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 789/1604] 10.222.0.73 () {58 vars in 1057 bytes} [Mon Apr 11 16:50:44 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:44.589963 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54759c2-2762-4b08-abe5-607905ef3475 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.635878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac86c9-d96c-4c8c-8fe4-ee3ad9418fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.637596 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac86c9-d96c-4c8c-8fe4-ee3ad9418fa5 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.647014 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 816/1605] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:44.647852 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac86c9-d96c-4c8c-8fe4-ee3ad9418fa5 service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.649582 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54759c2-2762-4b08-abe5-607905ef3475 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.654420 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74464db1-3a4b-4c2e-83ed-4cac9646b5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.655170 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74464db1-3a4b-4c2e-83ed-4cac9646b5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.655516 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74464db1-3a4b-4c2e-83ed-4cac9646b5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.655889 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74464db1-3a4b-4c2e-83ed-4cac9646b5a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.656681 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74464db1-3a4b-4c2e-83ed-4cac9646b5a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.656809 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac86c9-d96c-4c8c-8fe4-ee3ad9418fa5 service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.658730 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74464db1-3a4b-4c2e-83ed-4cac9646b5a0 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.661494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670f831-5d77-4404-8c72-7f1c1da28926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.662361 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670f831-5d77-4404-8c72-7f1c1da28926 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.662939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670f831-5d77-4404-8c72-7f1c1da28926 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.662939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670f831-5d77-4404-8c72-7f1c1da28926 admin admin] PATH_INFO: `/v3/projects/3796273a118e4a70b3f8097ef40525db/users/0bb6781028b743baa3538f5298a37d8d/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.673261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 790/1606] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:44.673261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74464db1-3a4b-4c2e-83ed-4cac9646b5a0 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.681118 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670f831-5d77-4404-8c72-7f1c1da28926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3796273a118e4a70b3f8097ef40525db, user_id=0bb6781028b743baa3538f5298a37d8d, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.681807 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74464db1-3a4b-4c2e-83ed-4cac9646b5a0 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.683818 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670f831-5d77-4404-8c72-7f1c1da28926 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.686495 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a07cd-1659-4a9a-999b-38400a9d8633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.687423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a07cd-1659-4a9a-999b-38400a9d8633 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.687723 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a07cd-1659-4a9a-999b-38400a9d8633 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.688002 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a07cd-1659-4a9a-999b-38400a9d8633 admin admin] PATH_INFO: `/v3/projects/28c4fb270b99427b9fb085597e134917/users/8ff2ac0b68d1414fb72955edc07ee3fd/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.697936 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 817/1607] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:44 2022] PUT /identity/v3/projects/3796273a118e4a70b3f8097ef40525db/users/0bb6781028b743baa3538f5298a37d8d/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:44.699008 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670f831-5d77-4404-8c72-7f1c1da28926 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.709153 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a07cd-1659-4a9a-999b-38400a9d8633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28c4fb270b99427b9fb085597e134917, user_id=8ff2ac0b68d1414fb72955edc07ee3fd, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.712242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a07cd-1659-4a9a-999b-38400a9d8633 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.730759 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 791/1608] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:44 2022] PUT /identity/v3/projects/28c4fb270b99427b9fb085597e134917/users/8ff2ac0b68d1414fb72955edc07ee3fd/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:44.732819 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a07cd-1659-4a9a-999b-38400a9d8633 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.764437 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670f831-5d77-4404-8c72-7f1c1da28926 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.802268 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a07cd-1659-4a9a-999b-38400a9d8633 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.807463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac1069-cf25-4d6d-98bc-810a618ef39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.808352 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac1069-cf25-4d6d-98bc-810a618ef39d admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.808633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac1069-cf25-4d6d-98bc-810a618ef39d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.808934 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac1069-cf25-4d6d-98bc-810a618ef39d admin admin] PATH_INFO: `/v3/projects/4c1eaeb25dca40618827018a56b90f68/users/710b76532ab64b3f9e5e6917a714694c/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.824112 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac1069-cf25-4d6d-98bc-810a618ef39d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1eaeb25dca40618827018a56b90f68, user_id=710b76532ab64b3f9e5e6917a714694c, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.826803 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac1069-cf25-4d6d-98bc-810a618ef39d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.833420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be63be8-5197-47ca-a27b-b196c1b03073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.834248 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be63be8-5197-47ca-a27b-b196c1b03073 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.834689 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be63be8-5197-47ca-a27b-b196c1b03073 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.835116 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be63be8-5197-47ca-a27b-b196c1b03073 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.835878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be63be8-5197-47ca-a27b-b196c1b03073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:44.838059 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be63be8-5197-47ca-a27b-b196c1b03073 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:44.851653 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 792/1609] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:44 2022] PUT /identity/v3/projects/4c1eaeb25dca40618827018a56b90f68/users/710b76532ab64b3f9e5e6917a714694c/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:44.864027 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2236fc-5d22-4738-948e-2b37ae82035d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.864498 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2236fc-5d22-4738-948e-2b37ae82035d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.865045 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2236fc-5d22-4738-948e-2b37ae82035d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:44.868224 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 818/1610] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:50:44 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:44.869251 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be63be8-5197-47ca-a27b-b196c1b03073 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.890099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6f2236fc-5d22-4738-948e-2b37ae82035d None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:44.891262 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6f2236fc-5d22-4738-948e-2b37ae82035d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:44.948909 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be63be8-5197-47ca-a27b-b196c1b03073 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.964147 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 793/1611] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:44.965339 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2236fc-5d22-4738-948e-2b37ae82035d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:44.989856 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2236fc-5d22-4738-948e-2b37ae82035d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:44.996504 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba852f1c-a24c-4d6b-8524-60f314c1ce53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:44.997792 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba852f1c-a24c-4d6b-8524-60f314c1ce53 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:44.998237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba852f1c-a24c-4d6b-8524-60f314c1ce53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:44.998686 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba852f1c-a24c-4d6b-8524-60f314c1ce53 admin admin] PATH_INFO: `/v3/projects/6713521d2d30444e80af185f9f7c05dd/users/51ddbfe7d6004b79b52f2625f88a9656/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:45.019080 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba852f1c-a24c-4d6b-8524-60f314c1ce53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6713521d2d30444e80af185f9f7c05dd, user_id=51ddbfe7d6004b79b52f2625f88a9656, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:45.022756 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba852f1c-a24c-4d6b-8524-60f314c1ce53 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:45.029193 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133898b9-4f58-41d2-9202-1c09e173089d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:45.029854 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133898b9-4f58-41d2-9202-1c09e173089d service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:45.030271 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133898b9-4f58-41d2-9202-1c09e173089d service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:45.030486 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133898b9-4f58-41d2-9202-1c09e173089d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:45.049536 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 794/1612] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:44 2022] PUT /identity/v3/projects/6713521d2d30444e80af185f9f7c05dd/users/51ddbfe7d6004b79b52f2625f88a9656/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:45.050628 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717be192-937f-44e6-ae41-f79162ea56c2 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:45.050926 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717be192-937f-44e6-ae41-f79162ea56c2 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:45.051207 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717be192-937f-44e6-ae41-f79162ea56c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:45.084975 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-717be192-937f-44e6-ae41-f79162ea56c2 None None] MFA Rules not processed for user `0bb6781028b743baa3538f5298a37d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:45.095948 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-717be192-937f-44e6-ae41-f79162ea56c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:45.119645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133898b9-4f58-41d2-9202-1c09e173089d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:45.121507 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133898b9-4f58-41d2-9202-1c09e173089d service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:45.132759 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 819/1613] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:45.134225 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b1411-f92f-4102-a414-89e7192df9bf None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:45.134582 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b1411-f92f-4102-a414-89e7192df9bf None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:45.134955 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b1411-f92f-4102-a414-89e7192df9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:45.153301 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-1e7b1411-f92f-4102-a414-89e7192df9bf None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:45.154523 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-1e7b1411-f92f-4102-a414-89e7192df9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:45.178560 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 795/1614] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:45.180340 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4870bf-c594-4101-82a2-f03338dc544c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:45.181037 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4870bf-c594-4101-82a2-f03338dc544c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:45.181500 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4870bf-c594-4101-82a2-f03338dc544c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:45.208594 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ca4870bf-c594-4101-82a2-f03338dc544c None None] MFA Rules not processed for user `710b76532ab64b3f9e5e6917a714694c`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:45.210051 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ca4870bf-c594-4101-82a2-f03338dc544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:45.228122 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 820/1615] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:45.228901 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b1411-f92f-4102-a414-89e7192df9bf None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:45.247787 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b1411-f92f-4102-a414-89e7192df9bf None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:45.253137 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d78b2e-7850-4842-ad0b-be8d835f9481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:45.253808 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d78b2e-7850-4842-ad0b-be8d835f9481 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:45.254089 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d78b2e-7850-4842-ad0b-be8d835f9481 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:45.254366 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d78b2e-7850-4842-ad0b-be8d835f9481 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:45.255947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d78b2e-7850-4842-ad0b-be8d835f9481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:45.258662 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d78b2e-7850-4842-ad0b-be8d835f9481 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:45.269969 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 821/1616] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:45.270847 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d78b2e-7850-4842-ad0b-be8d835f9481 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:45.274188 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f9d78b2e-7850-4842-ad0b-be8d835f9481 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:45.299261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 796/1617] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:45.300642 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a2398-8e48-403e-b1dc-3fb99233d3ae None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:45.301020 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a2398-8e48-403e-b1dc-3fb99233d3ae None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:45.304027 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a2398-8e48-403e-b1dc-3fb99233d3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:45.335835 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-917a2398-8e48-403e-b1dc-3fb99233d3ae None None] MFA Rules not processed for user `51ddbfe7d6004b79b52f2625f88a9656`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:45.337043 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-917a2398-8e48-403e-b1dc-3fb99233d3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:45.348162 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d78b2e-7850-4842-ad0b-be8d835f9481 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:45.353524 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65d8ce-6d73-4bbc-a7ac-009de64f9282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:45.354258 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65d8ce-6d73-4bbc-a7ac-009de64f9282 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:45.354630 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65d8ce-6d73-4bbc-a7ac-009de64f9282 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:45.354979 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc65d8ce-6d73-4bbc-a7ac-009de64f9282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:45.367985 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65d8ce-6d73-4bbc-a7ac-009de64f9282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:45.370962 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc65d8ce-6d73-4bbc-a7ac-009de64f9282 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:45.391333 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 822/1618] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:45.392486 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65d8ce-6d73-4bbc-a7ac-009de64f9282 service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:45.409047 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc65d8ce-6d73-4bbc-a7ac-009de64f9282 service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:45.416692 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 797/1619] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:45.417707 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a2398-8e48-403e-b1dc-3fb99233d3ae None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:45.425860 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8eaae5-648a-4d76-ac39-7a0d583d8c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:45.429589 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8eaae5-648a-4d76-ac39-7a0d583d8c40 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:45.429871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8eaae5-648a-4d76-ac39-7a0d583d8c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:45.430147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8eaae5-648a-4d76-ac39-7a0d583d8c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:45.430877 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8eaae5-648a-4d76-ac39-7a0d583d8c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:45.431662 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a2398-8e48-403e-b1dc-3fb99233d3ae None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:45.432831 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8eaae5-648a-4d76-ac39-7a0d583d8c40 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:45.438867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22476e23-6aac-4068-9f59-19ce4ca81d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:45.440454 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22476e23-6aac-4068-9f59-19ce4ca81d22 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:45.440997 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22476e23-6aac-4068-9f59-19ce4ca81d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:45.441585 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22476e23-6aac-4068-9f59-19ce4ca81d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:45.457802 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22476e23-6aac-4068-9f59-19ce4ca81d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:45.459824 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22476e23-6aac-4068-9f59-19ce4ca81d22 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:45.467173 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 823/1620] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:50:45 2022] POST /identity/v3/projects => generated 369 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:45.468120 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8eaae5-648a-4d76-ac39-7a0d583d8c40 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:45.473095 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 798/1621] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:45.474818 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dcf85-0201-4494-8754-939989af13b2 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:45.475174 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dcf85-0201-4494-8754-939989af13b2 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:45.476265 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9dcf85-0201-4494-8754-939989af13b2 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:45.478704 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 799/1622] 10.222.0.73 () {54 vars in 960 bytes} [Mon Apr 11 16:50:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:50:45.479302 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dcf85-0201-4494-8754-939989af13b2 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:45.600279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9dcf85-0201-4494-8754-939989af13b2 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:45.611333 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8eaae5-648a-4d76-ac39-7a0d583d8c40 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:45.615889 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc5f73-5b7e-49d9-88e6-1305f43ccd60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:45.617526 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc5f73-5b7e-49d9-88e6-1305f43ccd60 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:45.619306 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc5f73-5b7e-49d9-88e6-1305f43ccd60 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:45.620590 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc5f73-5b7e-49d9-88e6-1305f43ccd60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:45.625202 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06740a4-59ae-441b-9d71-d83c2df4eed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:45.627584 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06740a4-59ae-441b-9d71-d83c2df4eed7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:45.628777 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06740a4-59ae-441b-9d71-d83c2df4eed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:45.630246 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06740a4-59ae-441b-9d71-d83c2df4eed7 admin admin] PATH_INFO: `/v3/projects/fa782cc01e5f4ae3a8d1953a4ca5f477/users/f976017786a94e899ec1eb6a34ac0a0a/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:45.662192 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06740a4-59ae-441b-9d71-d83c2df4eed7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa782cc01e5f4ae3a8d1953a4ca5f477, user_id=f976017786a94e899ec1eb6a34ac0a0a, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:45.666846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06740a4-59ae-441b-9d71-d83c2df4eed7 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:45.700486 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 824/1623] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:45 2022] PUT /identity/v3/projects/fa782cc01e5f4ae3a8d1953a4ca5f477/users/f976017786a94e899ec1eb6a34ac0a0a/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:45.701587 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06740a4-59ae-441b-9d71-d83c2df4eed7 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:45.738489 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc5f73-5b7e-49d9-88e6-1305f43ccd60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:45.740689 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc5f73-5b7e-49d9-88e6-1305f43ccd60 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:45.777241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 800/1624] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:45.779062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3b9af-e1bf-4f18-9e14-cc950a1de478 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:45.779351 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3b9af-e1bf-4f18-9e14-cc950a1de478 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:45.779625 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3b9af-e1bf-4f18-9e14-cc950a1de478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:45.832409 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c6e3b9af-e1bf-4f18-9e14-cc950a1de478 None None] MFA Rules not processed for user `ba3665d046864985916fdd6c4a4edcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:45.835070 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c6e3b9af-e1bf-4f18-9e14-cc950a1de478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:45.854462 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06740a4-59ae-441b-9d71-d83c2df4eed7 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:45.864563 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88441009-be9d-432c-acab-d77b473b2ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:45.865256 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88441009-be9d-432c-acab-d77b473b2ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:45.865684 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88441009-be9d-432c-acab-d77b473b2ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:45.866015 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88441009-be9d-432c-acab-d77b473b2ef8 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:45.866744 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88441009-be9d-432c-acab-d77b473b2ef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:45.873003 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88441009-be9d-432c-acab-d77b473b2ef8 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:45.915202 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 825/1625] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:50:45 2022] POST /identity/v3/users => generated 291 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:45.916265 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88441009-be9d-432c-acab-d77b473b2ef8 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:45.939723 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88441009-be9d-432c-acab-d77b473b2ef8 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:45.952880 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f807b-67b5-4568-963c-4eb1997d5481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:45.956160 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f807b-67b5-4568-963c-4eb1997d5481 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:45.956787 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f807b-67b5-4568-963c-4eb1997d5481 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:45.957300 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f807b-67b5-4568-963c-4eb1997d5481 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:45.958424 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f807b-67b5-4568-963c-4eb1997d5481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:45.960807 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f807b-67b5-4568-963c-4eb1997d5481 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:45.963421 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 801/1626] 10.222.0.73 () {58 vars in 1057 bytes} [Mon Apr 11 16:50:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:45.964821 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803c41-e686-4227-86ed-ec1a9faecf36 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:45.965111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803c41-e686-4227-86ed-ec1a9faecf36 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:45.965390 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82803c41-e686-4227-86ed-ec1a9faecf36 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:45.974177 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 802/1627] 10.222.0.73 () {54 vars in 912 bytes} [Mon Apr 11 16:50:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:50:45.975074 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82803c41-e686-4227-86ed-ec1a9faecf36 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:45.989831 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 826/1628] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:45.991278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f807b-67b5-4568-963c-4eb1997d5481 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:46.011103 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f807b-67b5-4568-963c-4eb1997d5481 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:46.012728 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82803c41-e686-4227-86ed-ec1a9faecf36 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:46.020003 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c018ff-0385-4889-a30d-4096136d036f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:46.020687 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c018ff-0385-4889-a30d-4096136d036f admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:46.020970 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c018ff-0385-4889-a30d-4096136d036f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:46.021246 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c018ff-0385-4889-a30d-4096136d036f admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:46.022556 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c018ff-0385-4889-a30d-4096136d036f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:46.023359 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2b0dd-4171-407d-bcf2-e0c1ebe2110a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:46.024212 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c018ff-0385-4889-a30d-4096136d036f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:46.024351 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2b0dd-4171-407d-bcf2-e0c1ebe2110a service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:46.025637 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2b0dd-4171-407d-bcf2-e0c1ebe2110a service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:46.026056 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2b0dd-4171-407d-bcf2-e0c1ebe2110a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:46.065807 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 803/1629] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:46.065807 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2d7b2-8404-4a70-9384-7b86afebc771 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:46.068712 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2d7b2-8404-4a70-9384-7b86afebc771 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:46.069036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2d7b2-8404-4a70-9384-7b86afebc771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:46.103520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f2b2d7b2-8404-4a70-9384-7b86afebc771 None None] MFA Rules not processed for user `ba3665d046864985916fdd6c4a4edcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:46.105351 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f2b2d7b2-8404-4a70-9384-7b86afebc771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:46.117275 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 804/1630] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Apr 11 16:50:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:46.117972 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2d7b2-8404-4a70-9384-7b86afebc771 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:46.138348 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2d7b2-8404-4a70-9384-7b86afebc771 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:46.144297 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6100eac-8d09-4dc0-b59e-d4b17cb438f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:46.145255 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6100eac-8d09-4dc0-b59e-d4b17cb438f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:46.145582 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6100eac-8d09-4dc0-b59e-d4b17cb438f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:46.145859 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6100eac-8d09-4dc0-b59e-d4b17cb438f8 admin admin] PATH_INFO: `/v3/projects/fa782cc01e5f4ae3a8d1953a4ca5f477/users/f976017786a94e899ec1eb6a34ac0a0a/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:46.148439 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6100eac-8d09-4dc0-b59e-d4b17cb438f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa782cc01e5f4ae3a8d1953a4ca5f477, user_id=f976017786a94e899ec1eb6a34ac0a0a, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:46.151237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6100eac-8d09-4dc0-b59e-d4b17cb438f8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:46.156692 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2b0dd-4171-407d-bcf2-e0c1ebe2110a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:46.162670 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2b0dd-4171-407d-bcf2-e0c1ebe2110a service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:46.163736 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 805/1631] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:46 2022] PUT /identity/v3/projects/fa782cc01e5f4ae3a8d1953a4ca5f477/users/f976017786a94e899ec1eb6a34ac0a0a/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:46.165062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6100eac-8d09-4dc0-b59e-d4b17cb438f8 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:46.185794 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 827/1632] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:46.187168 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2b0dd-4171-407d-bcf2-e0c1ebe2110a service nova] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:46.252706 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2b0dd-4171-407d-bcf2-e0c1ebe2110a service nova] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:46.305996 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6100eac-8d09-4dc0-b59e-d4b17cb438f8 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:46.313410 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac2b2c1-1a3a-466b-9574-30cb4774274c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:46.315106 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2b2c1-1a3a-466b-9574-30cb4774274c admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:46.315635 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2b2c1-1a3a-466b-9574-30cb4774274c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:46.316190 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac2b2c1-1a3a-466b-9574-30cb4774274c admin admin] PATH_INFO: `/v3/projects/3a81f45a39c54381906d4ca1b3d60275/users/7bb85fd8a9974fffb4f483f0838189a1/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:46.343608 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c3095-aea2-4173-9945-8716155a02b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:46.344694 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c3095-aea2-4173-9945-8716155a02b7 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:46.344989 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c3095-aea2-4173-9945-8716155a02b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:46.345272 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6c3095-aea2-4173-9945-8716155a02b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:46.347317 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2b2c1-1a3a-466b-9574-30cb4774274c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a81f45a39c54381906d4ca1b3d60275, user_id=7bb85fd8a9974fffb4f483f0838189a1, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:46.351612 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac2b2c1-1a3a-466b-9574-30cb4774274c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:46.379916 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 806/1633] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:46 2022] PUT /identity/v3/projects/3a81f45a39c54381906d4ca1b3d60275/users/7bb85fd8a9974fffb4f483f0838189a1/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:46.382445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b1895-370a-4cfd-98cb-218571b1b374 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:46.383511 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b1895-370a-4cfd-98cb-218571b1b374 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:46.385530 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b1895-370a-4cfd-98cb-218571b1b374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:46.457181 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3b0b1895-370a-4cfd-98cb-218571b1b374 None None] MFA Rules not processed for user `f976017786a94e899ec1eb6a34ac0a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:46.458418 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3b0b1895-370a-4cfd-98cb-218571b1b374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:46.469438 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c3095-aea2-4173-9945-8716155a02b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:46.472631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6c3095-aea2-4173-9945-8716155a02b7 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:46.505251 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 828/1634] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:46.516192 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c3095-aea2-4173-9945-8716155a02b7 service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:46.551196 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6c3095-aea2-4173-9945-8716155a02b7 service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:46.682800 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 807/1635] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:46.691067 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a77e9-68f9-490b-9c90-937777ebc048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:46.691769 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a77e9-68f9-490b-9c90-937777ebc048 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:46.692356 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a77e9-68f9-490b-9c90-937777ebc048 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:46.692642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a77e9-68f9-490b-9c90-937777ebc048 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:46.693376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a77e9-68f9-490b-9c90-937777ebc048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:46.695038 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7a77e9-68f9-490b-9c90-937777ebc048 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:46.697242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b1895-370a-4cfd-98cb-218571b1b374 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:46.711934 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 829/1636] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:46.713161 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a77e9-68f9-490b-9c90-937777ebc048 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:46.723822 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a77e9-68f9-490b-9c90-937777ebc048 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:46.730547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada8e7b3-2aa4-4c67-b466-917d2703587c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:46.732481 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8e7b3-2aa4-4c67-b466-917d2703587c admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:46.733273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8e7b3-2aa4-4c67-b466-917d2703587c admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:46.733772 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada8e7b3-2aa4-4c67-b466-917d2703587c admin admin] PATH_INFO: `/v3/projects/3a81f45a39c54381906d4ca1b3d60275/users/7bb85fd8a9974fffb4f483f0838189a1/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:46.736718 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8e7b3-2aa4-4c67-b466-917d2703587c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a81f45a39c54381906d4ca1b3d60275, user_id=7bb85fd8a9974fffb4f483f0838189a1, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:46.739944 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada8e7b3-2aa4-4c67-b466-917d2703587c admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:46.765715 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 830/1637] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:46 2022] PUT /identity/v3/projects/3a81f45a39c54381906d4ca1b3d60275/users/7bb85fd8a9974fffb4f483f0838189a1/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:46.768276 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2b0a9-8cc0-421e-84a4-19b210332a27 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:46.768729 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2b0a9-8cc0-421e-84a4-19b210332a27 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:46.769115 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed2b0a9-8cc0-421e-84a4-19b210332a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:46.801286 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-aed2b0a9-8cc0-421e-84a4-19b210332a27 None None] MFA Rules not processed for user `7bb85fd8a9974fffb4f483f0838189a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:46.802685 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-aed2b0a9-8cc0-421e-84a4-19b210332a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:46.841516 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b1895-370a-4cfd-98cb-218571b1b374 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:46.914022 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 831/1638] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:46 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:46.915676 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01be946-c23c-4a31-88b6-b7be22a34764 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:46.916512 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01be946-c23c-4a31-88b6-b7be22a34764 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:46.916512 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01be946-c23c-4a31-88b6-b7be22a34764 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:46.919043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 832/1639] 10.222.0.73 () {54 vars in 912 bytes} [Mon Apr 11 16:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:50:46.927806 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe566f5-385b-40d2-a1e7-fdd36bd0e1b7 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:46.928429 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe566f5-385b-40d2-a1e7-fdd36bd0e1b7 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:46.929917 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe566f5-385b-40d2-a1e7-fdd36bd0e1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:46.959423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105d1bc-574f-42ce-9ab1-31f9adb97452 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:46.960108 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105d1bc-574f-42ce-9ab1-31f9adb97452 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:46.960398 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105d1bc-574f-42ce-9ab1-31f9adb97452 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:46.960679 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105d1bc-574f-42ce-9ab1-31f9adb97452 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:46.983131 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-ffe566f5-385b-40d2-a1e7-fdd36bd0e1b7 None None] MFA Rules not processed for user `ba3665d046864985916fdd6c4a4edcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:46.986331 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-ffe566f5-385b-40d2-a1e7-fdd36bd0e1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:47.077517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 833/1640] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Apr 11 16:50:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:47.086724 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105d1bc-574f-42ce-9ab1-31f9adb97452 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:47.088836 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105d1bc-574f-42ce-9ab1-31f9adb97452 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:47.114889 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 808/1641] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:50:47.210777 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe566f5-385b-40d2-a1e7-fdd36bd0e1b7 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:47.229936 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe566f5-385b-40d2-a1e7-fdd36bd0e1b7 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:47.244164 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2345f0-4d10-4403-aeff-dd5e5790c34c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:47.245726 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2345f0-4d10-4403-aeff-dd5e5790c34c service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:47.246087 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2345f0-4d10-4403-aeff-dd5e5790c34c service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:47.246564 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2345f0-4d10-4403-aeff-dd5e5790c34c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:47.273724 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2345f0-4d10-4403-aeff-dd5e5790c34c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:47.275312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2345f0-4d10-4403-aeff-dd5e5790c34c service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:47.277673 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8be339-150f-41bd-a465-c840e17b1a61 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:47.278034 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8be339-150f-41bd-a465-c840e17b1a61 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:47.278320 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8be339-150f-41bd-a465-c840e17b1a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:47.309988 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 834/1642] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:47 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:47.340796 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-8a8be339-150f-41bd-a465-c840e17b1a61 None None] MFA Rules not processed for user `101a86726b0c407996de8858af3cdabb`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:47.342037 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8a8be339-150f-41bd-a465-c840e17b1a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:47.399170 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2345f0-4d10-4403-aeff-dd5e5790c34c service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:47.408718 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2345f0-4d10-4403-aeff-dd5e5790c34c service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:47.419374 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00011a-6018-4dc7-84c4-34f1668183a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:47.420500 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00011a-6018-4dc7-84c4-34f1668183a2 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:47.420500 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00011a-6018-4dc7-84c4-34f1668183a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:47.420741 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00011a-6018-4dc7-84c4-34f1668183a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:47.438257 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00011a-6018-4dc7-84c4-34f1668183a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:47.440600 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00011a-6018-4dc7-84c4-34f1668183a2 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:47.454739 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 835/1643] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:47.538750 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 809/1644] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:50:47.550368 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca50a92-3425-44dc-ae64-68491f9c400b None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:47.550717 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca50a92-3425-44dc-ae64-68491f9c400b None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:47.550965 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca50a92-3425-44dc-ae64-68491f9c400b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:47.584619 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-8ca50a92-3425-44dc-ae64-68491f9c400b None None] MFA Rules not processed for user `101a86726b0c407996de8858af3cdabb`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:47.585763 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-8ca50a92-3425-44dc-ae64-68491f9c400b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:47.613110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 836/1645] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:47.820386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8be339-150f-41bd-a465-c840e17b1a61 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:47.839955 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8be339-150f-41bd-a465-c840e17b1a61 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:47.850259 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec0c21-f58e-4dbe-adfa-70361f8cfbc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:47.851256 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec0c21-f58e-4dbe-adfa-70361f8cfbc8 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:47.851546 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec0c21-f58e-4dbe-adfa-70361f8cfbc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:47.853170 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca50a92-3425-44dc-ae64-68491f9c400b None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:47.862998 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec0c21-f58e-4dbe-adfa-70361f8cfbc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:47.873771 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca50a92-3425-44dc-ae64-68491f9c400b None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:47.909691 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d3b4d2-b626-40a2-98f6-80aefe95888a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:47.910342 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3b4d2-b626-40a2-98f6-80aefe95888a service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:47.910647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3b4d2-b626-40a2-98f6-80aefe95888a service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:47.910927 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d3b4d2-b626-40a2-98f6-80aefe95888a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:47.948867 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3b4d2-b626-40a2-98f6-80aefe95888a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:47.951853 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d3b4d2-b626-40a2-98f6-80aefe95888a service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:47.999333 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 837/1646] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:48.092048 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec0c21-f58e-4dbe-adfa-70361f8cfbc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:48.099184 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec0c21-f58e-4dbe-adfa-70361f8cfbc8 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:48.169464 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 810/1647] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:48.968671 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501123f1-c7b9-44d2-ade0-7b865e476e41 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:48.969573 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501123f1-c7b9-44d2-ade0-7b865e476e41 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:48.970060 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501123f1-c7b9-44d2-ade0-7b865e476e41 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:48.972690 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 838/1648] 10.222.0.73 () {54 vars in 912 bytes} [Mon Apr 11 16:50:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:50:48.979937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc6972-8c67-4be0-b759-450cbeaf5228 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:48.980507 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc6972-8c67-4be0-b759-450cbeaf5228 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:48.980729 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc6972-8c67-4be0-b759-450cbeaf5228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:49.036310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501123f1-c7b9-44d2-ade0-7b865e476e41 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:49.090448 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-fdcc6972-8c67-4be0-b759-450cbeaf5228 None None] MFA Rules not processed for user `7990c92f59454156bbd99445387ca889`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:49.099533 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-fdcc6972-8c67-4be0-b759-450cbeaf5228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:49.226213 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501123f1-c7b9-44d2-ade0-7b865e476e41 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:49.233949 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153a9d0-ac5f-4c08-a5a6-5d07bd8bd409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:49.235552 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153a9d0-ac5f-4c08-a5a6-5d07bd8bd409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:49.236827 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153a9d0-ac5f-4c08-a5a6-5d07bd8bd409 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:49.237283 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6153a9d0-ac5f-4c08-a5a6-5d07bd8bd409 admin admin] PATH_INFO: `/v3/users/f202c393a41544debfc5a6faf7281b18` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:49.240741 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153a9d0-ac5f-4c08-a5a6-5d07bd8bd409 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f202c393a41544debfc5a6faf7281b18)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:49.243010 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6153a9d0-ac5f-4c08-a5a6-5d07bd8bd409 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:49.245510 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 811/1649] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Apr 11 16:50:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:49.335736 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6153a9d0-ac5f-4c08-a5a6-5d07bd8bd409 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f202c393a41544debfc5a6faf7281b18'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:49.337201 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6153a9d0-ac5f-4c08-a5a6-5d07bd8bd409 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f202c393a41544debfc5a6faf7281b18'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:49.344702 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc6972-8c67-4be0-b759-450cbeaf5228 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:49.354173 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6153a9d0-ac5f-4c08-a5a6-5d07bd8bd409 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f202c393a41544debfc5a6faf7281b18'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:49.359307 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc6972-8c67-4be0-b759-450cbeaf5228 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:49.364305 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27933a0-c365-4bb5-a91e-456b588d8d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:49.365139 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27933a0-c365-4bb5-a91e-456b588d8d68 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:49.365421 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27933a0-c365-4bb5-a91e-456b588d8d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:49.365584 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6153a9d0-ac5f-4c08-a5a6-5d07bd8bd409 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f202c393a41544debfc5a6faf7281b18'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:49.365783 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27933a0-c365-4bb5-a91e-456b588d8d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:49.397932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27933a0-c365-4bb5-a91e-456b588d8d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:49.401694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27933a0-c365-4bb5-a91e-456b588d8d68 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:49.405520 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6153a9d0-ac5f-4c08-a5a6-5d07bd8bd409 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f202c393a41544debfc5a6faf7281b18'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:49.423790 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 812/1650] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:50:49.426636 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 839/1651] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:50:49 2022] DELETE /identity/v3/users/f202c393a41544debfc5a6faf7281b18 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:49.431387 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b7806-8421-4e6c-b3eb-629c84bdc51f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:49.431908 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b7806-8421-4e6c-b3eb-629c84bdc51f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:49.432342 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b7806-8421-4e6c-b3eb-629c84bdc51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:49.494454 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3b5b7806-8421-4e6c-b3eb-629c84bdc51f None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:49.498996 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3b5b7806-8421-4e6c-b3eb-629c84bdc51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:49.670366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 813/1652] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:49.818414 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153a9d0-ac5f-4c08-a5a6-5d07bd8bd409 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:49.819923 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-6153a9d0-ac5f-4c08-a5a6-5d07bd8bd409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:50.022240 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6153a9d0-ac5f-4c08-a5a6-5d07bd8bd409 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:50.038727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7ce81-5d91-431a-acf8-3731f1b3e21d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:50.040009 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7ce81-5d91-431a-acf8-3731f1b3e21d service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:50.040573 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7ce81-5d91-431a-acf8-3731f1b3e21d service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:50.041069 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7ce81-5d91-431a-acf8-3731f1b3e21d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:50.096420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7ce81-5d91-431a-acf8-3731f1b3e21d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:50.098875 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7ce81-5d91-431a-acf8-3731f1b3e21d service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:50.119605 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 840/1653] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:51.296117 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b7806-8421-4e6c-b3eb-629c84bdc51f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:51.298264 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3b5b7806-8421-4e6c-b3eb-629c84bdc51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:51.317130 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b7806-8421-4e6c-b3eb-629c84bdc51f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:51.332139 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8da729-347d-4966-be33-7c379ea77bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:51.333658 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8da729-347d-4966-be33-7c379ea77bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:51.334133 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8da729-347d-4966-be33-7c379ea77bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:51.334710 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8da729-347d-4966-be33-7c379ea77bb3 admin admin] PATH_INFO: `/v3/projects/78ebf69e59e04deea8b3929482443b38` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:51.336710 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8da729-347d-4966-be33-7c379ea77bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78ebf69e59e04deea8b3929482443b38)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:51.338849 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8da729-347d-4966-be33-7c379ea77bb3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:51.343827 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53f9d2-3ca0-4100-aadb-2cfb3e1fd93d None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:51.344297 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53f9d2-3ca0-4100-aadb-2cfb3e1fd93d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:51.344649 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53f9d2-3ca0-4100-aadb-2cfb3e1fd93d None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:51.347072 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 841/1654] 10.222.0.73 () {54 vars in 960 bytes} [Mon Apr 11 16:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 16:50:51.358481 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b45717-d8db-4a6b-9dc5-71d3e3c13852 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:51.358927 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b45717-d8db-4a6b-9dc5-71d3e3c13852 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:51.359298 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b45717-d8db-4a6b-9dc5-71d3e3c13852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:51.414108 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-e8b45717-d8db-4a6b-9dc5-71d3e3c13852 None None] MFA Rules not processed for user `85f5ef8708f54401af7e8defa8d13141`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:51.415613 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-e8b45717-d8db-4a6b-9dc5-71d3e3c13852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:51.491855 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-aa8da729-347d-4966-be33-7c379ea77bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78ebf69e59e04deea8b3929482443b38', 'request_id': 'req-aa8da729-347d-4966-be33-7c379ea77bb3'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:51.499521 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-aa8da729-347d-4966-be33-7c379ea77bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78ebf69e59e04deea8b3929482443b38', 'request_id': 'req-aa8da729-347d-4966-be33-7c379ea77bb3'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:51.516083 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-aa8da729-347d-4966-be33-7c379ea77bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78ebf69e59e04deea8b3929482443b38', 'request_id': 'req-aa8da729-347d-4966-be33-7c379ea77bb3'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:51.556860 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-aa8da729-347d-4966-be33-7c379ea77bb3 admin admin] The token cache is being invalidate because project 78ebf69e59e04deea8b3929482443b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:50:51.557148 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-aa8da729-347d-4966-be33-7c379ea77bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:51.558292 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-aa8da729-347d-4966-be33-7c379ea77bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:51.561146 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 814/1655] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:50:51 2022] DELETE /identity/v3/projects/78ebf69e59e04deea8b3929482443b38 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:51.572557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f285b5-658b-4142-b362-5356127b0b95 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:51.574876 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f285b5-658b-4142-b362-5356127b0b95 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:51.575445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f285b5-658b-4142-b362-5356127b0b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:51.644831 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a5f285b5-658b-4142-b362-5356127b0b95 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:51.646076 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a5f285b5-658b-4142-b362-5356127b0b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:51.650266 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 842/1656] 10.222.0.73 () {58 vars in 1057 bytes} [Mon Apr 11 16:50:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:51.652437 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b45717-d8db-4a6b-9dc5-71d3e3c13852 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:51.655000 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-e8b45717-d8db-4a6b-9dc5-71d3e3c13852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:51.688908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b45717-d8db-4a6b-9dc5-71d3e3c13852 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:51.827778 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 815/1657] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:51.828784 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f285b5-658b-4142-b362-5356127b0b95 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:51.843872 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c6c67-9f5e-4155-b8f6-6719d611aeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:51.844785 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c6c67-9f5e-4155-b8f6-6719d611aeb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:51.845069 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c6c67-9f5e-4155-b8f6-6719d611aeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:51.848637 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c6c67-9f5e-4155-b8f6-6719d611aeb9 admin admin] PATH_INFO: `/v3/users/0bb6781028b743baa3538f5298a37d8d` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:51.854668 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c6c67-9f5e-4155-b8f6-6719d611aeb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb6781028b743baa3538f5298a37d8d)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:51.856678 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c6c67-9f5e-4155-b8f6-6719d611aeb9 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:52.028215 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-895c6c67-9f5e-4155-b8f6-6719d611aeb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb6781028b743baa3538f5298a37d8d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:52.032147 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f285b5-658b-4142-b362-5356127b0b95 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:52.033804 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-895c6c67-9f5e-4155-b8f6-6719d611aeb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb6781028b743baa3538f5298a37d8d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:52.033939 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b634466-f501-4cfd-bd91-b949c7a7bb19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f5ef8708f54401af7e8defa8d13141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:52.033939 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b634466-f501-4cfd-bd91-b949c7a7bb19 service placement] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:52.033939 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b634466-f501-4cfd-bd91-b949c7a7bb19 service placement] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:52.033939 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b634466-f501-4cfd-bd91-b949c7a7bb19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:52.034864 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3b634466-f501-4cfd-bd91-b949c7a7bb19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:52.035001 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-895c6c67-9f5e-4155-b8f6-6719d611aeb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb6781028b743baa3538f5298a37d8d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:52.049751 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b634466-f501-4cfd-bd91-b949c7a7bb19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:52.053236 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b634466-f501-4cfd-bd91-b949c7a7bb19 service placement] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:52.059537 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-895c6c67-9f5e-4155-b8f6-6719d611aeb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb6781028b743baa3538f5298a37d8d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:52.073918 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 816/1658] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:52.075591 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbd29c-ed62-4f99-bd38-6451745dad57 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:52.076010 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbd29c-ed62-4f99-bd38-6451745dad57 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:52.076438 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbd29c-ed62-4f99-bd38-6451745dad57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:52.096864 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-895c6c67-9f5e-4155-b8f6-6719d611aeb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb6781028b743baa3538f5298a37d8d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:52.101103 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-d9cbd29c-ed62-4f99-bd38-6451745dad57 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:52.102473 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d9cbd29c-ed62-4f99-bd38-6451745dad57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:52.108667 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 843/1659] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:50:51 2022] DELETE /identity/v3/users/0bb6781028b743baa3538f5298a37d8d => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:52.112407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c6c67-9f5e-4155-b8f6-6719d611aeb9 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:52.113869 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-895c6c67-9f5e-4155-b8f6-6719d611aeb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:52.121703 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 817/1660] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:52.130488 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb26688-6ab0-4a40-8749-b6c9e6f137fd None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:52.131344 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb26688-6ab0-4a40-8749-b6c9e6f137fd None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:52.131811 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb26688-6ab0-4a40-8749-b6c9e6f137fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:52.155411 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-2eb26688-6ab0-4a40-8749-b6c9e6f137fd None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:52.159309 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2eb26688-6ab0-4a40-8749-b6c9e6f137fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:52.232299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c6c67-9f5e-4155-b8f6-6719d611aeb9 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:52.238947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dba76-9faf-4b21-8cb7-867630be8997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:52.240613 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dba76-9faf-4b21-8cb7-867630be8997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:52.241390 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dba76-9faf-4b21-8cb7-867630be8997 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:52.241888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250dba76-9faf-4b21-8cb7-867630be8997 admin admin] PATH_INFO: `/v3/users/51ddbfe7d6004b79b52f2625f88a9656` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:52.244200 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dba76-9faf-4b21-8cb7-867630be8997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ddbfe7d6004b79b52f2625f88a9656)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:52.247215 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250dba76-9faf-4b21-8cb7-867630be8997 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:52.282056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 818/1661] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:52.284804 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb26688-6ab0-4a40-8749-b6c9e6f137fd None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:52.307930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb26688-6ab0-4a40-8749-b6c9e6f137fd None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:52.339780 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a07cf-397a-468c-bf6c-f3b59ab36065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:52.341244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a07cf-397a-468c-bf6c-f3b59ab36065 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:52.341683 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a07cf-397a-468c-bf6c-f3b59ab36065 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:52.342119 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098a07cf-397a-468c-bf6c-f3b59ab36065 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:52.343627 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a07cf-397a-468c-bf6c-f3b59ab36065 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:50:52.345966 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a07cf-397a-468c-bf6c-f3b59ab36065 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:52.350726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098a07cf-397a-468c-bf6c-f3b59ab36065 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:52.353435 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-250dba76-9faf-4b21-8cb7-867630be8997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ddbfe7d6004b79b52f2625f88a9656'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:52.355629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-250dba76-9faf-4b21-8cb7-867630be8997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ddbfe7d6004b79b52f2625f88a9656'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:52.387348 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-250dba76-9faf-4b21-8cb7-867630be8997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ddbfe7d6004b79b52f2625f88a9656'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:52.389568 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 819/1662] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:50:52.390483 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a07cf-397a-468c-bf6c-f3b59ab36065 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:52.397582 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-250dba76-9faf-4b21-8cb7-867630be8997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ddbfe7d6004b79b52f2625f88a9656'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:52.398017 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-098a07cf-397a-468c-bf6c-f3b59ab36065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:52.415107 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-250dba76-9faf-4b21-8cb7-867630be8997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ddbfe7d6004b79b52f2625f88a9656'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:52.448050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 844/1663] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:50:52 2022] DELETE /identity/v3/users/51ddbfe7d6004b79b52f2625f88a9656 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:52.448050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dba76-9faf-4b21-8cb7-867630be8997 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:52.450485 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-250dba76-9faf-4b21-8cb7-867630be8997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:52.482362 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098a07cf-397a-468c-bf6c-f3b59ab36065 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:52.587326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250dba76-9faf-4b21-8cb7-867630be8997 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:52.593692 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf305fd9-673d-4b64-9615-730c8a75a89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:52.594772 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf305fd9-673d-4b64-9615-730c8a75a89d admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:52.595122 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf305fd9-673d-4b64-9615-730c8a75a89d admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:52.595499 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf305fd9-673d-4b64-9615-730c8a75a89d admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:52.596757 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf305fd9-673d-4b64-9615-730c8a75a89d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:52.598808 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf305fd9-673d-4b64-9615-730c8a75a89d admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:52.607860 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a10ef7-96e0-4449-816e-7f528cc13164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:52.609017 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a10ef7-96e0-4449-816e-7f528cc13164 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:52.609535 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a10ef7-96e0-4449-816e-7f528cc13164 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:52.618430 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a10ef7-96e0-4449-816e-7f528cc13164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:52.629999 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d9a10ef7-96e0-4449-816e-7f528cc13164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:52.639257 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 845/1664] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:50:52 2022] POST /identity/v3/projects => generated 365 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:52.645901 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f39f58-7d53-4c79-ab0b-1cf2a4e38d89 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:52.646391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f39f58-7d53-4c79-ab0b-1cf2a4e38d89 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:52.646786 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f39f58-7d53-4c79-ab0b-1cf2a4e38d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:52.664154 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a10ef7-96e0-4449-816e-7f528cc13164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:52.665869 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a10ef7-96e0-4449-816e-7f528cc13164 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:52.672123 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-d0f39f58-7d53-4c79-ab0b-1cf2a4e38d89 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:52.674868 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d0f39f58-7d53-4c79-ab0b-1cf2a4e38d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:52.713792 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 820/1665] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:52.715032 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a10ef7-96e0-4449-816e-7f528cc13164 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:52.733310 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a10ef7-96e0-4449-816e-7f528cc13164 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:52.844853 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 846/1666] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:52.864308 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f39f58-7d53-4c79-ab0b-1cf2a4e38d89 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:52.867949 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d0f39f58-7d53-4c79-ab0b-1cf2a4e38d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:52.926738 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e76ad1-c64d-4bf0-ac65-d34c2fba50fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:52.927427 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e76ad1-c64d-4bf0-ac65-d34c2fba50fc admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:52.927706 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e76ad1-c64d-4bf0-ac65-d34c2fba50fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:52.927979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e76ad1-c64d-4bf0-ac65-d34c2fba50fc admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:52.928747 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e76ad1-c64d-4bf0-ac65-d34c2fba50fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:52.931428 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e76ad1-c64d-4bf0-ac65-d34c2fba50fc admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:52.965884 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 821/1667] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:50:52 2022] POST /identity/v3/users => generated 283 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:52.969917 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e76ad1-c64d-4bf0-ac65-d34c2fba50fc admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:52.988859 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e76ad1-c64d-4bf0-ac65-d34c2fba50fc admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:53.004417 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140221ee-c718-40a0-aa1a-aa1d70c7fdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:53.005179 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140221ee-c718-40a0-aa1a-aa1d70c7fdbe admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:53.006739 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140221ee-c718-40a0-aa1a-aa1d70c7fdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:53.007050 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140221ee-c718-40a0-aa1a-aa1d70c7fdbe admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:53.007805 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140221ee-c718-40a0-aa1a-aa1d70c7fdbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:53.016766 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140221ee-c718-40a0-aa1a-aa1d70c7fdbe admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:53.020386 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f39f58-7d53-4c79-ab0b-1cf2a4e38d89 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:53.025513 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49671720-90df-4a5f-a8e6-45658ca3db3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:53.026334 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49671720-90df-4a5f-a8e6-45658ca3db3d service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:53.027438 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49671720-90df-4a5f-a8e6-45658ca3db3d service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:53.028049 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49671720-90df-4a5f-a8e6-45658ca3db3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:53.044120 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 822/1668] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:50:53.048026 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140221ee-c718-40a0-aa1a-aa1d70c7fdbe admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:53.050576 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49671720-90df-4a5f-a8e6-45658ca3db3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:53.052335 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49671720-90df-4a5f-a8e6-45658ca3db3d service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:53.081804 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140221ee-c718-40a0-aa1a-aa1d70c7fdbe admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:53.085273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 847/1669] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:53.104008 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71862e59-6b24-4ccd-a32b-fa8821597787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:53.104970 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71862e59-6b24-4ccd-a32b-fa8821597787 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:53.105547 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71862e59-6b24-4ccd-a32b-fa8821597787 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:53.105997 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71862e59-6b24-4ccd-a32b-fa8821597787 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:53.107296 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71862e59-6b24-4ccd-a32b-fa8821597787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:53.109098 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71862e59-6b24-4ccd-a32b-fa8821597787 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:53.136266 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 823/1670] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:50:53.138009 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49671720-90df-4a5f-a8e6-45658ca3db3d service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:53.153332 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49671720-90df-4a5f-a8e6-45658ca3db3d service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:53.170485 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26a2c6-f90d-4749-8033-040d6e0a40f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:53.171367 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26a2c6-f90d-4749-8033-040d6e0a40f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:53.171652 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26a2c6-f90d-4749-8033-040d6e0a40f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:53.172125 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26a2c6-f90d-4749-8033-040d6e0a40f7 admin admin] PATH_INFO: `/v3/projects/675a09639a6b450d8bc849f12061edac/users/4937ee2772df4690b8b6c278cbc374e7/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:53.208881 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26a2c6-f90d-4749-8033-040d6e0a40f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=675a09639a6b450d8bc849f12061edac, user_id=4937ee2772df4690b8b6c278cbc374e7, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:53.218487 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca26a2c6-f90d-4749-8033-040d6e0a40f7 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:53.256217 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 848/1671] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:53 2022] PUT /identity/v3/projects/675a09639a6b450d8bc849f12061edac/users/4937ee2772df4690b8b6c278cbc374e7/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:53.269899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fa0a0-987e-49aa-9de4-43628423631e None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:53.270191 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fa0a0-987e-49aa-9de4-43628423631e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:53.270465 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977fa0a0-987e-49aa-9de4-43628423631e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:53.343737 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-977fa0a0-987e-49aa-9de4-43628423631e None None] MFA Rules not processed for user `4937ee2772df4690b8b6c278cbc374e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:53.345064 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-977fa0a0-987e-49aa-9de4-43628423631e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:53.581718 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26a2c6-f90d-4749-8033-040d6e0a40f7 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:53.586875 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 824/1672] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:53.766479 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca26a2c6-f90d-4749-8033-040d6e0a40f7 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:53.779833 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f6f44-b594-43ab-bcc4-54d90e9dbf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:53.780579 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f6f44-b594-43ab-bcc4-54d90e9dbf75 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:53.780867 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f6f44-b594-43ab-bcc4-54d90e9dbf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:53.781294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f6f44-b594-43ab-bcc4-54d90e9dbf75 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:53.782012 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f6f44-b594-43ab-bcc4-54d90e9dbf75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:53.784033 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f6f44-b594-43ab-bcc4-54d90e9dbf75 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:53.845738 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 849/1673] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:50:53 2022] POST /identity/v3/projects => generated 363 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:53.847289 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fa0a0-987e-49aa-9de4-43628423631e None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:53.860021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977fa0a0-987e-49aa-9de4-43628423631e None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:53.973634 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dd094-6447-49a8-b14f-a9c7aa816130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:53.975228 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dd094-6447-49a8-b14f-a9c7aa816130 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:53.975628 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dd094-6447-49a8-b14f-a9c7aa816130 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:53.976403 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236dd094-6447-49a8-b14f-a9c7aa816130 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:53.979806 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236dd094-6447-49a8-b14f-a9c7aa816130 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:53.984574 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236dd094-6447-49a8-b14f-a9c7aa816130 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:54.003360 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f6f44-b594-43ab-bcc4-54d90e9dbf75 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:54.005583 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-670f6f44-b594-43ab-bcc4-54d90e9dbf75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:54.039173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 825/1674] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:50:53 2022] POST /identity/v3/users => generated 288 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:54.040108 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dd094-6447-49a8-b14f-a9c7aa816130 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:54.051189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f6f44-b594-43ab-bcc4-54d90e9dbf75 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:54.063420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111c69d-6f2b-4eaa-b757-db325ce4d04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:54.064830 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111c69d-6f2b-4eaa-b757-db325ce4d04a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:54.065253 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111c69d-6f2b-4eaa-b757-db325ce4d04a admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:54.065666 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111c69d-6f2b-4eaa-b757-db325ce4d04a admin admin] PATH_INFO: `/v3/projects/3796273a118e4a70b3f8097ef40525db` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:54.068194 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111c69d-6f2b-4eaa-b757-db325ce4d04a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3796273a118e4a70b3f8097ef40525db)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:54.069723 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236dd094-6447-49a8-b14f-a9c7aa816130 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:54.071292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: WARNING py.warnings [None req-9111c69d-6f2b-4eaa-b757-db325ce4d04a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:50:54.071292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: warnings.warn(msg) Apr 11 16:50:54.071292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: Apr 11 16:50:54.076653 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111c69d-6f2b-4eaa-b757-db325ce4d04a admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:54.085491 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949fc39-ed70-4816-b448-6ff48a461ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:54.086171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949fc39-ed70-4816-b448-6ff48a461ed8 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:54.086448 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949fc39-ed70-4816-b448-6ff48a461ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:54.086761 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949fc39-ed70-4816-b448-6ff48a461ed8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:54.087495 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949fc39-ed70-4816-b448-6ff48a461ed8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:54.089102 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949fc39-ed70-4816-b448-6ff48a461ed8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:54.112678 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 826/1675] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:54.113614 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949fc39-ed70-4816-b448-6ff48a461ed8 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:54.135175 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949fc39-ed70-4816-b448-6ff48a461ed8 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:54.149228 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524d2a5-c430-4c5e-b19a-f7ed2b8b162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:54.150603 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524d2a5-c430-4c5e-b19a-f7ed2b8b162b admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:54.151032 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524d2a5-c430-4c5e-b19a-f7ed2b8b162b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:54.151337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5524d2a5-c430-4c5e-b19a-f7ed2b8b162b admin admin] PATH_INFO: `/v3/projects/29e7f2947a01426c9cd282e1e5732337/users/e16a853f4b8f40db877af294eb6fc5c0/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:54.185185 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524d2a5-c430-4c5e-b19a-f7ed2b8b162b admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e7f2947a01426c9cd282e1e5732337, user_id=e16a853f4b8f40db877af294eb6fc5c0, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:54.205344 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5524d2a5-c430-4c5e-b19a-f7ed2b8b162b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:54.232243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 827/1676] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:54 2022] PUT /identity/v3/projects/29e7f2947a01426c9cd282e1e5732337/users/e16a853f4b8f40db877af294eb6fc5c0/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:54.237586 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524d2a5-c430-4c5e-b19a-f7ed2b8b162b admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:54.240834 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-9111c69d-6f2b-4eaa-b757-db325ce4d04a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3796273a118e4a70b3f8097ef40525db', 'request_id': 'req-9111c69d-6f2b-4eaa-b757-db325ce4d04a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:54.279655 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-9111c69d-6f2b-4eaa-b757-db325ce4d04a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3796273a118e4a70b3f8097ef40525db', 'request_id': 'req-9111c69d-6f2b-4eaa-b757-db325ce4d04a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:54.346810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-9111c69d-6f2b-4eaa-b757-db325ce4d04a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3796273a118e4a70b3f8097ef40525db', 'request_id': 'req-9111c69d-6f2b-4eaa-b757-db325ce4d04a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:54.372596 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5524d2a5-c430-4c5e-b19a-f7ed2b8b162b admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:54.375033 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-9111c69d-6f2b-4eaa-b757-db325ce4d04a admin admin] The token cache is being invalidate because project 3796273a118e4a70b3f8097ef40525db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:50:54.375325 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-9111c69d-6f2b-4eaa-b757-db325ce4d04a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:54.376092 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-9111c69d-6f2b-4eaa-b757-db325ce4d04a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:54.378748 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 850/1677] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:50:53 2022] DELETE /identity/v3/projects/3796273a118e4a70b3f8097ef40525db => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:54.380267 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f219d1-051c-452a-8a95-cde4146d4a96 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:54.380576 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f219d1-051c-452a-8a95-cde4146d4a96 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:54.380819 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f219d1-051c-452a-8a95-cde4146d4a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:54.383764 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef57129-e3bc-481a-9ee0-f3957d23f761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:54.384585 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef57129-e3bc-481a-9ee0-f3957d23f761 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:54.385037 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef57129-e3bc-481a-9ee0-f3957d23f761 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:54.385415 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef57129-e3bc-481a-9ee0-f3957d23f761 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:54.386664 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef57129-e3bc-481a-9ee0-f3957d23f761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:54.388683 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef57129-e3bc-481a-9ee0-f3957d23f761 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:54.411023 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 828/1678] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:54 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:54.411023 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef57129-e3bc-481a-9ee0-f3957d23f761 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:54.421809 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1ef57129-e3bc-481a-9ee0-f3957d23f761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:54.438050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-98f219d1-051c-452a-8a95-cde4146d4a96 None None] MFA Rules not processed for user `9924b7b7dd6448d78bc9d166a2b51927`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:54.440074 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-98f219d1-051c-452a-8a95-cde4146d4a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:54.459621 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef57129-e3bc-481a-9ee0-f3957d23f761 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:54.472742 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c5567-b127-4089-94c7-4249c9312dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:54.473644 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c5567-b127-4089-94c7-4249c9312dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:54.473925 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c5567-b127-4089-94c7-4249c9312dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:54.474199 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c5567-b127-4089-94c7-4249c9312dc7 admin admin] PATH_INFO: `/v3/users/7bb85fd8a9974fffb4f483f0838189a1` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:54.475558 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c5567-b127-4089-94c7-4249c9312dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb85fd8a9974fffb4f483f0838189a1)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:54.476734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: WARNING py.warnings [None req-b62c5567-b127-4089-94c7-4249c9312dc7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 16:50:54.476734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: warnings.warn(msg) Apr 11 16:50:54.476734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: Apr 11 16:50:54.478261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c5567-b127-4089-94c7-4249c9312dc7 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:54.582363 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 851/1679] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:54.584610 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f219d1-051c-452a-8a95-cde4146d4a96 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:54.586037 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-98f219d1-051c-452a-8a95-cde4146d4a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:54.636956 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f219d1-051c-452a-8a95-cde4146d4a96 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:54.645320 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483ecc3-8522-47fa-92c9-90543d85c425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:54.647615 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b62c5567-b127-4089-94c7-4249c9312dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb85fd8a9974fffb4f483f0838189a1'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:54.648021 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483ecc3-8522-47fa-92c9-90543d85c425 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:54.648411 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483ecc3-8522-47fa-92c9-90543d85c425 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:54.649253 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483ecc3-8522-47fa-92c9-90543d85c425 admin admin] PATH_INFO: `/v3/projects/29e7f2947a01426c9cd282e1e5732337/users/e16a853f4b8f40db877af294eb6fc5c0/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:54.653935 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483ecc3-8522-47fa-92c9-90543d85c425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e7f2947a01426c9cd282e1e5732337, user_id=e16a853f4b8f40db877af294eb6fc5c0, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:54.664106 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483ecc3-8522-47fa-92c9-90543d85c425 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:54.667215 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b62c5567-b127-4089-94c7-4249c9312dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb85fd8a9974fffb4f483f0838189a1'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:54.668032 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b62c5567-b127-4089-94c7-4249c9312dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb85fd8a9974fffb4f483f0838189a1'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:54.690720 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 852/1680] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:54 2022] PUT /identity/v3/projects/29e7f2947a01426c9cd282e1e5732337/users/e16a853f4b8f40db877af294eb6fc5c0/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:54.692179 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7a8cb-12ac-4a97-9521-28b3d230037e None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:54.693802 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b62c5567-b127-4089-94c7-4249c9312dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb85fd8a9974fffb4f483f0838189a1'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:54.694445 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7a8cb-12ac-4a97-9521-28b3d230037e None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:54.696337 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7a8cb-12ac-4a97-9521-28b3d230037e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:54.736459 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-69a7a8cb-12ac-4a97-9521-28b3d230037e None None] MFA Rules not processed for user `9924b7b7dd6448d78bc9d166a2b51927`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:54.739082 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-69a7a8cb-12ac-4a97-9521-28b3d230037e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:54.750838 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b62c5567-b127-4089-94c7-4249c9312dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb85fd8a9974fffb4f483f0838189a1'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:54.757894 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 829/1681] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:50:54 2022] DELETE /identity/v3/users/7bb85fd8a9974fffb4f483f0838189a1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:54.761359 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565ad01-12e7-43a1-9e2e-31785011d991 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:54.761359 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565ad01-12e7-43a1-9e2e-31785011d991 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:54.761359 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565ad01-12e7-43a1-9e2e-31785011d991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:54.832766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 853/1682] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:54.834834 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-d565ad01-12e7-43a1-9e2e-31785011d991 None None] MFA Rules not processed for user `e16a853f4b8f40db877af294eb6fc5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:54.836218 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d565ad01-12e7-43a1-9e2e-31785011d991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:54.851851 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7a8cb-12ac-4a97-9521-28b3d230037e None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:54.854755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-69a7a8cb-12ac-4a97-9521-28b3d230037e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:55.027722 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7a8cb-12ac-4a97-9521-28b3d230037e None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:55.076953 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 830/1683] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:54 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:55.083822 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565ad01-12e7-43a1-9e2e-31785011d991 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:55.093476 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d565ad01-12e7-43a1-9e2e-31785011d991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:55.191150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e039187-3c49-4484-81f2-f6391162cd4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:55.191951 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e039187-3c49-4484-81f2-f6391162cd4b service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:55.192235 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e039187-3c49-4484-81f2-f6391162cd4b service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:55.192502 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e039187-3c49-4484-81f2-f6391162cd4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:55.196044 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-6e039187-3c49-4484-81f2-f6391162cd4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:55.226175 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565ad01-12e7-43a1-9e2e-31785011d991 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:55.232318 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e1ed94-842b-4187-bd6e-5270a89af81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:55.234348 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1ed94-842b-4187-bd6e-5270a89af81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:55.234901 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1ed94-842b-4187-bd6e-5270a89af81f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:55.236597 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e1ed94-842b-4187-bd6e-5270a89af81f admin admin] PATH_INFO: `/v3/projects/6713521d2d30444e80af185f9f7c05dd` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:55.238995 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1ed94-842b-4187-bd6e-5270a89af81f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6713521d2d30444e80af185f9f7c05dd)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:55.241992 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e1ed94-842b-4187-bd6e-5270a89af81f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:55.302519 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e039187-3c49-4484-81f2-f6391162cd4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:55.304591 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e039187-3c49-4484-81f2-f6391162cd4b service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:55.310210 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-54e1ed94-842b-4187-bd6e-5270a89af81f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6713521d2d30444e80af185f9f7c05dd', 'request_id': 'req-54e1ed94-842b-4187-bd6e-5270a89af81f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:55.318573 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-54e1ed94-842b-4187-bd6e-5270a89af81f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6713521d2d30444e80af185f9f7c05dd', 'request_id': 'req-54e1ed94-842b-4187-bd6e-5270a89af81f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:55.326470 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 854/1684] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:55.327053 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-54e1ed94-842b-4187-bd6e-5270a89af81f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6713521d2d30444e80af185f9f7c05dd', 'request_id': 'req-54e1ed94-842b-4187-bd6e-5270a89af81f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:55.336469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e039187-3c49-4484-81f2-f6391162cd4b service nova] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:55.343127 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-54e1ed94-842b-4187-bd6e-5270a89af81f admin admin] The token cache is being invalidate because project 6713521d2d30444e80af185f9f7c05dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:50:55.343681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-6e039187-3c49-4484-81f2-f6391162cd4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:55.344019 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-54e1ed94-842b-4187-bd6e-5270a89af81f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:55.345043 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-54e1ed94-842b-4187-bd6e-5270a89af81f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:55.348187 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 831/1685] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:50:55 2022] DELETE /identity/v3/projects/6713521d2d30444e80af185f9f7c05dd => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:55.353312 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622395b-cd05-480d-8ec0-280a270bd98f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:55.353922 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622395b-cd05-480d-8ec0-280a270bd98f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:55.354442 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b622395b-cd05-480d-8ec0-280a270bd98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:55.379614 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b622395b-cd05-480d-8ec0-280a270bd98f None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:55.381569 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b622395b-cd05-480d-8ec0-280a270bd98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:55.482922 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 832/1686] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:55.491587 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107ddad-31f6-4a52-833e-7a7f933d9948 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:55.492075 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107ddad-31f6-4a52-833e-7a7f933d9948 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:55.492540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107ddad-31f6-4a52-833e-7a7f933d9948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:55.528838 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e039187-3c49-4484-81f2-f6391162cd4b service nova] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:55.537066 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-4107ddad-31f6-4a52-833e-7a7f933d9948 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:55.557374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4107ddad-31f6-4a52-833e-7a7f933d9948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:55.598447 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 833/1687] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:50:55.602462 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107ddad-31f6-4a52-833e-7a7f933d9948 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:55.630540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107ddad-31f6-4a52-833e-7a7f933d9948 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:55.649361 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107759d-0069-492c-8094-9c88e3c0e04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:55.650083 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107759d-0069-492c-8094-9c88e3c0e04a admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:55.650420 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107759d-0069-492c-8094-9c88e3c0e04a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:55.650726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107759d-0069-492c-8094-9c88e3c0e04a admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:55.651556 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107759d-0069-492c-8094-9c88e3c0e04a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:50:55.652010 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107759d-0069-492c-8094-9c88e3c0e04a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:55.659324 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107759d-0069-492c-8094-9c88e3c0e04a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:55.689569 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 834/1688] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:50:55.689942 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107759d-0069-492c-8094-9c88e3c0e04a admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:55.692989 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15129f2-951c-4529-bdf0-2503fa502cc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:55.693659 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15129f2-951c-4529-bdf0-2503fa502cc0 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:55.694000 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15129f2-951c-4529-bdf0-2503fa502cc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:55.694264 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15129f2-951c-4529-bdf0-2503fa502cc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:55.694980 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2107759d-0069-492c-8094-9c88e3c0e04a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:55.696203 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f15129f2-951c-4529-bdf0-2503fa502cc0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:55.721990 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107759d-0069-492c-8094-9c88e3c0e04a admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:55.746494 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6967c-986a-4076-b711-0e130ba24c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:55.761973 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6967c-986a-4076-b711-0e130ba24c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:55.762270 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6967c-986a-4076-b711-0e130ba24c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:55.762550 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6967c-986a-4076-b711-0e130ba24c3b admin admin] PATH_INFO: `/v3/projects/3a81f45a39c54381906d4ca1b3d60275` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:55.770252 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6967c-986a-4076-b711-0e130ba24c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a81f45a39c54381906d4ca1b3d60275)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:55.773136 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6967c-986a-4076-b711-0e130ba24c3b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:55.807262 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15129f2-951c-4529-bdf0-2503fa502cc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:55.809047 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15129f2-951c-4529-bdf0-2503fa502cc0 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:55.831465 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 855/1689] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:55.833871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de90369-8ec9-4806-b3f5-e2471a3d49e0 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:55.833871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de90369-8ec9-4806-b3f5-e2471a3d49e0 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:55.833871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de90369-8ec9-4806-b3f5-e2471a3d49e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:55.889031 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-55e6967c-986a-4076-b711-0e130ba24c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a81f45a39c54381906d4ca1b3d60275', 'request_id': 'req-55e6967c-986a-4076-b711-0e130ba24c3b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:55.899272 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-55e6967c-986a-4076-b711-0e130ba24c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a81f45a39c54381906d4ca1b3d60275', 'request_id': 'req-55e6967c-986a-4076-b711-0e130ba24c3b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:55.901492 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-5de90369-8ec9-4806-b3f5-e2471a3d49e0 None None] MFA Rules not processed for user `8ff2ac0b68d1414fb72955edc07ee3fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:55.902772 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-5de90369-8ec9-4806-b3f5-e2471a3d49e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:55.908525 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-55e6967c-986a-4076-b711-0e130ba24c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a81f45a39c54381906d4ca1b3d60275', 'request_id': 'req-55e6967c-986a-4076-b711-0e130ba24c3b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:55.932208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-55e6967c-986a-4076-b711-0e130ba24c3b admin admin] The token cache is being invalidate because project 3a81f45a39c54381906d4ca1b3d60275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:50:55.932603 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-55e6967c-986a-4076-b711-0e130ba24c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:55.933856 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-55e6967c-986a-4076-b711-0e130ba24c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:55.942038 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 835/1690] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:50:55 2022] DELETE /identity/v3/projects/3a81f45a39c54381906d4ca1b3d60275 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:55.942038 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6967c-986a-4076-b711-0e130ba24c3b admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:55.946520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-55e6967c-986a-4076-b711-0e130ba24c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:56.067463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6967c-986a-4076-b711-0e130ba24c3b admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:56.082784 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de73da-db75-4e3a-a7a6-6cfadf2e3b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:56.083472 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de73da-db75-4e3a-a7a6-6cfadf2e3b97 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:56.083753 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de73da-db75-4e3a-a7a6-6cfadf2e3b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:56.084035 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02de73da-db75-4e3a-a7a6-6cfadf2e3b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:56.085009 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de73da-db75-4e3a-a7a6-6cfadf2e3b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:56.086972 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02de73da-db75-4e3a-a7a6-6cfadf2e3b97 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:56.096575 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 856/1691] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:56.103810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47d4b0-018e-42d8-a1a3-1208fec89178 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:56.104652 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47d4b0-018e-42d8-a1a3-1208fec89178 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:56.104652 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47d4b0-018e-42d8-a1a3-1208fec89178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:56.168718 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 836/1692] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:50:55 2022] POST /identity/v3/projects => generated 403 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:56.169762 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de73da-db75-4e3a-a7a6-6cfadf2e3b97 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:56.172374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-02de73da-db75-4e3a-a7a6-6cfadf2e3b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:56.174336 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-4c47d4b0-018e-42d8-a1a3-1208fec89178 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:56.175583 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4c47d4b0-018e-42d8-a1a3-1208fec89178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:56.326684 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 857/1693] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:56.327522 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47d4b0-018e-42d8-a1a3-1208fec89178 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:56.351857 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47d4b0-018e-42d8-a1a3-1208fec89178 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:56.359193 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02de73da-db75-4e3a-a7a6-6cfadf2e3b97 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:56.360737 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e2686-e1db-4f3e-8e7a-7db0fae72c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:56.361419 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e2686-e1db-4f3e-8e7a-7db0fae72c45 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:56.361701 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e2686-e1db-4f3e-8e7a-7db0fae72c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:56.361977 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e2686-e1db-4f3e-8e7a-7db0fae72c45 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:56.362688 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e2686-e1db-4f3e-8e7a-7db0fae72c45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:56.364677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e2686-e1db-4f3e-8e7a-7db0fae72c45 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:56.374331 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e72ba2-d8ef-4cb3-a7b7-39cad7518bf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:56.375197 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e72ba2-d8ef-4cb3-a7b7-39cad7518bf2 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:56.375655 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e72ba2-d8ef-4cb3-a7b7-39cad7518bf2 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:56.376078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e72ba2-d8ef-4cb3-a7b7-39cad7518bf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:56.427440 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 858/1694] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:50:56 2022] POST /identity/v3/users => generated 302 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:56.429340 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fd84c-0370-4e96-917d-4a7310682545 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:56.429340 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fd84c-0370-4e96-917d-4a7310682545 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:56.429633 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fd84c-0370-4e96-917d-4a7310682545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:56.496083 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-ae9fd84c-0370-4e96-917d-4a7310682545 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:56.497321 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-ae9fd84c-0370-4e96-917d-4a7310682545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:56.498528 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e72ba2-d8ef-4cb3-a7b7-39cad7518bf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:56.501484 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e72ba2-d8ef-4cb3-a7b7-39cad7518bf2 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:56.506463 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 859/1695] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:56.510992 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fd84c-0370-4e96-917d-4a7310682545 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:56.518641 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 837/1696] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:56.520356 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e72ba2-d8ef-4cb3-a7b7-39cad7518bf2 service nova] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:56.522847 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fd84c-0370-4e96-917d-4a7310682545 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:56.533680 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e72ba2-d8ef-4cb3-a7b7-39cad7518bf2 service nova] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:56.539160 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82483f1-897c-4db8-91fc-ed3cf9a174bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:56.540007 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbd75b-a878-40d4-b3a3-869dd469bf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:56.540366 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82483f1-897c-4db8-91fc-ed3cf9a174bf admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:56.541047 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82483f1-897c-4db8-91fc-ed3cf9a174bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:56.541144 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbd75b-a878-40d4-b3a3-869dd469bf7e admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:56.541459 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbd75b-a878-40d4-b3a3-869dd469bf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:56.541792 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbd75b-a878-40d4-b3a3-869dd469bf7e admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:56.542078 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82483f1-897c-4db8-91fc-ed3cf9a174bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:56.542727 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbd75b-a878-40d4-b3a3-869dd469bf7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:50:56.543322 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbd75b-a878-40d4-b3a3-869dd469bf7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:56.545481 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adbd75b-a878-40d4-b3a3-869dd469bf7e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:56.547390 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82483f1-897c-4db8-91fc-ed3cf9a174bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:56.549930 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82483f1-897c-4db8-91fc-ed3cf9a174bf admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:56.577364 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 860/1697] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:56.583753 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 838/1698] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:50:56.587262 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbd75b-a878-40d4-b3a3-869dd469bf7e admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:56.588489 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82483f1-897c-4db8-91fc-ed3cf9a174bf admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:56.610047 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adbd75b-a878-40d4-b3a3-869dd469bf7e admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:56.612710 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82483f1-897c-4db8-91fc-ed3cf9a174bf admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:56.622991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbabdee-cbd5-4794-8e9b-74a5699e02ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:56.623492 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abbfe9-2192-4664-803d-ad21fbb094b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:56.624210 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbabdee-cbd5-4794-8e9b-74a5699e02ac admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:56.624406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbabdee-cbd5-4794-8e9b-74a5699e02ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:56.624835 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbabdee-cbd5-4794-8e9b-74a5699e02ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:56.625356 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abbfe9-2192-4664-803d-ad21fbb094b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:56.625801 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbabdee-cbd5-4794-8e9b-74a5699e02ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:56.625927 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abbfe9-2192-4664-803d-ad21fbb094b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:56.626357 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abbfe9-2192-4664-803d-ad21fbb094b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:56.627929 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abbfe9-2192-4664-803d-ad21fbb094b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:56.629068 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbabdee-cbd5-4794-8e9b-74a5699e02ac admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:56.630656 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9abbfe9-2192-4664-803d-ad21fbb094b6 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:56.671250 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 839/1699] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:56.678229 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbabdee-cbd5-4794-8e9b-74a5699e02ac admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:56.678705 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 861/1700] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:50:56 2022] POST /identity/v3/projects => generated 369 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:56.681647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abbfe9-2192-4664-803d-ad21fbb094b6 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:56.707931 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbabdee-cbd5-4794-8e9b-74a5699e02ac admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:56.825874 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9abbfe9-2192-4664-803d-ad21fbb094b6 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:56.839381 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937f978-35c5-4803-bc08-f6336d7f2785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:56.840080 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937f978-35c5-4803-bc08-f6336d7f2785 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:56.840362 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937f978-35c5-4803-bc08-f6336d7f2785 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:56.840663 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937f978-35c5-4803-bc08-f6336d7f2785 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:56.841470 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937f978-35c5-4803-bc08-f6336d7f2785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:56.843969 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937f978-35c5-4803-bc08-f6336d7f2785 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:56.853866 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195670b2-095e-4b01-877a-770652bbe7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:56.854916 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195670b2-095e-4b01-877a-770652bbe7da admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:56.855499 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195670b2-095e-4b01-877a-770652bbe7da admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:56.855978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195670b2-095e-4b01-877a-770652bbe7da admin admin] PATH_INFO: `/v3/projects/28db0ba70cc640d49924d80da53ccb45/users/51ca213b2c7e4498aa471cf22da6c60a/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:56.899350 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 862/1701] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:50:56 2022] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:50:56.899603 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195670b2-095e-4b01-877a-770652bbe7da admin admin] RBAC: Authorizing `identity:create_grant(project_id=28db0ba70cc640d49924d80da53ccb45, user_id=51ca213b2c7e4498aa471cf22da6c60a, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:56.900825 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47eddf-a000-4234-ae92-8bcd767858cf None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:56.901110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47eddf-a000-4234-ae92-8bcd767858cf None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:56.901386 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47eddf-a000-4234-ae92-8bcd767858cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:56.908577 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195670b2-095e-4b01-877a-770652bbe7da admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:56.939322 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-3b47eddf-a000-4234-ae92-8bcd767858cf None None] MFA Rules not processed for user `9924b7b7dd6448d78bc9d166a2b51927`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:56.940693 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3b47eddf-a000-4234-ae92-8bcd767858cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:56.947584 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 840/1702] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:56 2022] PUT /identity/v3/projects/28db0ba70cc640d49924d80da53ccb45/users/51ca213b2c7e4498aa471cf22da6c60a/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:56.949070 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195670b2-095e-4b01-877a-770652bbe7da admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:56.959203 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-195670b2-095e-4b01-877a-770652bbe7da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:57.051485 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 863/1703] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:57.052572 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47eddf-a000-4234-ae92-8bcd767858cf None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:57.157352 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47eddf-a000-4234-ae92-8bcd767858cf None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:57.164147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20811145-6209-462b-94fd-783920f03c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:57.165003 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195670b2-095e-4b01-877a-770652bbe7da admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:57.165251 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20811145-6209-462b-94fd-783920f03c04 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:57.165805 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20811145-6209-462b-94fd-783920f03c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:57.166235 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20811145-6209-462b-94fd-783920f03c04 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:57.167636 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20811145-6209-462b-94fd-783920f03c04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:57.169502 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20811145-6209-462b-94fd-783920f03c04 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:57.181090 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a23d99-4dcc-4086-8a1e-d3cf3db04157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:57.181999 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a23d99-4dcc-4086-8a1e-d3cf3db04157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:57.182264 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a23d99-4dcc-4086-8a1e-d3cf3db04157 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:57.182539 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a23d99-4dcc-4086-8a1e-d3cf3db04157 admin admin] PATH_INFO: `/v3/users/4937ee2772df4690b8b6c278cbc374e7` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:57.183585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 864/1704] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:57.185092 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f6978-5c7e-4f8a-9164-f91b4a1cc44d None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:57.185475 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f6978-5c7e-4f8a-9164-f91b4a1cc44d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:57.186164 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f6978-5c7e-4f8a-9164-f91b4a1cc44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:57.186469 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a23d99-4dcc-4086-8a1e-d3cf3db04157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4937ee2772df4690b8b6c278cbc374e7)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:57.190222 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a23d99-4dcc-4086-8a1e-d3cf3db04157 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:57.225626 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-8b5f6978-5c7e-4f8a-9164-f91b4a1cc44d None None] MFA Rules not processed for user `51ca213b2c7e4498aa471cf22da6c60a`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:57.227330 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-8b5f6978-5c7e-4f8a-9164-f91b4a1cc44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:57.366925 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c9a23d99-4dcc-4086-8a1e-d3cf3db04157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4937ee2772df4690b8b6c278cbc374e7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:57.411029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c9a23d99-4dcc-4086-8a1e-d3cf3db04157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4937ee2772df4690b8b6c278cbc374e7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:57.412315 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c9a23d99-4dcc-4086-8a1e-d3cf3db04157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4937ee2772df4690b8b6c278cbc374e7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:57.441344 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c9a23d99-4dcc-4086-8a1e-d3cf3db04157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4937ee2772df4690b8b6c278cbc374e7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:57.458890 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c9a23d99-4dcc-4086-8a1e-d3cf3db04157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4937ee2772df4690b8b6c278cbc374e7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:50:57.469165 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 841/1705] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:50:56 2022] DELETE /identity/v3/users/4937ee2772df4690b8b6c278cbc374e7 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:57.471180 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a23d99-4dcc-4086-8a1e-d3cf3db04157 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:57.473037 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c9a23d99-4dcc-4086-8a1e-d3cf3db04157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:57.479301 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 865/1706] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:57.488191 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae9df5-8c5b-47d7-9cfa-63a518be7b77 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:57.488766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae9df5-8c5b-47d7-9cfa-63a518be7b77 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:57.495965 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae9df5-8c5b-47d7-9cfa-63a518be7b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:57.556150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-6dae9df5-8c5b-47d7-9cfa-63a518be7b77 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:57.559615 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-6dae9df5-8c5b-47d7-9cfa-63a518be7b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:57.588134 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a23d99-4dcc-4086-8a1e-d3cf3db04157 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:57.594826 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffbb0f-8640-4bff-a27a-624e0d61b4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:57.596942 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffbb0f-8640-4bff-a27a-624e0d61b4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:57.597636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffbb0f-8640-4bff-a27a-624e0d61b4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:57.598111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ffbb0f-8640-4bff-a27a-624e0d61b4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:57.599277 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffbb0f-8640-4bff-a27a-624e0d61b4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:57.605764 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ffbb0f-8640-4bff-a27a-624e0d61b4c1 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:57.619280 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 842/1707] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:57.620717 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffbb0f-8640-4bff-a27a-624e0d61b4c1 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:57.622964 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-22ffbb0f-8640-4bff-a27a-624e0d61b4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:57.640842 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ffbb0f-8640-4bff-a27a-624e0d61b4c1 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:57.669505 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7101a88-828e-45d4-8e5f-3bdac8fdd3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:57.671082 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7101a88-828e-45d4-8e5f-3bdac8fdd3c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:57.671650 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7101a88-828e-45d4-8e5f-3bdac8fdd3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:57.672017 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7101a88-828e-45d4-8e5f-3bdac8fdd3c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:57.674720 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7101a88-828e-45d4-8e5f-3bdac8fdd3c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:57.683509 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7101a88-828e-45d4-8e5f-3bdac8fdd3c7 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:57.747279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 843/1708] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:50:57 2022] POST /identity/v3/projects => generated 405 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:57.747279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7101a88-828e-45d4-8e5f-3bdac8fdd3c7 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:57.784911 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 866/1709] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:57.788262 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae9df5-8c5b-47d7-9cfa-63a518be7b77 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:57.819386 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae9df5-8c5b-47d7-9cfa-63a518be7b77 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:57.829660 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7101a88-828e-45d4-8e5f-3bdac8fdd3c7 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:57.836314 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954e846-d1d4-4889-adc7-c37a4d969fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:57.837375 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954e846-d1d4-4889-adc7-c37a4d969fea admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:57.837716 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954e846-d1d4-4889-adc7-c37a4d969fea admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:57.838076 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6954e846-d1d4-4889-adc7-c37a4d969fea admin admin] PATH_INFO: `/v3/projects/d8323bb202894093bc5ad1a43857c581/users/95c9588e11d7420ba13a47d8d394c5cb/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:57.846661 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cbac5-33b1-4e26-8515-1c8826b8e308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:57.854464 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cbac5-33b1-4e26-8515-1c8826b8e308 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:57.854792 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cbac5-33b1-4e26-8515-1c8826b8e308 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:57.855089 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cbac5-33b1-4e26-8515-1c8826b8e308 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:57.856726 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cbac5-33b1-4e26-8515-1c8826b8e308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:57.858147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227cbac5-33b1-4e26-8515-1c8826b8e308 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:57.904765 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954e846-d1d4-4889-adc7-c37a4d969fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8323bb202894093bc5ad1a43857c581, user_id=95c9588e11d7420ba13a47d8d394c5cb, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:57.919979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6954e846-d1d4-4889-adc7-c37a4d969fea admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:57.925006 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 867/1710] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:50:57 2022] POST /identity/v3/users => generated 309 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:57.927035 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cbac5-33b1-4e26-8515-1c8826b8e308 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:57.967501 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cbac5-33b1-4e26-8515-1c8826b8e308 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:57.989504 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 844/1711] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:57 2022] PUT /identity/v3/projects/d8323bb202894093bc5ad1a43857c581/users/95c9588e11d7420ba13a47d8d394c5cb/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:57.996514 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954e846-d1d4-4889-adc7-c37a4d969fea admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:58.003316 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6954e846-d1d4-4889-adc7-c37a4d969fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:58.183554 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6954e846-d1d4-4889-adc7-c37a4d969fea admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:58.187755 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757a1d5-40a9-47fa-98d4-cdfbca35bbb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:58.188415 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757a1d5-40a9-47fa-98d4-cdfbca35bbb8 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:58.189355 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757a1d5-40a9-47fa-98d4-cdfbca35bbb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:58.189639 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757a1d5-40a9-47fa-98d4-cdfbca35bbb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:58.247949 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfaafe2-d986-404c-b166-5fc6a6670cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:58.258912 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaafe2-d986-404c-b166-5fc6a6670cfe admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:58.259202 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaafe2-d986-404c-b166-5fc6a6670cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:58.287571 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfaafe2-d986-404c-b166-5fc6a6670cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:58.288480 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfaafe2-d986-404c-b166-5fc6a6670cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:58.318712 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfaafe2-d986-404c-b166-5fc6a6670cfe admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:58.381366 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 868/1712] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:50:58.383022 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf65f9-b127-45c8-b324-f9d35a2b9e9e None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:58.386631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf65f9-b127-45c8-b324-f9d35a2b9e9e None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:58.388235 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf65f9-b127-45c8-b324-f9d35a2b9e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:58.435319 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757a1d5-40a9-47fa-98d4-cdfbca35bbb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:58.449708 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1757a1d5-40a9-47fa-98d4-cdfbca35bbb8 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:58.487000 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 845/1713] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:50:58.489497 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e8bfd-7c72-4f38-ae81-e65d78c9b7b1 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:58.489792 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e8bfd-7c72-4f38-ae81-e65d78c9b7b1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:58.490074 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e8bfd-7c72-4f38-ae81-e65d78c9b7b1 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:58.491660 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 846/1714] 10.222.0.73 () {54 vars in 912 bytes} [Mon Apr 11 16:50:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:50:58.500345 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-1acf65f9-b127-45c8-b324-f9d35a2b9e9e None None] MFA Rules not processed for user `95c9588e11d7420ba13a47d8d394c5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:58.502727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-1acf65f9-b127-45c8-b324-f9d35a2b9e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:58.504838 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e8bfd-7c72-4f38-ae81-e65d78c9b7b1 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:58.534395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e8bfd-7c72-4f38-ae81-e65d78c9b7b1 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:58.561374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f801bc5-f8c5-4252-bade-e1c9a8eb58a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:58.568292 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f801bc5-f8c5-4252-bade-e1c9a8eb58a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:58.568589 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f801bc5-f8c5-4252-bade-e1c9a8eb58a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:58.572124 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f801bc5-f8c5-4252-bade-e1c9a8eb58a1 admin admin] PATH_INFO: `/v3/projects/f750b3a639644a44bacb8a0b8646c8da/users/e131c1835c7c4bb8bcc5eacd29be5a40/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:58.656786 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f801bc5-f8c5-4252-bade-e1c9a8eb58a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f750b3a639644a44bacb8a0b8646c8da, user_id=e131c1835c7c4bb8bcc5eacd29be5a40, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:58.659490 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 869/1715] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:58.665934 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22babe8a-1717-4da3-94d0-2cc0a7625e3c None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:58.666763 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f801bc5-f8c5-4252-bade-e1c9a8eb58a1 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:58.670564 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22babe8a-1717-4da3-94d0-2cc0a7625e3c None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:58.672729 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22babe8a-1717-4da3-94d0-2cc0a7625e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:58.723419 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 847/1716] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:58 2022] PUT /identity/v3/projects/f750b3a639644a44bacb8a0b8646c8da/users/e131c1835c7c4bb8bcc5eacd29be5a40/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:58.733862 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d13309-4e96-4646-a541-1f3efc26e081 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:58.734142 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d13309-4e96-4646-a541-1f3efc26e081 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:58.740537 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d13309-4e96-4646-a541-1f3efc26e081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:58.751451 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-22babe8a-1717-4da3-94d0-2cc0a7625e3c None None] MFA Rules not processed for user `e0653575c0a24603bb9287e6222313de`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:58.754802 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-22babe8a-1717-4da3-94d0-2cc0a7625e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:58.796695 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b2d13309-4e96-4646-a541-1f3efc26e081 None None] MFA Rules not processed for user `7990c92f59454156bbd99445387ca889`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:58.797932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b2d13309-4e96-4646-a541-1f3efc26e081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:58.982883 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 870/1717] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Apr 11 16:50:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:58.984265 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22babe8a-1717-4da3-94d0-2cc0a7625e3c None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:58.989798 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 848/1718] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Apr 11 16:50:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:58.991654 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d13309-4e96-4646-a541-1f3efc26e081 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:59.135965 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d13309-4e96-4646-a541-1f3efc26e081 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:59.138830 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22babe8a-1717-4da3-94d0-2cc0a7625e3c None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:59.151402 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3dc3c-01fd-426f-a065-1018325accfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:59.151702 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a44639-7555-4997-ba21-265ef1b86475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:59.152105 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3dc3c-01fd-426f-a065-1018325accfe admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:59.152319 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a44639-7555-4997-ba21-265ef1b86475 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:59.152414 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3dc3c-01fd-426f-a065-1018325accfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:59.152608 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a44639-7555-4997-ba21-265ef1b86475 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:59.152702 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff3dc3c-01fd-426f-a065-1018325accfe admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:59.153360 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3dc3c-01fd-426f-a065-1018325accfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:59.154616 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a44639-7555-4997-ba21-265ef1b86475 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:59.155624 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff3dc3c-01fd-426f-a065-1018325accfe admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:59.155729 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a44639-7555-4997-ba21-265ef1b86475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:59.157286 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a44639-7555-4997-ba21-265ef1b86475 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:59.203119 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 849/1719] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:50:58 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:50:59.204080 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3dc3c-01fd-426f-a065-1018325accfe admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:59.240495 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff3dc3c-01fd-426f-a065-1018325accfe admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:59.259840 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 871/1720] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:50:58 2022] POST /identity/v3/projects => generated 367 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:59.263379 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a44639-7555-4997-ba21-265ef1b86475 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:59.266869 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c9398-679b-4a0a-9751-66c476ce31ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:59.274577 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c9398-679b-4a0a-9751-66c476ce31ea admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:59.274894 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c9398-679b-4a0a-9751-66c476ce31ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:59.275173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c9398-679b-4a0a-9751-66c476ce31ea admin admin] PATH_INFO: `/v3/projects/f750b3a639644a44bacb8a0b8646c8da/users/e131c1835c7c4bb8bcc5eacd29be5a40/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:59.284892 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c9398-679b-4a0a-9751-66c476ce31ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f750b3a639644a44bacb8a0b8646c8da, user_id=e131c1835c7c4bb8bcc5eacd29be5a40, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:59.289584 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c9398-679b-4a0a-9751-66c476ce31ea admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:59.382140 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 850/1721] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:50:59 2022] PUT /identity/v3/projects/f750b3a639644a44bacb8a0b8646c8da/users/e131c1835c7c4bb8bcc5eacd29be5a40/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:50:59.384711 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27482b4e-d72b-4b43-b71f-2c5789e67f13 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:59.385173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27482b4e-d72b-4b43-b71f-2c5789e67f13 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:59.385587 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27482b4e-d72b-4b43-b71f-2c5789e67f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:59.500889 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-27482b4e-d72b-4b43-b71f-2c5789e67f13 None None] MFA Rules not processed for user `e131c1835c7c4bb8bcc5eacd29be5a40`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:50:59.504481 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a44639-7555-4997-ba21-265ef1b86475 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:59.505525 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-27482b4e-d72b-4b43-b71f-2c5789e67f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:59.728899 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08911083-da2a-40fc-bb7e-c11a156ba6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:59.729786 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08911083-da2a-40fc-bb7e-c11a156ba6be admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:59.730071 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08911083-da2a-40fc-bb7e-c11a156ba6be admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:59.730348 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08911083-da2a-40fc-bb7e-c11a156ba6be admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:59.731076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08911083-da2a-40fc-bb7e-c11a156ba6be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:59.733109 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08911083-da2a-40fc-bb7e-c11a156ba6be admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:59.774029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 851/1722] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:50:59 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:50:59.777098 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27482b4e-d72b-4b43-b71f-2c5789e67f13 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:59.795905 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 872/1723] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:50:59 2022] POST /identity/v3/users => generated 290 bytes in 530 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:50:59.795905 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08911083-da2a-40fc-bb7e-c11a156ba6be admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:50:59.800732 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-08911083-da2a-40fc-bb7e-c11a156ba6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:50:59.914881 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27482b4e-d72b-4b43-b71f-2c5789e67f13 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:59.925555 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a790dd5-6055-4048-8e61-3e1d2c2f1b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:59.926650 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a790dd5-6055-4048-8e61-3e1d2c2f1b09 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:59.928913 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a790dd5-6055-4048-8e61-3e1d2c2f1b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:59.930065 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a790dd5-6055-4048-8e61-3e1d2c2f1b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:50:59.957524 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a790dd5-6055-4048-8e61-3e1d2c2f1b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:50:59.964997 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a790dd5-6055-4048-8e61-3e1d2c2f1b09 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:50:59.965178 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08911083-da2a-40fc-bb7e-c11a156ba6be admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:50:59.982724 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834efb1b-9da8-4fd2-9ac2-26ed3d68d791 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6659c6661840a79ba9ff1c3c9e93c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:50:59.983357 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834efb1b-9da8-4fd2-9ac2-26ed3d68d791 service swift] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:50:59.983891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834efb1b-9da8-4fd2-9ac2-26ed3d68d791 service swift] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:50:59.983891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834efb1b-9da8-4fd2-9ac2-26ed3d68d791 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:00.003790 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 852/1724] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:50:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:00.004804 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a790dd5-6055-4048-8e61-3e1d2c2f1b09 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:00.054454 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a790dd5-6055-4048-8e61-3e1d2c2f1b09 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:00.085309 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ab801-e4d1-453b-ad17-62149e057a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:00.086242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ab801-e4d1-453b-ad17-62149e057a3c admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:00.086691 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ab801-e4d1-453b-ad17-62149e057a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:00.087105 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ab801-e4d1-453b-ad17-62149e057a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:00.087959 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ab801-e4d1-453b-ad17-62149e057a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:00.089737 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ab801-e4d1-453b-ad17-62149e057a3c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:00.121566 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 853/1725] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:00.122518 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ab801-e4d1-453b-ad17-62149e057a3c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:00.133916 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-cb2ab801-e4d1-453b-ad17-62149e057a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:00.182801 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834efb1b-9da8-4fd2-9ac2-26ed3d68d791 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:00.184554 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834efb1b-9da8-4fd2-9ac2-26ed3d68d791 service swift] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:00.194820 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 873/1726] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Apr 11 16:50:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:51:00.196726 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834efb1b-9da8-4fd2-9ac2-26ed3d68d791 service swift] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:00.198280 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-834efb1b-9da8-4fd2-9ac2-26ed3d68d791 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:00.208619 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ab801-e4d1-453b-ad17-62149e057a3c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:00.213916 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae2627-3926-4bd8-86fb-3067c8473d83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:00.214843 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae2627-3926-4bd8-86fb-3067c8473d83 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:00.229381 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae2627-3926-4bd8-86fb-3067c8473d83 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:00.229971 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae2627-3926-4bd8-86fb-3067c8473d83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:00.233228 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834efb1b-9da8-4fd2-9ac2-26ed3d68d791 service swift] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:00.246014 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae2627-3926-4bd8-86fb-3067c8473d83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:00.247550 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57368b78-fdac-4ae2-9b43-dca226646d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:00.248344 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffae2627-3926-4bd8-86fb-3067c8473d83 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:00.255517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57368b78-fdac-4ae2-9b43-dca226646d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:00.255787 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57368b78-fdac-4ae2-9b43-dca226646d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:00.256124 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57368b78-fdac-4ae2-9b43-dca226646d57 admin admin] PATH_INFO: `/v3/users/710b76532ab64b3f9e5e6917a714694c` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:00.258803 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57368b78-fdac-4ae2-9b43-dca226646d57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=710b76532ab64b3f9e5e6917a714694c)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:00.260771 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57368b78-fdac-4ae2-9b43-dca226646d57 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:00.281208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 854/1727] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:00 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:00.282426 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae2627-3926-4bd8-86fb-3067c8473d83 service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:00.307611 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae2627-3926-4bd8-86fb-3067c8473d83 service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:00.354181 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e5bd1-8251-4650-a353-f9fa983c159d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:00.356390 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e5bd1-8251-4650-a353-f9fa983c159d admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:00.356742 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e5bd1-8251-4650-a353-f9fa983c159d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:00.358115 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e5bd1-8251-4650-a353-f9fa983c159d admin admin] PATH_INFO: `/v3/projects/8df2450b987b43fabd29bc93b47335e2/users/c554c8766387470bb094f3204e6ab5ce/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:00.454036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e5bd1-8251-4650-a353-f9fa983c159d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df2450b987b43fabd29bc93b47335e2, user_id=c554c8766387470bb094f3204e6ab5ce, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:00.462532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e5bd1-8251-4650-a353-f9fa983c159d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:00.483350 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-57368b78-fdac-4ae2-9b43-dca226646d57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '710b76532ab64b3f9e5e6917a714694c'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:00.486327 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-57368b78-fdac-4ae2-9b43-dca226646d57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '710b76532ab64b3f9e5e6917a714694c'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:00.490201 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 855/1728] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:00 2022] PUT /identity/v3/projects/8df2450b987b43fabd29bc93b47335e2/users/c554c8766387470bb094f3204e6ab5ce/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:00.494553 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e5bd1-8251-4650-a353-f9fa983c159d admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:00.533595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-57368b78-fdac-4ae2-9b43-dca226646d57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '710b76532ab64b3f9e5e6917a714694c'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:00.565111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-57368b78-fdac-4ae2-9b43-dca226646d57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '710b76532ab64b3f9e5e6917a714694c'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:00.648769 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-57368b78-fdac-4ae2-9b43-dca226646d57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '710b76532ab64b3f9e5e6917a714694c'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:00.686451 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e5bd1-8251-4650-a353-f9fa983c159d admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:00.694211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 874/1729] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:00 2022] DELETE /identity/v3/users/710b76532ab64b3f9e5e6917a714694c => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:00.697593 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed940b-5769-42b4-9dd3-c2c6707f4b94 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:00.697894 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed940b-5769-42b4-9dd3-c2c6707f4b94 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:00.698165 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed940b-5769-42b4-9dd3-c2c6707f4b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:00.763676 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-a5ed940b-5769-42b4-9dd3-c2c6707f4b94 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:00.777080 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a5ed940b-5769-42b4-9dd3-c2c6707f4b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:00.884646 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 875/1730] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:00.888211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed940b-5769-42b4-9dd3-c2c6707f4b94 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:00.888898 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a5ed940b-5769-42b4-9dd3-c2c6707f4b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:00.916453 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed940b-5769-42b4-9dd3-c2c6707f4b94 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:00.925290 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc689fbd-56b2-4cd9-9ca4-d848e7029927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:00.926824 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc689fbd-56b2-4cd9-9ca4-d848e7029927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:00.927219 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc689fbd-56b2-4cd9-9ca4-d848e7029927 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:00.927664 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc689fbd-56b2-4cd9-9ca4-d848e7029927 admin admin] PATH_INFO: `/v3/projects/675a09639a6b450d8bc849f12061edac` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:00.929858 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc689fbd-56b2-4cd9-9ca4-d848e7029927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=675a09639a6b450d8bc849f12061edac)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:00.933563 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc689fbd-56b2-4cd9-9ca4-d848e7029927 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:01.030477 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-bc689fbd-56b2-4cd9-9ca4-d848e7029927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '675a09639a6b450d8bc849f12061edac', 'request_id': 'req-bc689fbd-56b2-4cd9-9ca4-d848e7029927'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:01.042108 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-bc689fbd-56b2-4cd9-9ca4-d848e7029927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '675a09639a6b450d8bc849f12061edac', 'request_id': 'req-bc689fbd-56b2-4cd9-9ca4-d848e7029927'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:01.052210 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-bc689fbd-56b2-4cd9-9ca4-d848e7029927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '675a09639a6b450d8bc849f12061edac', 'request_id': 'req-bc689fbd-56b2-4cd9-9ca4-d848e7029927'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:01.112446 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-bc689fbd-56b2-4cd9-9ca4-d848e7029927 admin admin] The token cache is being invalidate because project 675a09639a6b450d8bc849f12061edac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:01.112832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-bc689fbd-56b2-4cd9-9ca4-d848e7029927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:01.115912 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-bc689fbd-56b2-4cd9-9ca4-d848e7029927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:01.119836 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06098220-cbc4-4120-afbb-647645b721d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:01.123182 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06098220-cbc4-4120-afbb-647645b721d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:01.123438 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06098220-cbc4-4120-afbb-647645b721d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:01.123723 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06098220-cbc4-4120-afbb-647645b721d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:01.131698 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 876/1731] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:00 2022] DELETE /identity/v3/projects/675a09639a6b450d8bc849f12061edac => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:01.137922 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc689fbd-56b2-4cd9-9ca4-d848e7029927 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:01.138295 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06098220-cbc4-4120-afbb-647645b721d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:01.144572 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-bc689fbd-56b2-4cd9-9ca4-d848e7029927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:01.148839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06098220-cbc4-4120-afbb-647645b721d1 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:01.219558 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 856/1732] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 726 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:01.220484 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06098220-cbc4-4120-afbb-647645b721d1 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:01.240081 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-06098220-cbc4-4120-afbb-647645b721d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:01.308570 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc689fbd-56b2-4cd9-9ca4-d848e7029927 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:01.320496 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fbcfe-23da-433f-8644-d0ae89035794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:01.321527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fbcfe-23da-433f-8644-d0ae89035794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:01.321715 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fbcfe-23da-433f-8644-d0ae89035794 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:01.322181 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fbcfe-23da-433f-8644-d0ae89035794 admin admin] PATH_INFO: `/v3/users/51ca213b2c7e4498aa471cf22da6c60a` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:01.324675 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fbcfe-23da-433f-8644-d0ae89035794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51ca213b2c7e4498aa471cf22da6c60a)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:01.332374 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fbcfe-23da-433f-8644-d0ae89035794 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:01.433859 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-763fbcfe-23da-433f-8644-d0ae89035794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51ca213b2c7e4498aa471cf22da6c60a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:01.434884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-763fbcfe-23da-433f-8644-d0ae89035794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51ca213b2c7e4498aa471cf22da6c60a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:01.449822 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-763fbcfe-23da-433f-8644-d0ae89035794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51ca213b2c7e4498aa471cf22da6c60a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:01.468564 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-763fbcfe-23da-433f-8644-d0ae89035794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51ca213b2c7e4498aa471cf22da6c60a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:01.502792 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-763fbcfe-23da-433f-8644-d0ae89035794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51ca213b2c7e4498aa471cf22da6c60a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:01.518642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 877/1733] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:01 2022] DELETE /identity/v3/users/51ca213b2c7e4498aa471cf22da6c60a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:01.519810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fbcfe-23da-433f-8644-d0ae89035794 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:01.522934 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-763fbcfe-23da-433f-8644-d0ae89035794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:01.554284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06098220-cbc4-4120-afbb-647645b721d1 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:01.681792 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fbcfe-23da-433f-8644-d0ae89035794 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:01.697630 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57a1ec-534e-4d6a-ba07-913de37cae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:01.698535 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57a1ec-534e-4d6a-ba07-913de37cae43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:01.698874 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57a1ec-534e-4d6a-ba07-913de37cae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:01.699141 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57a1ec-534e-4d6a-ba07-913de37cae43 admin admin] PATH_INFO: `/v3/users/e16a853f4b8f40db877af294eb6fc5c0` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:01.702293 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57a1ec-534e-4d6a-ba07-913de37cae43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16a853f4b8f40db877af294eb6fc5c0)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:01.715538 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57a1ec-534e-4d6a-ba07-913de37cae43 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:01.786284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3df5c-0628-4fcd-8dba-2044d8d5ab2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:01.789464 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3df5c-0628-4fcd-8dba-2044d8d5ab2d service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:01.790006 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3df5c-0628-4fcd-8dba-2044d8d5ab2d service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:01.791362 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3df5c-0628-4fcd-8dba-2044d8d5ab2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:01.808508 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c6a3df5c-0628-4fcd-8dba-2044d8d5ab2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:01.885796 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3df5c-0628-4fcd-8dba-2044d8d5ab2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:01.893905 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3df5c-0628-4fcd-8dba-2044d8d5ab2d service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:01.931745 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5a57a1ec-534e-4d6a-ba07-913de37cae43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16a853f4b8f40db877af294eb6fc5c0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:01.936581 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5a57a1ec-534e-4d6a-ba07-913de37cae43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16a853f4b8f40db877af294eb6fc5c0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:01.974244 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5a57a1ec-534e-4d6a-ba07-913de37cae43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16a853f4b8f40db877af294eb6fc5c0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:01.986300 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5a57a1ec-534e-4d6a-ba07-913de37cae43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16a853f4b8f40db877af294eb6fc5c0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:01.988723 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 857/1734] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 768 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:01.990635 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3df5c-0628-4fcd-8dba-2044d8d5ab2d service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:01.998875 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c6a3df5c-0628-4fcd-8dba-2044d8d5ab2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:02.027118 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5a57a1ec-534e-4d6a-ba07-913de37cae43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16a853f4b8f40db877af294eb6fc5c0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:02.042061 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3df5c-0628-4fcd-8dba-2044d8d5ab2d service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:02.051635 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 878/1735] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:01 2022] DELETE /identity/v3/users/e16a853f4b8f40db877af294eb6fc5c0 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:02.053179 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199841f-f505-48cf-9a38-6ffe9b30997a None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:02.053468 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199841f-f505-48cf-9a38-6ffe9b30997a None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:02.053751 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199841f-f505-48cf-9a38-6ffe9b30997a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:02.127891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-8199841f-f505-48cf-9a38-6ffe9b30997a None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:02.130391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-8199841f-f505-48cf-9a38-6ffe9b30997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:02.365422 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2712d8b-3054-4d32-b691-35b811014191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:02.366305 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2712d8b-3054-4d32-b691-35b811014191 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:02.369303 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2712d8b-3054-4d32-b691-35b811014191 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:02.369754 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2712d8b-3054-4d32-b691-35b811014191 admin admin] PATH_INFO: `/v3/projects/8df2450b987b43fabd29bc93b47335e2/users/c554c8766387470bb094f3204e6ab5ce/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:02.374978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2712d8b-3054-4d32-b691-35b811014191 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df2450b987b43fabd29bc93b47335e2, user_id=c554c8766387470bb094f3204e6ab5ce, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:02.383089 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2712d8b-3054-4d32-b691-35b811014191 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:02.428086 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 858/1736] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:01 2022] PUT /identity/v3/projects/8df2450b987b43fabd29bc93b47335e2/users/c554c8766387470bb094f3204e6ab5ce/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:02.431321 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2712d8b-3054-4d32-b691-35b811014191 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:02.434685 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 879/1737] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:02.436220 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72841c71-900b-45ac-92ee-979cd68ccbae None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:02.436663 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72841c71-900b-45ac-92ee-979cd68ccbae None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:02.437176 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72841c71-900b-45ac-92ee-979cd68ccbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:02.439470 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f2712d8b-3054-4d32-b691-35b811014191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:02.517180 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-72841c71-900b-45ac-92ee-979cd68ccbae None None] MFA Rules not processed for user `c554c8766387470bb094f3204e6ab5ce`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:02.518448 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-72841c71-900b-45ac-92ee-979cd68ccbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:02.638270 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2712d8b-3054-4d32-b691-35b811014191 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:02.651010 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427767c-504f-47f8-b684-1063e4468ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:02.652679 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427767c-504f-47f8-b684-1063e4468ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:02.652964 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427767c-504f-47f8-b684-1063e4468ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:02.653242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427767c-504f-47f8-b684-1063e4468ad9 admin admin] PATH_INFO: `/v3/users/5abbbf5aabab4cf7b1921473b5528955` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:02.659845 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427767c-504f-47f8-b684-1063e4468ad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5abbbf5aabab4cf7b1921473b5528955)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:02.663099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427767c-504f-47f8-b684-1063e4468ad9 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:02.706026 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 880/1738] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:02.707054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72841c71-900b-45ac-92ee-979cd68ccbae None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:02.708743 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-72841c71-900b-45ac-92ee-979cd68ccbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:02.804118 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e427767c-504f-47f8-b684-1063e4468ad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5abbbf5aabab4cf7b1921473b5528955'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:02.816460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e427767c-504f-47f8-b684-1063e4468ad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5abbbf5aabab4cf7b1921473b5528955'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:02.817487 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e427767c-504f-47f8-b684-1063e4468ad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5abbbf5aabab4cf7b1921473b5528955'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:02.835489 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e427767c-504f-47f8-b684-1063e4468ad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5abbbf5aabab4cf7b1921473b5528955'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:02.841846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72841c71-900b-45ac-92ee-979cd68ccbae None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:02.855349 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f5105-d9e3-478a-8d80-6b3f3da4c21e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:02.859601 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f5105-d9e3-478a-8d80-6b3f3da4c21e service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:02.860323 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f5105-d9e3-478a-8d80-6b3f3da4c21e service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:02.862864 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f5105-d9e3-478a-8d80-6b3f3da4c21e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:02.866985 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b89f5105-d9e3-478a-8d80-6b3f3da4c21e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:02.869071 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e427767c-504f-47f8-b684-1063e4468ad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5abbbf5aabab4cf7b1921473b5528955'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:02.893458 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 859/1739] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:02 2022] DELETE /identity/v3/users/5abbbf5aabab4cf7b1921473b5528955 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:02.897220 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cffe5-a729-433f-b941-c977433b6118 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:02.897679 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cffe5-a729-433f-b941-c977433b6118 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:02.898095 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cffe5-a729-433f-b941-c977433b6118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:02.903502 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f5105-d9e3-478a-8d80-6b3f3da4c21e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:02.905187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f5105-d9e3-478a-8d80-6b3f3da4c21e service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:02.933029 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 881/1740] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:02.934211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f5105-d9e3-478a-8d80-6b3f3da4c21e service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:02.937992 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b89f5105-d9e3-478a-8d80-6b3f3da4c21e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:02.942052 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-523cffe5-a729-433f-b941-c977433b6118 None None] MFA Rules not processed for user `7990c92f59454156bbd99445387ca889`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:02.945337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-523cffe5-a729-433f-b941-c977433b6118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:03.083058 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 860/1741] 10.222.0.15 () {58 vars in 1015 bytes} [Mon Apr 11 16:51:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:03.084765 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e0b27-002d-4e0e-ae21-b4a372270be2 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:03.085202 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e0b27-002d-4e0e-ae21-b4a372270be2 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:03.085625 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e0b27-002d-4e0e-ae21-b4a372270be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:03.120997 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f5105-d9e3-478a-8d80-6b3f3da4c21e service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:03.143875 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-070e0b27-002d-4e0e-ae21-b4a372270be2 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:03.145447 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-070e0b27-002d-4e0e-ae21-b4a372270be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:03.256121 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4400a-fa15-41f1-89f1-633d45d5bb9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:03.257107 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4400a-fa15-41f1-89f1-633d45d5bb9c service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:03.258403 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4400a-fa15-41f1-89f1-633d45d5bb9c service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:03.258894 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4400a-fa15-41f1-89f1-633d45d5bb9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:03.265953 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-94b4400a-fa15-41f1-89f1-633d45d5bb9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:03.311817 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 861/1742] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:03.315930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a15f86-29c6-4167-a94a-154fa440e0d5 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:03.316435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a15f86-29c6-4167-a94a-154fa440e0d5 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:03.317285 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a15f86-29c6-4167-a94a-154fa440e0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:03.362323 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-15a15f86-29c6-4167-a94a-154fa440e0d5 None None] MFA Rules not processed for user `8ff2ac0b68d1414fb72955edc07ee3fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:03.364850 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-15a15f86-29c6-4167-a94a-154fa440e0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:03.429805 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4400a-fa15-41f1-89f1-633d45d5bb9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:03.431313 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4400a-fa15-41f1-89f1-633d45d5bb9c service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:03.461221 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 882/1743] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:02 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:03.463818 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4400a-fa15-41f1-89f1-633d45d5bb9c service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:03.467614 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-94b4400a-fa15-41f1-89f1-633d45d5bb9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:03.493338 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 862/1744] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:03.495592 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a15f86-29c6-4167-a94a-154fa440e0d5 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:03.502395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-15a15f86-29c6-4167-a94a-154fa440e0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:03.504310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4400a-fa15-41f1-89f1-633d45d5bb9c service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:03.516292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f2667-41ae-4aaf-a254-b3f78d0bdfb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:03.522012 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f2667-41ae-4aaf-a254-b3f78d0bdfb0 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:03.522189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f2667-41ae-4aaf-a254-b3f78d0bdfb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:03.522469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f2667-41ae-4aaf-a254-b3f78d0bdfb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:03.548404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a15f86-29c6-4167-a94a-154fa440e0d5 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:03.561199 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f2667-41ae-4aaf-a254-b3f78d0bdfb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:03.563123 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f2667-41ae-4aaf-a254-b3f78d0bdfb0 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:03.568308 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a682a5d-911d-4430-ad72-5cff91961774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:03.571052 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a682a5d-911d-4430-ad72-5cff91961774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:03.571340 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a682a5d-911d-4430-ad72-5cff91961774 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:03.571623 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a682a5d-911d-4430-ad72-5cff91961774 admin admin] PATH_INFO: `/v3/projects/4c1eaeb25dca40618827018a56b90f68` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:03.583251 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a682a5d-911d-4430-ad72-5cff91961774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1eaeb25dca40618827018a56b90f68)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:03.588148 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a682a5d-911d-4430-ad72-5cff91961774 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:03.607375 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 883/1745] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:03.614911 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f2667-41ae-4aaf-a254-b3f78d0bdfb0 service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:03.617919 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-e94f2667-41ae-4aaf-a254-b3f78d0bdfb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:03.666691 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f2667-41ae-4aaf-a254-b3f78d0bdfb0 service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:03.680531 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713857b0-8300-4e46-bc7e-4502551defd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:03.681217 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713857b0-8300-4e46-bc7e-4502551defd8 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:03.681504 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713857b0-8300-4e46-bc7e-4502551defd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:03.681780 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713857b0-8300-4e46-bc7e-4502551defd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:03.685940 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-713857b0-8300-4e46-bc7e-4502551defd8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:03.724706 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-2a682a5d-911d-4430-ad72-5cff91961774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1eaeb25dca40618827018a56b90f68', 'request_id': 'req-2a682a5d-911d-4430-ad72-5cff91961774'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:03.745578 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-2a682a5d-911d-4430-ad72-5cff91961774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1eaeb25dca40618827018a56b90f68', 'request_id': 'req-2a682a5d-911d-4430-ad72-5cff91961774'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:03.754037 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-2a682a5d-911d-4430-ad72-5cff91961774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1eaeb25dca40618827018a56b90f68', 'request_id': 'req-2a682a5d-911d-4430-ad72-5cff91961774'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:03.795844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-2a682a5d-911d-4430-ad72-5cff91961774 admin admin] The token cache is being invalidate because project 4c1eaeb25dca40618827018a56b90f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:03.797921 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-2a682a5d-911d-4430-ad72-5cff91961774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:03.802727 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-2a682a5d-911d-4430-ad72-5cff91961774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:03.817173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 863/1746] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:03 2022] DELETE /identity/v3/projects/4c1eaeb25dca40618827018a56b90f68 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:03.826092 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f3de2-d3ac-4b44-bce2-ccb809e0fe59 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:03.826682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f3de2-d3ac-4b44-bce2-ccb809e0fe59 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:03.827301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88f3de2-d3ac-4b44-bce2-ccb809e0fe59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:03.904086 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713857b0-8300-4e46-bc7e-4502551defd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:03.905625 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713857b0-8300-4e46-bc7e-4502551defd8 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:03.909374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-d88f3de2-d3ac-4b44-bce2-ccb809e0fe59 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:03.910676 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d88f3de2-d3ac-4b44-bce2-ccb809e0fe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:03.937029 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 884/1747] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:03 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:04.133036 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713857b0-8300-4e46-bc7e-4502551defd8 service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:04.153345 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713857b0-8300-4e46-bc7e-4502551defd8 service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:04.154667 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 864/1748] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:04.167363 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f3de2-d3ac-4b44-bce2-ccb809e0fe59 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:04.177103 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d88f3de2-d3ac-4b44-bce2-ccb809e0fe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:04.379535 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17c9f5-994a-4d10-a69d-957fc1836fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:04.380182 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17c9f5-994a-4d10-a69d-957fc1836fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:04.380465 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17c9f5-994a-4d10-a69d-957fc1836fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:04.380741 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17c9f5-994a-4d10-a69d-957fc1836fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:04.387519 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-2e17c9f5-994a-4d10-a69d-957fc1836fc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:04.408195 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17c9f5-994a-4d10-a69d-957fc1836fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:04.409628 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88f3de2-d3ac-4b44-bce2-ccb809e0fe59 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:04.409749 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17c9f5-994a-4d10-a69d-957fc1836fc6 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:04.414238 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86e30b-2bfe-4973-96ca-ccac0c0efed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:04.414864 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86e30b-2bfe-4973-96ca-ccac0c0efed9 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:04.415141 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86e30b-2bfe-4973-96ca-ccac0c0efed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:04.415414 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86e30b-2bfe-4973-96ca-ccac0c0efed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:04.429449 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 885/1749] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:51:04.430629 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86e30b-2bfe-4973-96ca-ccac0c0efed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:04.431033 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd893f9c-3ee4-423c-acc4-99a821f91b60 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:04.431334 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd893f9c-3ee4-423c-acc4-99a821f91b60 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:04.431586 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd893f9c-3ee4-423c-acc4-99a821f91b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:04.432058 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86e30b-2bfe-4973-96ca-ccac0c0efed9 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:04.446212 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 865/1750] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:04.447759 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86e30b-2bfe-4973-96ca-ccac0c0efed9 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:04.450628 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3e86e30b-2bfe-4973-96ca-ccac0c0efed9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:04.477426 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-dd893f9c-3ee4-423c-acc4-99a821f91b60 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:04.478714 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-dd893f9c-3ee4-423c-acc4-99a821f91b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:04.498010 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 886/1751] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:04.498976 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd893f9c-3ee4-423c-acc4-99a821f91b60 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:04.509879 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86e30b-2bfe-4973-96ca-ccac0c0efed9 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:04.538518 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbf237-06fd-4d1f-b64c-5390099987ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:04.538695 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd893f9c-3ee4-423c-acc4-99a821f91b60 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:04.539855 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbf237-06fd-4d1f-b64c-5390099987ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:04.540140 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbf237-06fd-4d1f-b64c-5390099987ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:04.540415 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbf237-06fd-4d1f-b64c-5390099987ff admin admin] PATH_INFO: `/v3/projects/29e7f2947a01426c9cd282e1e5732337` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:04.542329 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbf237-06fd-4d1f-b64c-5390099987ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e7f2947a01426c9cd282e1e5732337)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:04.545367 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dbf237-06fd-4d1f-b64c-5390099987ff admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:04.578736 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490aaf6-abec-4f74-ad13-e02fcf05d790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:04.579970 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490aaf6-abec-4f74-ad13-e02fcf05d790 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:04.580235 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490aaf6-abec-4f74-ad13-e02fcf05d790 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:04.580526 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490aaf6-abec-4f74-ad13-e02fcf05d790 admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:04.581232 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490aaf6-abec-4f74-ad13-e02fcf05d790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:51:04.581532 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490aaf6-abec-4f74-ad13-e02fcf05d790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:04.591125 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a490aaf6-abec-4f74-ad13-e02fcf05d790 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:04.649392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 887/1752] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:51:04.650347 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490aaf6-abec-4f74-ad13-e02fcf05d790 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:04.657246 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-83dbf237-06fd-4d1f-b64c-5390099987ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e7f2947a01426c9cd282e1e5732337', 'request_id': 'req-83dbf237-06fd-4d1f-b64c-5390099987ff'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:04.665082 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-83dbf237-06fd-4d1f-b64c-5390099987ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e7f2947a01426c9cd282e1e5732337', 'request_id': 'req-83dbf237-06fd-4d1f-b64c-5390099987ff'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:04.673648 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-83dbf237-06fd-4d1f-b64c-5390099987ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e7f2947a01426c9cd282e1e5732337', 'request_id': 'req-83dbf237-06fd-4d1f-b64c-5390099987ff'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:04.686803 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a490aaf6-abec-4f74-ad13-e02fcf05d790 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:04.723291 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-83dbf237-06fd-4d1f-b64c-5390099987ff admin admin] The token cache is being invalidate because project 29e7f2947a01426c9cd282e1e5732337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:04.725790 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-83dbf237-06fd-4d1f-b64c-5390099987ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:04.727093 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-83dbf237-06fd-4d1f-b64c-5390099987ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:04.736104 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 866/1753] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:04 2022] DELETE /identity/v3/projects/29e7f2947a01426c9cd282e1e5732337 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:04.742211 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97d0a0-07fc-4d1b-be11-12e68cc2499a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:04.742761 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97d0a0-07fc-4d1b-be11-12e68cc2499a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:04.743045 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d97d0a0-07fc-4d1b-be11-12e68cc2499a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:04.834730 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6d97d0a0-07fc-4d1b-be11-12e68cc2499a None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:04.840533 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6d97d0a0-07fc-4d1b-be11-12e68cc2499a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:04.888243 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed7853-39d7-449d-9246-c628ce226371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:04.890728 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed7853-39d7-449d-9246-c628ce226371 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:04.891189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed7853-39d7-449d-9246-c628ce226371 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:04.892332 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed7853-39d7-449d-9246-c628ce226371 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:04.893679 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed7853-39d7-449d-9246-c628ce226371 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:04.899837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed7853-39d7-449d-9246-c628ce226371 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:05.010837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 888/1754] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:04 2022] POST /identity/v3/projects => generated 365 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:05.013848 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed7853-39d7-449d-9246-c628ce226371 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:05.017783 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-e7ed7853-39d7-449d-9246-c628ce226371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:05.144227 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 867/1755] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:05.150375 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84717822-52bc-468d-a51b-1417c8560bfe None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:05.152058 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84717822-52bc-468d-a51b-1417c8560bfe None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:05.152351 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84717822-52bc-468d-a51b-1417c8560bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:05.179364 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed7853-39d7-449d-9246-c628ce226371 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:05.193112 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded5cf7-232f-49b6-b9c2-19f6a53d6464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:05.193891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded5cf7-232f-49b6-b9c2-19f6a53d6464 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:05.194178 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded5cf7-232f-49b6-b9c2-19f6a53d6464 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:05.194459 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded5cf7-232f-49b6-b9c2-19f6a53d6464 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:05.195197 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded5cf7-232f-49b6-b9c2-19f6a53d6464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:05.199291 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded5cf7-232f-49b6-b9c2-19f6a53d6464 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:05.200703 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-84717822-52bc-468d-a51b-1417c8560bfe None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:05.209167 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-84717822-52bc-468d-a51b-1417c8560bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:05.250723 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 868/1756] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:05.258469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 889/1757] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:05 2022] POST /identity/v3/users => generated 283 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:05.258639 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84717822-52bc-468d-a51b-1417c8560bfe None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:05.260225 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded5cf7-232f-49b6-b9c2-19f6a53d6464 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:05.276415 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84717822-52bc-468d-a51b-1417c8560bfe None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:05.280472 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded5cf7-232f-49b6-b9c2-19f6a53d6464 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:05.286446 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da18d35-e6fe-445a-a0b9-90dd71040641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:05.287383 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da18d35-e6fe-445a-a0b9-90dd71040641 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:05.287907 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da18d35-e6fe-445a-a0b9-90dd71040641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:05.290182 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada44b39-e566-4ec5-b693-ef7d801db396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:05.290899 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada44b39-e566-4ec5-b693-ef7d801db396 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:05.291180 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada44b39-e566-4ec5-b693-ef7d801db396 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:05.291453 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada44b39-e566-4ec5-b693-ef7d801db396 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:05.292183 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada44b39-e566-4ec5-b693-ef7d801db396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:05.292445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da18d35-e6fe-445a-a0b9-90dd71040641 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:05.293288 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da18d35-e6fe-445a-a0b9-90dd71040641 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:51:05.293606 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da18d35-e6fe-445a-a0b9-90dd71040641 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:05.293783 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada44b39-e566-4ec5-b693-ef7d801db396 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:05.295727 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da18d35-e6fe-445a-a0b9-90dd71040641 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:05.325948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 890/1758] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:05.330352 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 869/1759] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:51:05.330503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada44b39-e566-4ec5-b693-ef7d801db396 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:05.332664 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da18d35-e6fe-445a-a0b9-90dd71040641 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:05.353630 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada44b39-e566-4ec5-b693-ef7d801db396 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:05.356756 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da18d35-e6fe-445a-a0b9-90dd71040641 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:05.364019 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0265616-3dd2-44b8-8ec7-513351d28a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:05.364744 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0265616-3dd2-44b8-8ec7-513351d28a32 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:05.365029 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0265616-3dd2-44b8-8ec7-513351d28a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:05.365449 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0265616-3dd2-44b8-8ec7-513351d28a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:05.366187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0265616-3dd2-44b8-8ec7-513351d28a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:05.367891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0265616-3dd2-44b8-8ec7-513351d28a32 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:05.375704 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616df24-78a7-4c95-bbed-5f0fb71df7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:05.376608 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616df24-78a7-4c95-bbed-5f0fb71df7b9 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:05.376937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616df24-78a7-4c95-bbed-5f0fb71df7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:05.377350 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3616df24-78a7-4c95-bbed-5f0fb71df7b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:05.378485 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616df24-78a7-4c95-bbed-5f0fb71df7b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:05.380911 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3616df24-78a7-4c95-bbed-5f0fb71df7b9 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:05.395840 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 891/1760] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:05.397268 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0265616-3dd2-44b8-8ec7-513351d28a32 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:05.418631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0265616-3dd2-44b8-8ec7-513351d28a32 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:05.429072 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4da55-de70-46c1-a6cd-909fa03d7c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:05.430076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4da55-de70-46c1-a6cd-909fa03d7c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:05.430358 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4da55-de70-46c1-a6cd-909fa03d7c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:05.430661 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4da55-de70-46c1-a6cd-909fa03d7c12 admin admin] PATH_INFO: `/v3/projects/534ef3581f814eb58d65bced712f1652/users/09caf2b0382744e7a5cbbcbf983cea2b/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:05.449462 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 870/1761] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:05 2022] POST /identity/v3/projects => generated 387 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:05.450963 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616df24-78a7-4c95-bbed-5f0fb71df7b9 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:05.475134 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4da55-de70-46c1-a6cd-909fa03d7c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=534ef3581f814eb58d65bced712f1652, user_id=09caf2b0382744e7a5cbbcbf983cea2b, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:05.485156 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d4da55-de70-46c1-a6cd-909fa03d7c12 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:05.520626 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 892/1762] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:05 2022] PUT /identity/v3/projects/534ef3581f814eb58d65bced712f1652/users/09caf2b0382744e7a5cbbcbf983cea2b/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:05.526503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bddf21-23b7-4233-ae3a-78e6bc61c13b None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:05.526849 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bddf21-23b7-4233-ae3a-78e6bc61c13b None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:05.527099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bddf21-23b7-4233-ae3a-78e6bc61c13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:05.610120 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-99bddf21-23b7-4233-ae3a-78e6bc61c13b None None] MFA Rules not processed for user `09caf2b0382744e7a5cbbcbf983cea2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:05.611908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-99bddf21-23b7-4233-ae3a-78e6bc61c13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:05.627033 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3616df24-78a7-4c95-bbed-5f0fb71df7b9 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:05.820565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 893/1763] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:05.825117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bddf21-23b7-4233-ae3a-78e6bc61c13b None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:05.882080 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb8d14-e5dc-47c0-91ef-e6fb7a484ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:05.883185 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb8d14-e5dc-47c0-91ef-e6fb7a484ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:05.883507 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb8d14-e5dc-47c0-91ef-e6fb7a484ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:05.883989 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb8d14-e5dc-47c0-91ef-e6fb7a484ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:05.884996 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb8d14-e5dc-47c0-91ef-e6fb7a484ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:05.888559 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb8d14-e5dc-47c0-91ef-e6fb7a484ed1 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:05.962488 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 871/1764] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:05 2022] POST /identity/v3/users => generated 294 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:51:05.964068 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb8d14-e5dc-47c0-91ef-e6fb7a484ed1 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:05.977586 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb8d14-e5dc-47c0-91ef-e6fb7a484ed1 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:05.984071 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a02d8-0719-4865-8e53-6eab072f941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:05.985104 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a02d8-0719-4865-8e53-6eab072f941c admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:05.985708 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a02d8-0719-4865-8e53-6eab072f941c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:05.986292 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108a02d8-0719-4865-8e53-6eab072f941c admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:05.987386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a02d8-0719-4865-8e53-6eab072f941c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:05.990817 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108a02d8-0719-4865-8e53-6eab072f941c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:06.037130 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bddf21-23b7-4233-ae3a-78e6bc61c13b None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:06.042980 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 872/1765] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:06.044134 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a02d8-0719-4865-8e53-6eab072f941c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:06.045964 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c0f5d-1a98-4b46-83fd-4576253ce68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:06.046668 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c0f5d-1a98-4b46-83fd-4576253ce68b admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:06.046953 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c0f5d-1a98-4b46-83fd-4576253ce68b admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:06.047281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c0f5d-1a98-4b46-83fd-4576253ce68b admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:06.048490 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c0f5d-1a98-4b46-83fd-4576253ce68b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:06.057266 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108a02d8-0719-4865-8e53-6eab072f941c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:06.061344 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1c0f5d-1a98-4b46-83fd-4576253ce68b admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:06.066803 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95833b1-dae5-498e-8c2c-943fe4d56feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:06.068303 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95833b1-dae5-498e-8c2c-943fe4d56feb admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:06.069995 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95833b1-dae5-498e-8c2c-943fe4d56feb admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:06.070480 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95833b1-dae5-498e-8c2c-943fe4d56feb admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:06.071468 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95833b1-dae5-498e-8c2c-943fe4d56feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:06.074507 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95833b1-dae5-498e-8c2c-943fe4d56feb admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:06.103415 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 873/1766] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:06.104923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95833b1-dae5-498e-8c2c-943fe4d56feb admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:06.119678 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 894/1767] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:05 2022] POST /identity/v3/projects => generated 363 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:51:06.120884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c0f5d-1a98-4b46-83fd-4576253ce68b admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:06.136301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95833b1-dae5-498e-8c2c-943fe4d56feb admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:06.249935 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1c0f5d-1a98-4b46-83fd-4576253ce68b admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:06.257009 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb91cc2-608a-4f0a-b307-064267ffd2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:06.258025 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb91cc2-608a-4f0a-b307-064267ffd2c7 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:06.259407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb91cc2-608a-4f0a-b307-064267ffd2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:06.261832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb91cc2-608a-4f0a-b307-064267ffd2c7 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:06.262810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb91cc2-608a-4f0a-b307-064267ffd2c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:06.264987 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb91cc2-608a-4f0a-b307-064267ffd2c7 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:06.297917 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 895/1768] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:06 2022] POST /identity/v3/users => generated 288 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:06.299310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb91cc2-608a-4f0a-b307-064267ffd2c7 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:06.302616 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7b43d-8961-49c1-bb5d-33474c49a202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:06.304148 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7b43d-8961-49c1-bb5d-33474c49a202 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:06.304813 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7b43d-8961-49c1-bb5d-33474c49a202 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:06.304813 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af7b43d-8961-49c1-bb5d-33474c49a202 admin admin] PATH_INFO: `/v3/projects/a762adb6eae1477ba60a4d86a38aed2f/users/5ce9c40602af4acda22fbd2da2b45374/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:06.319306 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb91cc2-608a-4f0a-b307-064267ffd2c7 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:06.336863 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44929c1c-9328-4ca4-b602-7953fa86c39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:06.341189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44929c1c-9328-4ca4-b602-7953fa86c39e admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:06.341857 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44929c1c-9328-4ca4-b602-7953fa86c39e admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:06.343304 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44929c1c-9328-4ca4-b602-7953fa86c39e admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:06.346653 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44929c1c-9328-4ca4-b602-7953fa86c39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:06.355087 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44929c1c-9328-4ca4-b602-7953fa86c39e admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:06.379134 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7b43d-8961-49c1-bb5d-33474c49a202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a762adb6eae1477ba60a4d86a38aed2f, user_id=5ce9c40602af4acda22fbd2da2b45374, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:06.388112 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af7b43d-8961-49c1-bb5d-33474c49a202 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:06.402054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 896/1769] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:06.404421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44929c1c-9328-4ca4-b602-7953fa86c39e admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:06.408752 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-44929c1c-9328-4ca4-b602-7953fa86c39e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:06.443802 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44929c1c-9328-4ca4-b602-7953fa86c39e admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:06.446116 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 874/1770] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:06 2022] PUT /identity/v3/projects/a762adb6eae1477ba60a4d86a38aed2f/users/5ce9c40602af4acda22fbd2da2b45374/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:06.449349 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7b43d-8961-49c1-bb5d-33474c49a202 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:06.653091 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640b2ee0-e1a2-426c-9b2f-36e30df13d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:06.654510 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b2ee0-e1a2-426c-9b2f-36e30df13d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:06.654970 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b2ee0-e1a2-426c-9b2f-36e30df13d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:06.655411 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b2ee0-e1a2-426c-9b2f-36e30df13d5a admin admin] PATH_INFO: `/v3/projects/28db0ba70cc640d49924d80da53ccb45` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:06.657006 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b2ee0-e1a2-426c-9b2f-36e30df13d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=28db0ba70cc640d49924d80da53ccb45)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:06.659837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640b2ee0-e1a2-426c-9b2f-36e30df13d5a admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:06.741388 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af7b43d-8961-49c1-bb5d-33474c49a202 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:06.748720 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-640b2ee0-e1a2-426c-9b2f-36e30df13d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28db0ba70cc640d49924d80da53ccb45', 'request_id': 'req-640b2ee0-e1a2-426c-9b2f-36e30df13d5a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:06.764911 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-640b2ee0-e1a2-426c-9b2f-36e30df13d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28db0ba70cc640d49924d80da53ccb45', 'request_id': 'req-640b2ee0-e1a2-426c-9b2f-36e30df13d5a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:06.777955 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-640b2ee0-e1a2-426c-9b2f-36e30df13d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28db0ba70cc640d49924d80da53ccb45', 'request_id': 'req-640b2ee0-e1a2-426c-9b2f-36e30df13d5a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:06.796795 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-640b2ee0-e1a2-426c-9b2f-36e30df13d5a admin admin] The token cache is being invalidate because project 28db0ba70cc640d49924d80da53ccb45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:06.809930 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-640b2ee0-e1a2-426c-9b2f-36e30df13d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:06.812981 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-640b2ee0-e1a2-426c-9b2f-36e30df13d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:06.819477 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 897/1771] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:06 2022] DELETE /identity/v3/projects/28db0ba70cc640d49924d80da53ccb45 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:06.822063 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67acff-b62c-42cf-b86d-0d9dacfeb8b7 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:06.822407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67acff-b62c-42cf-b86d-0d9dacfeb8b7 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:06.823096 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67acff-b62c-42cf-b86d-0d9dacfeb8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:06.929025 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-2f67acff-b62c-42cf-b86d-0d9dacfeb8b7 None None] MFA Rules not processed for user `5ce9c40602af4acda22fbd2da2b45374`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:06.930370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-2f67acff-b62c-42cf-b86d-0d9dacfeb8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:07.010257 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a09efe-98be-49a7-96ce-f8099e45573e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:07.011209 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a09efe-98be-49a7-96ce-f8099e45573e admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:07.011498 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a09efe-98be-49a7-96ce-f8099e45573e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:07.012148 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a09efe-98be-49a7-96ce-f8099e45573e admin admin] PATH_INFO: `/v3/projects/20f5af9668a649e09707c6bed02dac65/users/4471e3c399b64b599804420ee84f158b/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:07.075683 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a09efe-98be-49a7-96ce-f8099e45573e admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f5af9668a649e09707c6bed02dac65, user_id=4471e3c399b64b599804420ee84f158b, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:07.078367 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a09efe-98be-49a7-96ce-f8099e45573e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:07.145088 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 875/1772] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:06 2022] PUT /identity/v3/projects/20f5af9668a649e09707c6bed02dac65/users/4471e3c399b64b599804420ee84f158b/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:07.148298 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a09efe-98be-49a7-96ce-f8099e45573e admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:07.160493 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-96a09efe-98be-49a7-96ce-f8099e45573e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:07.189335 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 898/1773] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:07.190384 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67acff-b62c-42cf-b86d-0d9dacfeb8b7 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:07.191852 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-2f67acff-b62c-42cf-b86d-0d9dacfeb8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:07.207264 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67acff-b62c-42cf-b86d-0d9dacfeb8b7 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:07.309579 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c7c43-f344-4895-a94a-6ab0e784391a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:07.311719 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c7c43-f344-4895-a94a-6ab0e784391a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:07.312149 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c7c43-f344-4895-a94a-6ab0e784391a admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:07.312742 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c7c43-f344-4895-a94a-6ab0e784391a admin admin] PATH_INFO: `/v3/users/e131c1835c7c4bb8bcc5eacd29be5a40` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:07.314958 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c7c43-f344-4895-a94a-6ab0e784391a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e131c1835c7c4bb8bcc5eacd29be5a40)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:07.317553 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c7c43-f344-4895-a94a-6ab0e784391a admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:07.372894 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a09efe-98be-49a7-96ce-f8099e45573e admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:07.380654 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c95ed-da04-4d0e-9258-4567103d166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:07.381621 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c95ed-da04-4d0e-9258-4567103d166c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:07.381847 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c95ed-da04-4d0e-9258-4567103d166c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:07.382138 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c95ed-da04-4d0e-9258-4567103d166c admin admin] PATH_INFO: `/v3/projects/86c699b812e44134b9a8f08dd7bb7257` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:07.385014 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c95ed-da04-4d0e-9258-4567103d166c admin admin] RBAC: Authorizing `identity:delete_project(project_id=86c699b812e44134b9a8f08dd7bb7257)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:07.403075 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-ac2c7c43-f344-4895-a94a-6ab0e784391a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e131c1835c7c4bb8bcc5eacd29be5a40'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:07.404076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-ac2c7c43-f344-4895-a94a-6ab0e784391a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e131c1835c7c4bb8bcc5eacd29be5a40'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:07.405837 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c95ed-da04-4d0e-9258-4567103d166c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:07.429579 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-ac2c7c43-f344-4895-a94a-6ab0e784391a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e131c1835c7c4bb8bcc5eacd29be5a40'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:07.442662 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-ac2c7c43-f344-4895-a94a-6ab0e784391a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e131c1835c7c4bb8bcc5eacd29be5a40'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:07.458061 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-ac2c7c43-f344-4895-a94a-6ab0e784391a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e131c1835c7c4bb8bcc5eacd29be5a40'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:07.467024 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 899/1774] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:07 2022] DELETE /identity/v3/users/e131c1835c7c4bb8bcc5eacd29be5a40 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:07.468365 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c7c43-f344-4895-a94a-6ab0e784391a admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:07.470460 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-ac2c7c43-f344-4895-a94a-6ab0e784391a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:07.521590 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-bc0c95ed-da04-4d0e-9258-4567103d166c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86c699b812e44134b9a8f08dd7bb7257', 'request_id': 'req-bc0c95ed-da04-4d0e-9258-4567103d166c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:07.546399 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-bc0c95ed-da04-4d0e-9258-4567103d166c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86c699b812e44134b9a8f08dd7bb7257', 'request_id': 'req-bc0c95ed-da04-4d0e-9258-4567103d166c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:07.556684 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c7c43-f344-4895-a94a-6ab0e784391a admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:07.559341 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-bc0c95ed-da04-4d0e-9258-4567103d166c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86c699b812e44134b9a8f08dd7bb7257', 'request_id': 'req-bc0c95ed-da04-4d0e-9258-4567103d166c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:07.584722 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-bc0c95ed-da04-4d0e-9258-4567103d166c admin admin] The token cache is being invalidate because project 86c699b812e44134b9a8f08dd7bb7257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:07.585221 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-bc0c95ed-da04-4d0e-9258-4567103d166c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:07.588785 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-bc0c95ed-da04-4d0e-9258-4567103d166c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:07.598133 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 876/1775] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:07 2022] DELETE /identity/v3/projects/86c699b812e44134b9a8f08dd7bb7257 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:07.609627 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c95ed-da04-4d0e-9258-4567103d166c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:07.612680 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bc0c95ed-da04-4d0e-9258-4567103d166c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:07.631558 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22ceb5-ffa5-4621-ad34-02e2b4656c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:07.632543 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22ceb5-ffa5-4621-ad34-02e2b4656c96 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:07.632893 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22ceb5-ffa5-4621-ad34-02e2b4656c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:07.633167 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22ceb5-ffa5-4621-ad34-02e2b4656c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:07.633907 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22ceb5-ffa5-4621-ad34-02e2b4656c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:07.636148 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22ceb5-ffa5-4621-ad34-02e2b4656c96 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:07.649035 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c95ed-da04-4d0e-9258-4567103d166c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:07.649232 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 900/1776] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:07.654711 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22ceb5-ffa5-4621-ad34-02e2b4656c96 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:07.656796 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-bd22ceb5-ffa5-4621-ad34-02e2b4656c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:07.658176 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3ac66-d826-418d-be16-6a8f44a6e592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:07.659066 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3ac66-d826-418d-be16-6a8f44a6e592 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:07.659545 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3ac66-d826-418d-be16-6a8f44a6e592 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:07.659964 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3ac66-d826-418d-be16-6a8f44a6e592 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:07.661005 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3ac66-d826-418d-be16-6a8f44a6e592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:07.664174 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3ac66-d826-418d-be16-6a8f44a6e592 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:07.670914 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22ceb5-ffa5-4621-ad34-02e2b4656c96 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:07.677241 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e37c3-e951-4db3-8def-bcfa69c5dcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:07.678074 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e37c3-e951-4db3-8def-bcfa69c5dcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:07.678421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e37c3-e951-4db3-8def-bcfa69c5dcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:07.678800 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e37c3-e951-4db3-8def-bcfa69c5dcd6 admin admin] PATH_INFO: `/v3/users/f976017786a94e899ec1eb6a34ac0a0a` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:07.681131 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e37c3-e951-4db3-8def-bcfa69c5dcd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f976017786a94e899ec1eb6a34ac0a0a)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:07.683252 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e37c3-e951-4db3-8def-bcfa69c5dcd6 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:07.757346 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-8e7e37c3-e951-4db3-8def-bcfa69c5dcd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f976017786a94e899ec1eb6a34ac0a0a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:07.762054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-8e7e37c3-e951-4db3-8def-bcfa69c5dcd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f976017786a94e899ec1eb6a34ac0a0a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:07.781083 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-8e7e37c3-e951-4db3-8def-bcfa69c5dcd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f976017786a94e899ec1eb6a34ac0a0a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:07.794884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-8e7e37c3-e951-4db3-8def-bcfa69c5dcd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f976017786a94e899ec1eb6a34ac0a0a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:07.813941 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 877/1777] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:07 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:07.816379 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3ac66-d826-418d-be16-6a8f44a6e592 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:07.825221 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-90a3ac66-d826-418d-be16-6a8f44a6e592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:07.831939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-8e7e37c3-e951-4db3-8def-bcfa69c5dcd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f976017786a94e899ec1eb6a34ac0a0a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:07.852888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 901/1778] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:07 2022] DELETE /identity/v3/users/f976017786a94e899ec1eb6a34ac0a0a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:07.853779 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e37c3-e951-4db3-8def-bcfa69c5dcd6 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:07.859810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-8e7e37c3-e951-4db3-8def-bcfa69c5dcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:07.948703 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3ac66-d826-418d-be16-6a8f44a6e592 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:07.966852 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e37c3-e951-4db3-8def-bcfa69c5dcd6 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:07.988585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcc5be-e3fc-47cb-8645-cc36b240aa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:07.989280 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcc5be-e3fc-47cb-8645-cc36b240aa3e admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:07.990649 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcc5be-e3fc-47cb-8645-cc36b240aa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:07.990937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcc5be-e3fc-47cb-8645-cc36b240aa3e admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:07.991637 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcc5be-e3fc-47cb-8645-cc36b240aa3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:07.997203 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bcc5be-e3fc-47cb-8645-cc36b240aa3e admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:08.044789 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 902/1779] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:07 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:08.045861 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcc5be-e3fc-47cb-8645-cc36b240aa3e admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:08.069594 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcc5be-e3fc-47cb-8645-cc36b240aa3e admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:08.080857 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ed1ee-c3cd-47d1-9b33-c2abded733dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:08.081477 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ed1ee-c3cd-47d1-9b33-c2abded733dd admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:08.081772 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ed1ee-c3cd-47d1-9b33-c2abded733dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:08.084451 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ed1ee-c3cd-47d1-9b33-c2abded733dd admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:08.085104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ed1ee-c3cd-47d1-9b33-c2abded733dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:08.089796 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ed1ee-c3cd-47d1-9b33-c2abded733dd admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:08.097251 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57bcccf-26f5-4d0e-8b97-5a41f0f5f8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:08.098159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bcccf-26f5-4d0e-8b97-5a41f0f5f8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:08.098471 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bcccf-26f5-4d0e-8b97-5a41f0f5f8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:08.098755 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57bcccf-26f5-4d0e-8b97-5a41f0f5f8b3 admin admin] PATH_INFO: `/v3/projects/20f5af9668a649e09707c6bed02dac65/users/4471e3c399b64b599804420ee84f158b/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:08.110978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bcccf-26f5-4d0e-8b97-5a41f0f5f8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20f5af9668a649e09707c6bed02dac65, user_id=4471e3c399b64b599804420ee84f158b, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:08.124085 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57bcccf-26f5-4d0e-8b97-5a41f0f5f8b3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:08.142807 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 903/1780] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:08.144331 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ed1ee-c3cd-47d1-9b33-c2abded733dd admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:08.177187 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 878/1781] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:07 2022] PUT /identity/v3/projects/20f5af9668a649e09707c6bed02dac65/users/4471e3c399b64b599804420ee84f158b/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:08.180591 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ed1ee-c3cd-47d1-9b33-c2abded733dd admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:08.187542 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ae5b1-3539-401e-95ad-adb7f5809870 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:08.188716 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ae5b1-3539-401e-95ad-adb7f5809870 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:08.189348 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ae5b1-3539-401e-95ad-adb7f5809870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:08.313725 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ba2ae5b1-3539-401e-95ad-adb7f5809870 None None] MFA Rules not processed for user `4471e3c399b64b599804420ee84f158b`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:08.313725 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ba2ae5b1-3539-401e-95ad-adb7f5809870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:08.503461 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb597e-5799-4ade-be1e-2425d1adb522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:08.505649 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb597e-5799-4ade-be1e-2425d1adb522 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:08.510804 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb597e-5799-4ade-be1e-2425d1adb522 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:08.515500 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb597e-5799-4ade-be1e-2425d1adb522 admin admin] PATH_INFO: `/v3/projects/7247935bba8840a8a43406d3c9889e83/users/8fd829a04a564b7391a23b0be272caa6/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:08.598629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb597e-5799-4ade-be1e-2425d1adb522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7247935bba8840a8a43406d3c9889e83, user_id=8fd829a04a564b7391a23b0be272caa6, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:08.618923 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb597e-5799-4ade-be1e-2425d1adb522 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:08.666123 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 904/1782] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:08 2022] PUT /identity/v3/projects/7247935bba8840a8a43406d3c9889e83/users/8fd829a04a564b7391a23b0be272caa6/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:08.668047 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86c6e-6723-4df7-806e-b6c27fc94ddd None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:08.674926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86c6e-6723-4df7-806e-b6c27fc94ddd None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:08.675739 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86c6e-6723-4df7-806e-b6c27fc94ddd None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:08.684305 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 905/1783] 10.222.0.73 () {54 vars in 921 bytes} [Mon Apr 11 16:51:08 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:51:08.685398 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d86c6e-6723-4df7-806e-b6c27fc94ddd None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:08.717625 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 879/1784] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:08 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 531 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:08.733011 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ae5b1-3539-401e-95ad-adb7f5809870 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:08.734888 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ba2ae5b1-3539-401e-95ad-adb7f5809870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:08.934906 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d86c6e-6723-4df7-806e-b6c27fc94ddd None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:08.946477 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ae5b1-3539-401e-95ad-adb7f5809870 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:08.950564 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26b864-728c-4160-8956-d88e1b600e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:08.959466 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26b864-728c-4160-8956-d88e1b600e60 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:08.961384 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26b864-728c-4160-8956-d88e1b600e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:08.961874 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26b864-728c-4160-8956-d88e1b600e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:08.964560 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26b864-728c-4160-8956-d88e1b600e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:08.974206 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26b864-728c-4160-8956-d88e1b600e60 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:08.998028 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 906/1785] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:08.999775 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924cc58-324a-41e5-94d0-362c07334e2b None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:09.002673 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924cc58-324a-41e5-94d0-362c07334e2b None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:09.003194 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924cc58-324a-41e5-94d0-362c07334e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:09.048860 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-2924cc58-324a-41e5-94d0-362c07334e2b None None] MFA Rules not processed for user `ba3665d046864985916fdd6c4a4edcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:09.050385 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-2924cc58-324a-41e5-94d0-362c07334e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:09.087515 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32381f7-4f66-4b25-818a-0b4a2b052fae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:09.088427 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32381f7-4f66-4b25-818a-0b4a2b052fae service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:09.088930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32381f7-4f66-4b25-818a-0b4a2b052fae service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:09.089626 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32381f7-4f66-4b25-818a-0b4a2b052fae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:09.253312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 907/1786] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Apr 11 16:51:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:09.256683 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924cc58-324a-41e5-94d0-362c07334e2b None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:09.260847 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32381f7-4f66-4b25-818a-0b4a2b052fae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:09.263895 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32381f7-4f66-4b25-818a-0b4a2b052fae service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:09.279151 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924cc58-324a-41e5-94d0-362c07334e2b None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:09.298954 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 880/1787] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:08 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:09.304128 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d9c98-117a-4796-bf62-ad4215f78e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:09.305456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d9c98-117a-4796-bf62-ad4215f78e22 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:09.305993 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d9c98-117a-4796-bf62-ad4215f78e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:09.310198 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d9c98-117a-4796-bf62-ad4215f78e22 admin admin] PATH_INFO: `/v3/projects/7247935bba8840a8a43406d3c9889e83/users/8fd829a04a564b7391a23b0be272caa6/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:09.313094 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d9c98-117a-4796-bf62-ad4215f78e22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7247935bba8840a8a43406d3c9889e83, user_id=8fd829a04a564b7391a23b0be272caa6, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:09.316876 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d9c98-117a-4796-bf62-ad4215f78e22 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:09.356218 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 908/1788] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:09 2022] PUT /identity/v3/projects/7247935bba8840a8a43406d3c9889e83/users/8fd829a04a564b7391a23b0be272caa6/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:09.368389 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15945dfc-e348-4a39-87fe-8567184b6faf None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:09.369009 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15945dfc-e348-4a39-87fe-8567184b6faf None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:09.369511 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15945dfc-e348-4a39-87fe-8567184b6faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:09.389066 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d9c98-117a-4796-bf62-ad4215f78e22 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:09.393819 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d65d9c98-117a-4796-bf62-ad4215f78e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:09.482215 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-15945dfc-e348-4a39-87fe-8567184b6faf None None] MFA Rules not processed for user `8fd829a04a564b7391a23b0be272caa6`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:09.489408 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-15945dfc-e348-4a39-87fe-8567184b6faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:09.662618 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d9c98-117a-4796-bf62-ad4215f78e22 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:09.681725 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2347d-4caa-4db8-9adf-5da8b322433b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:09.682620 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2347d-4caa-4db8-9adf-5da8b322433b service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:09.683047 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2347d-4caa-4db8-9adf-5da8b322433b service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:09.683379 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2347d-4caa-4db8-9adf-5da8b322433b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:09.706087 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2347d-4caa-4db8-9adf-5da8b322433b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:09.711100 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2347d-4caa-4db8-9adf-5da8b322433b service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:09.752454 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 909/1789] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:51:09.754205 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2347d-4caa-4db8-9adf-5da8b322433b service nova] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:09.760056 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-72e2347d-4caa-4db8-9adf-5da8b322433b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:09.765899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 881/1790] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:09.767199 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15945dfc-e348-4a39-87fe-8567184b6faf None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:09.771263 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-15945dfc-e348-4a39-87fe-8567184b6faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:09.935849 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2347d-4caa-4db8-9adf-5da8b322433b service nova] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:09.948392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd82115-62e6-4481-8490-d7611859d1cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:09.949439 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd82115-62e6-4481-8490-d7611859d1cb service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:09.950040 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd82115-62e6-4481-8490-d7611859d1cb service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:09.950575 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd82115-62e6-4481-8490-d7611859d1cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:09.954681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-cfd82115-62e6-4481-8490-d7611859d1cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:10.010014 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15945dfc-e348-4a39-87fe-8567184b6faf None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:10.023310 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509faa2-cf20-43f5-b372-46e18add6710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:10.024921 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509faa2-cf20-43f5-b372-46e18add6710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:10.025445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509faa2-cf20-43f5-b372-46e18add6710 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:10.026006 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509faa2-cf20-43f5-b372-46e18add6710 admin admin] PATH_INFO: `/v3/users/95c9588e11d7420ba13a47d8d394c5cb` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:10.029369 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509faa2-cf20-43f5-b372-46e18add6710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95c9588e11d7420ba13a47d8d394c5cb)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:10.032352 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509faa2-cf20-43f5-b372-46e18add6710 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:10.055911 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd82115-62e6-4481-8490-d7611859d1cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:10.057387 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd82115-62e6-4481-8490-d7611859d1cb service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:10.081667 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 910/1791] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:10.083565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd82115-62e6-4481-8490-d7611859d1cb service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:10.103196 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd82115-62e6-4481-8490-d7611859d1cb service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:10.115204 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c48cf7-3a36-4408-a7ab-c72468460702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:10.116092 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c48cf7-3a36-4408-a7ab-c72468460702 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:10.116263 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c48cf7-3a36-4408-a7ab-c72468460702 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:10.116396 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c48cf7-3a36-4408-a7ab-c72468460702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:10.148447 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9509faa2-cf20-43f5-b372-46e18add6710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95c9588e11d7420ba13a47d8d394c5cb'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.164688 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c48cf7-3a36-4408-a7ab-c72468460702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:10.171701 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9509faa2-cf20-43f5-b372-46e18add6710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95c9588e11d7420ba13a47d8d394c5cb'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.179424 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9509faa2-cf20-43f5-b372-46e18add6710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95c9588e11d7420ba13a47d8d394c5cb'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.181686 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c48cf7-3a36-4408-a7ab-c72468460702 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:10.219252 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9509faa2-cf20-43f5-b372-46e18add6710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95c9588e11d7420ba13a47d8d394c5cb'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.227626 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 911/1792] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:10 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:10.230620 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c48cf7-3a36-4408-a7ab-c72468460702 service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:10.238740 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f5c48cf7-3a36-4408-a7ab-c72468460702 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:10.273989 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9509faa2-cf20-43f5-b372-46e18add6710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95c9588e11d7420ba13a47d8d394c5cb'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.282527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c48cf7-3a36-4408-a7ab-c72468460702 service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:10.293273 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 882/1793] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:09 2022] DELETE /identity/v3/users/95c9588e11d7420ba13a47d8d394c5cb => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:10.295267 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509faa2-cf20-43f5-b372-46e18add6710 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:10.296207 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d76b15-4fe0-45ca-914c-5d07e26fae4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:10.297330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9509faa2-cf20-43f5-b372-46e18add6710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:10.297498 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d76b15-4fe0-45ca-914c-5d07e26fae4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:10.298272 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d76b15-4fe0-45ca-914c-5d07e26fae4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:10.300460 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d76b15-4fe0-45ca-914c-5d07e26fae4e admin admin] PATH_INFO: `/v3/projects/fa782cc01e5f4ae3a8d1953a4ca5f477` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:10.305829 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d76b15-4fe0-45ca-914c-5d07e26fae4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa782cc01e5f4ae3a8d1953a4ca5f477)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:10.308126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d76b15-4fe0-45ca-914c-5d07e26fae4e admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:10.431224 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-58d76b15-4fe0-45ca-914c-5d07e26fae4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa782cc01e5f4ae3a8d1953a4ca5f477', 'request_id': 'req-58d76b15-4fe0-45ca-914c-5d07e26fae4e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.444979 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-58d76b15-4fe0-45ca-914c-5d07e26fae4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa782cc01e5f4ae3a8d1953a4ca5f477', 'request_id': 'req-58d76b15-4fe0-45ca-914c-5d07e26fae4e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.455394 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-58d76b15-4fe0-45ca-914c-5d07e26fae4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa782cc01e5f4ae3a8d1953a4ca5f477', 'request_id': 'req-58d76b15-4fe0-45ca-914c-5d07e26fae4e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.477924 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-58d76b15-4fe0-45ca-914c-5d07e26fae4e admin admin] The token cache is being invalidate because project fa782cc01e5f4ae3a8d1953a4ca5f477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:10.478050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-58d76b15-4fe0-45ca-914c-5d07e26fae4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.479693 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-58d76b15-4fe0-45ca-914c-5d07e26fae4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.486644 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 912/1794] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:10 2022] DELETE /identity/v3/projects/fa782cc01e5f4ae3a8d1953a4ca5f477 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:10.488310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688d100-d1f2-40e8-993a-56df10674e2c None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:10.488601 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688d100-d1f2-40e8-993a-56df10674e2c None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:10.488883 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4688d100-d1f2-40e8-993a-56df10674e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:10.519320 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509faa2-cf20-43f5-b372-46e18add6710 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:10.549430 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-4688d100-d1f2-40e8-993a-56df10674e2c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:10.559062 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4688d100-d1f2-40e8-993a-56df10674e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:10.681753 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 913/1795] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:10.681753 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688d100-d1f2-40e8-993a-56df10674e2c None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:10.685629 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbeed5-c5e9-49f7-a0bb-e7ae6e6340a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:10.686401 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4688d100-d1f2-40e8-993a-56df10674e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:10.689118 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbeed5-c5e9-49f7-a0bb-e7ae6e6340a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:10.689587 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbeed5-c5e9-49f7-a0bb-e7ae6e6340a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:10.690015 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbeed5-c5e9-49f7-a0bb-e7ae6e6340a5 admin admin] PATH_INFO: `/v3/projects/f750b3a639644a44bacb8a0b8646c8da` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:10.691534 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbeed5-c5e9-49f7-a0bb-e7ae6e6340a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f750b3a639644a44bacb8a0b8646c8da)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:10.696576 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbeed5-c5e9-49f7-a0bb-e7ae6e6340a5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:10.718658 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4688d100-d1f2-40e8-993a-56df10674e2c None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:10.736837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aed4aa-b3a4-4914-8976-455d70654c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:10.737748 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aed4aa-b3a4-4914-8976-455d70654c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:10.738011 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aed4aa-b3a4-4914-8976-455d70654c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:10.738284 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aed4aa-b3a4-4914-8976-455d70654c58 admin admin] PATH_INFO: `/v3/users/5ce9c40602af4acda22fbd2da2b45374` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:10.744090 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aed4aa-b3a4-4914-8976-455d70654c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce9c40602af4acda22fbd2da2b45374)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:10.746394 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aed4aa-b3a4-4914-8976-455d70654c58 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:10.869208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-99bbeed5-c5e9-49f7-a0bb-e7ae6e6340a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f750b3a639644a44bacb8a0b8646c8da', 'request_id': 'req-99bbeed5-c5e9-49f7-a0bb-e7ae6e6340a5'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.870242 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d4aed4aa-b3a4-4914-8976-455d70654c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce9c40602af4acda22fbd2da2b45374'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.870985 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d4aed4aa-b3a4-4914-8976-455d70654c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce9c40602af4acda22fbd2da2b45374'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.885038 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-99bbeed5-c5e9-49f7-a0bb-e7ae6e6340a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f750b3a639644a44bacb8a0b8646c8da', 'request_id': 'req-99bbeed5-c5e9-49f7-a0bb-e7ae6e6340a5'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.894299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d4aed4aa-b3a4-4914-8976-455d70654c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce9c40602af4acda22fbd2da2b45374'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.906130 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d4aed4aa-b3a4-4914-8976-455d70654c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce9c40602af4acda22fbd2da2b45374'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.909042 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-99bbeed5-c5e9-49f7-a0bb-e7ae6e6340a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f750b3a639644a44bacb8a0b8646c8da', 'request_id': 'req-99bbeed5-c5e9-49f7-a0bb-e7ae6e6340a5'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.932797 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d4aed4aa-b3a4-4914-8976-455d70654c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce9c40602af4acda22fbd2da2b45374'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.943134 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-99bbeed5-c5e9-49f7-a0bb-e7ae6e6340a5 admin admin] The token cache is being invalidate because project f750b3a639644a44bacb8a0b8646c8da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:10.948250 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-99bbeed5-c5e9-49f7-a0bb-e7ae6e6340a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.949841 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-99bbeed5-c5e9-49f7-a0bb-e7ae6e6340a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:10.951730 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 914/1796] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:10 2022] DELETE /identity/v3/users/5ce9c40602af4acda22fbd2da2b45374 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:10.953283 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 883/1797] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:10 2022] DELETE /identity/v3/projects/f750b3a639644a44bacb8a0b8646c8da => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:10.957589 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b11c9-9b77-4994-bedc-fcaf0ddbe980 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:10.957589 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b11c9-9b77-4994-bedc-fcaf0ddbe980 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:10.957589 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b11c9-9b77-4994-bedc-fcaf0ddbe980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:10.958825 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbeed5-c5e9-49f7-a0bb-e7ae6e6340a5 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:10.961864 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-99bbeed5-c5e9-49f7-a0bb-e7ae6e6340a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:10.983188 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-469b11c9-9b77-4994-bedc-fcaf0ddbe980 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:10.984586 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-469b11c9-9b77-4994-bedc-fcaf0ddbe980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:11.086207 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 915/1798] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:11.088586 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea63f25-8c8a-4a87-a1e9-01439f08e0f5 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:11.089070 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea63f25-8c8a-4a87-a1e9-01439f08e0f5 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:11.089355 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea63f25-8c8a-4a87-a1e9-01439f08e0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:11.116613 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-4ea63f25-8c8a-4a87-a1e9-01439f08e0f5 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:11.117955 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4ea63f25-8c8a-4a87-a1e9-01439f08e0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:11.147988 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 916/1799] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:11.149826 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbeed5-c5e9-49f7-a0bb-e7ae6e6340a5 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:11.152600 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7c07f-e66a-42a9-80b2-c1c9a4275fcb None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:11.152890 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7c07f-e66a-42a9-80b2-c1c9a4275fcb None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:11.153330 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c7c07f-e66a-42a9-80b2-c1c9a4275fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:11.191647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-82c7c07f-e66a-42a9-80b2-c1c9a4275fcb None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:11.197318 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-82c7c07f-e66a-42a9-80b2-c1c9a4275fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:11.224586 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 917/1800] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:11.224586 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0327b-9acc-4938-bee2-92ee1966f02a None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:11.224586 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0327b-9acc-4938-bee2-92ee1966f02a None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:11.224586 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e0327b-9acc-4938-bee2-92ee1966f02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:11.256215 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a8bbb-162c-436a-bc5d-1a4d9c5017ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:11.257093 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a8bbb-162c-436a-bc5d-1a4d9c5017ff service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:11.257490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a8bbb-162c-436a-bc5d-1a4d9c5017ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:11.257935 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a8bbb-162c-436a-bc5d-1a4d9c5017ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:11.260473 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-946a8bbb-162c-436a-bc5d-1a4d9c5017ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:11.271576 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-e3e0327b-9acc-4938-bee2-92ee1966f02a None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:11.272900 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-e3e0327b-9acc-4938-bee2-92ee1966f02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:11.289127 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 918/1801] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:11.290255 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0327b-9acc-4938-bee2-92ee1966f02a None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:11.292740 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-e3e0327b-9acc-4938-bee2-92ee1966f02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:11.293351 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a8bbb-162c-436a-bc5d-1a4d9c5017ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:11.295966 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a8bbb-162c-436a-bc5d-1a4d9c5017ff service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:11.315794 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e0327b-9acc-4938-bee2-92ee1966f02a None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:11.327751 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc260da-bcc8-4a87-8430-9aa951c12e60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:11.328198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 884/1802] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:11.328310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc260da-bcc8-4a87-8430-9aa951c12e60 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:11.328557 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc260da-bcc8-4a87-8430-9aa951c12e60 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:11.329395 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc260da-bcc8-4a87-8430-9aa951c12e60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:11.332290 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993d67f-556d-4a20-805f-817a46e37057 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:11.333444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993d67f-556d-4a20-805f-817a46e37057 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:11.334482 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5993d67f-556d-4a20-805f-817a46e37057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:11.352083 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc260da-bcc8-4a87-8430-9aa951c12e60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:11.353551 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc260da-bcc8-4a87-8430-9aa951c12e60 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:11.374538 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 919/1803] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:11.376340 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc260da-bcc8-4a87-8430-9aa951c12e60 service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:11.382262 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-5993d67f-556d-4a20-805f-817a46e37057 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:11.383803 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5993d67f-556d-4a20-805f-817a46e37057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:11.391486 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc260da-bcc8-4a87-8430-9aa951c12e60 service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:11.407214 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47c3ad-ce55-4478-a8b0-772122797ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:11.407847 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47c3ad-ce55-4478-a8b0-772122797ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:11.408127 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47c3ad-ce55-4478-a8b0-772122797ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:11.408406 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d47c3ad-ce55-4478-a8b0-772122797ad7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:11.409187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47c3ad-ce55-4478-a8b0-772122797ad7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:51:11.409434 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47c3ad-ce55-4478-a8b0-772122797ad7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:11.410902 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 885/1804] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:11.411085 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d47c3ad-ce55-4478-a8b0-772122797ad7 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:11.415475 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993d67f-556d-4a20-805f-817a46e37057 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:11.445938 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 920/1805] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:51:11.450269 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47c3ad-ce55-4478-a8b0-772122797ad7 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:11.451414 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5993d67f-556d-4a20-805f-817a46e37057 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:11.461293 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d47c3ad-ce55-4478-a8b0-772122797ad7 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:11.466327 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127bf3f-152e-4339-a1f7-9c2c554d9e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:11.467018 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127bf3f-152e-4339-a1f7-9c2c554d9e4c admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:11.467302 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127bf3f-152e-4339-a1f7-9c2c554d9e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:11.467578 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c127bf3f-152e-4339-a1f7-9c2c554d9e4c admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:11.468345 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127bf3f-152e-4339-a1f7-9c2c554d9e4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:11.470565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c127bf3f-152e-4339-a1f7-9c2c554d9e4c admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:11.471411 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9975e8-432f-4613-860c-b0a65453f8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:11.472245 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9975e8-432f-4613-860c-b0a65453f8a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:11.472673 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9975e8-432f-4613-860c-b0a65453f8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:11.473090 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9975e8-432f-4613-860c-b0a65453f8a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:11.473962 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9975e8-432f-4613-860c-b0a65453f8a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:51:11.474501 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9975e8-432f-4613-860c-b0a65453f8a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:11.478617 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9975e8-432f-4613-860c-b0a65453f8a6 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:11.520841 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 921/1807] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:11 2022] POST /identity/v3/projects => generated 409 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:11.521037 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 886/1807] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:51:11.521745 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127bf3f-152e-4339-a1f7-9c2c554d9e4c admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:11.525401 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9975e8-432f-4613-860c-b0a65453f8a6 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:11.549990 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9975e8-432f-4613-860c-b0a65453f8a6 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:11.683623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c127bf3f-152e-4339-a1f7-9c2c554d9e4c admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:11.687556 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3e020-fe53-4774-aa7c-3cde151390ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:11.692145 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3e020-fe53-4774-aa7c-3cde151390ee admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:11.695754 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3e020-fe53-4774-aa7c-3cde151390ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:11.697950 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3e020-fe53-4774-aa7c-3cde151390ee admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:11.698802 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bc782-9b2a-4d44-803b-4b8a6e918607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:11.699587 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bc782-9b2a-4d44-803b-4b8a6e918607 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:11.700934 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bc782-9b2a-4d44-803b-4b8a6e918607 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:11.701172 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3e020-fe53-4774-aa7c-3cde151390ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:11.701800 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bc782-9b2a-4d44-803b-4b8a6e918607 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:11.707007 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bc782-9b2a-4d44-803b-4b8a6e918607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:11.709288 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bc782-9b2a-4d44-803b-4b8a6e918607 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:11.712298 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3e020-fe53-4774-aa7c-3cde151390ee admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:11.775350 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 922/1808] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:11 2022] POST /identity/v3/projects => generated 373 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:11.776700 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bc782-9b2a-4d44-803b-4b8a6e918607 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:11.827579 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 887/1809] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:11 2022] POST /identity/v3/users => generated 305 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:11.830009 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3e020-fe53-4774-aa7c-3cde151390ee admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:11.855628 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3e020-fe53-4774-aa7c-3cde151390ee admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:11.935831 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bc782-9b2a-4d44-803b-4b8a6e918607 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:11.952110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b02df-0bf2-4cd4-ba29-bd4ca62e7717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:11.953239 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b02df-0bf2-4cd4-ba29-bd4ca62e7717 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:11.953708 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b02df-0bf2-4cd4-ba29-bd4ca62e7717 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:11.954112 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b02df-0bf2-4cd4-ba29-bd4ca62e7717 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:11.956908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b02df-0bf2-4cd4-ba29-bd4ca62e7717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:11.960768 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215b02df-0bf2-4cd4-ba29-bd4ca62e7717 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:11.995582 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da428f8-e455-4ee5-b16a-289b735ba6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:11.996267 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da428f8-e455-4ee5-b16a-289b735ba6a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:11.996559 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da428f8-e455-4ee5-b16a-289b735ba6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:11.996885 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da428f8-e455-4ee5-b16a-289b735ba6a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:11.997595 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da428f8-e455-4ee5-b16a-289b735ba6a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:11.999230 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da428f8-e455-4ee5-b16a-289b735ba6a5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:12.012617 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 923/1810] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:11 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:12.013677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b02df-0bf2-4cd4-ba29-bd4ca62e7717 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:12.038215 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 888/1811] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:12.039232 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da428f8-e455-4ee5-b16a-289b735ba6a5 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:12.041163 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215b02df-0bf2-4cd4-ba29-bd4ca62e7717 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:12.063949 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da428f8-e455-4ee5-b16a-289b735ba6a5 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:12.064193 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472038ae-fed5-4329-acda-ea3b766f6247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:12.065504 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472038ae-fed5-4329-acda-ea3b766f6247 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:12.066144 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472038ae-fed5-4329-acda-ea3b766f6247 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:12.067071 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472038ae-fed5-4329-acda-ea3b766f6247 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:12.068895 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752f75d-65dd-429a-b5d6-4106babe3a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:12.069526 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752f75d-65dd-429a-b5d6-4106babe3a67 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:12.069840 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752f75d-65dd-429a-b5d6-4106babe3a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:12.070088 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0752f75d-65dd-429a-b5d6-4106babe3a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:12.070331 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472038ae-fed5-4329-acda-ea3b766f6247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:12.070841 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752f75d-65dd-429a-b5d6-4106babe3a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:12.072561 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0752f75d-65dd-429a-b5d6-4106babe3a67 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:12.074461 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472038ae-fed5-4329-acda-ea3b766f6247 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:12.111108 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 924/1812] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:12.113507 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472038ae-fed5-4329-acda-ea3b766f6247 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:12.121780 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 889/1813] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:12.130323 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752f75d-65dd-429a-b5d6-4106babe3a67 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:12.140585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472038ae-fed5-4329-acda-ea3b766f6247 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:12.155648 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0752f75d-65dd-429a-b5d6-4106babe3a67 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:12.157378 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f701a62-111d-4174-b745-b7f3e305063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:12.159644 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f701a62-111d-4174-b745-b7f3e305063f admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:12.159941 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f701a62-111d-4174-b745-b7f3e305063f admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:12.160212 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f701a62-111d-4174-b745-b7f3e305063f admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:12.160957 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f701a62-111d-4174-b745-b7f3e305063f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:12.167735 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f701a62-111d-4174-b745-b7f3e305063f admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:12.182474 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 925/1814] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:12.190560 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f701a62-111d-4174-b745-b7f3e305063f admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:12.195338 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d2cbd3-1056-4210-bf6d-39a6c9710f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:12.196405 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2cbd3-1056-4210-bf6d-39a6c9710f37 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:12.196690 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2cbd3-1056-4210-bf6d-39a6c9710f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:12.196993 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d2cbd3-1056-4210-bf6d-39a6c9710f37 admin admin] PATH_INFO: `/v3/projects/0656539df03841f182fa6cb574ae2865/users/99d47aa456f4489caf79805890884f6b/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:12.241836 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f701a62-111d-4174-b745-b7f3e305063f admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:12.267656 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf595e-8b23-4174-8d14-c8355f6ae6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:12.271419 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf595e-8b23-4174-8d14-c8355f6ae6ff admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:12.273576 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf595e-8b23-4174-8d14-c8355f6ae6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:12.273576 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf595e-8b23-4174-8d14-c8355f6ae6ff admin admin] PATH_INFO: `/v3/projects/578841aa960c43698576e1656b942435/users/608224a33e7f4e01afb917fb5a6061a2/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:12.274791 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2cbd3-1056-4210-bf6d-39a6c9710f37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0656539df03841f182fa6cb574ae2865, user_id=99d47aa456f4489caf79805890884f6b, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:12.293822 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d2cbd3-1056-4210-bf6d-39a6c9710f37 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:12.338846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf595e-8b23-4174-8d14-c8355f6ae6ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=578841aa960c43698576e1656b942435, user_id=608224a33e7f4e01afb917fb5a6061a2, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:12.353554 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf595e-8b23-4174-8d14-c8355f6ae6ff admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:12.366463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 890/1815] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:12 2022] PUT /identity/v3/projects/0656539df03841f182fa6cb574ae2865/users/99d47aa456f4489caf79805890884f6b/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:12.371875 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e74aae-adaf-494f-8c0b-ab35c9a88fd3 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:12.372204 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e74aae-adaf-494f-8c0b-ab35c9a88fd3 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:12.372492 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e74aae-adaf-494f-8c0b-ab35c9a88fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:12.396952 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 926/1816] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:12 2022] PUT /identity/v3/projects/578841aa960c43698576e1656b942435/users/608224a33e7f4e01afb917fb5a6061a2/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:12.404053 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4668e-e3f1-4a83-9dba-b847499d3358 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:12.405202 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4668e-e3f1-4a83-9dba-b847499d3358 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:12.405729 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee4668e-e3f1-4a83-9dba-b847499d3358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:12.461462 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-73e74aae-adaf-494f-8c0b-ab35c9a88fd3 None None] MFA Rules not processed for user `99d47aa456f4489caf79805890884f6b`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:12.464843 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-73e74aae-adaf-494f-8c0b-ab35c9a88fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:12.512673 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-8ee4668e-e3f1-4a83-9dba-b847499d3358 None None] MFA Rules not processed for user `608224a33e7f4e01afb917fb5a6061a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:12.513574 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-8ee4668e-e3f1-4a83-9dba-b847499d3358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:12.650067 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 891/1817] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:12 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:12.654490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e74aae-adaf-494f-8c0b-ab35c9a88fd3 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:12.743459 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 927/1818] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:12.745322 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4668e-e3f1-4a83-9dba-b847499d3358 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:12.812821 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e74aae-adaf-494f-8c0b-ab35c9a88fd3 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:12.821232 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7d990-10fc-44d2-966d-0045c2d1082c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:12.822062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7d990-10fc-44d2-966d-0045c2d1082c admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:12.822352 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7d990-10fc-44d2-966d-0045c2d1082c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:12.822676 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a7d990-10fc-44d2-966d-0045c2d1082c admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:12.823380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7d990-10fc-44d2-966d-0045c2d1082c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:12.825329 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a7d990-10fc-44d2-966d-0045c2d1082c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:12.881116 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 892/1819] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:12 2022] POST /identity/v3/projects => generated 409 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:12.882184 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7d990-10fc-44d2-966d-0045c2d1082c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:12.952133 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee4668e-e3f1-4a83-9dba-b847499d3358 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:13.011986 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a7d990-10fc-44d2-966d-0045c2d1082c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:13.025507 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2caa1-de47-4163-8cb2-b38774b437c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:13.026204 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2caa1-de47-4163-8cb2-b38774b437c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:13.026488 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2caa1-de47-4163-8cb2-b38774b437c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:13.026786 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2caa1-de47-4163-8cb2-b38774b437c2 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:13.027490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2caa1-de47-4163-8cb2-b38774b437c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:13.037228 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2caa1-de47-4163-8cb2-b38774b437c2 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:13.074892 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12c54d-f652-432d-bc63-e9727f762608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:13.075653 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12c54d-f652-432d-bc63-e9727f762608 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:13.075981 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12c54d-f652-432d-bc63-e9727f762608 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:13.076251 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12c54d-f652-432d-bc63-e9727f762608 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:13.077110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12c54d-f652-432d-bc63-e9727f762608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:13.079225 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12c54d-f652-432d-bc63-e9727f762608 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:13.094506 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 893/1820] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:12 2022] POST /identity/v3/users => generated 311 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:51:13.096250 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2caa1-de47-4163-8cb2-b38774b437c2 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:13.132578 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2caa1-de47-4163-8cb2-b38774b437c2 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:13.139345 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0db99-8aaf-4273-a33a-8a49f7a4f3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:13.140368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0db99-8aaf-4273-a33a-8a49f7a4f3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:13.140663 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0db99-8aaf-4273-a33a-8a49f7a4f3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:13.141110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0db99-8aaf-4273-a33a-8a49f7a4f3c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:13.141860 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0db99-8aaf-4273-a33a-8a49f7a4f3c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:13.143906 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0db99-8aaf-4273-a33a-8a49f7a4f3c8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:13.150232 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 928/1821] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:12 2022] POST /identity/v3/projects => generated 373 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:13.152349 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12c54d-f652-432d-bc63-e9727f762608 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:13.158325 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-7b12c54d-f652-432d-bc63-e9727f762608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:13.169480 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 894/1822] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:13.169480 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0db99-8aaf-4273-a33a-8a49f7a4f3c8 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:13.181580 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0db99-8aaf-4273-a33a-8a49f7a4f3c8 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:13.295074 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12c54d-f652-432d-bc63-e9727f762608 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:13.295282 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311de38a-e636-4e46-9f3a-23a0445e6ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:13.295737 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311de38a-e636-4e46-9f3a-23a0445e6ed3 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:13.295957 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311de38a-e636-4e46-9f3a-23a0445e6ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:13.296285 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311de38a-e636-4e46-9f3a-23a0445e6ed3 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:13.296993 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311de38a-e636-4e46-9f3a-23a0445e6ed3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:13.299589 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311de38a-e636-4e46-9f3a-23a0445e6ed3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:13.309556 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b53188-9293-4b6c-b72a-dc9f5cb47d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:13.311608 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b53188-9293-4b6c-b72a-dc9f5cb47d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:13.311936 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b53188-9293-4b6c-b72a-dc9f5cb47d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:13.312264 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b53188-9293-4b6c-b72a-dc9f5cb47d58 admin admin] PATH_INFO: `/v3/projects/d8323bb202894093bc5ad1a43857c581` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:13.317197 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b53188-9293-4b6c-b72a-dc9f5cb47d58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8323bb202894093bc5ad1a43857c581)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:13.322890 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b53188-9293-4b6c-b72a-dc9f5cb47d58 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:13.335710 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 895/1823] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:13 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:13.336923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311de38a-e636-4e46-9f3a-23a0445e6ed3 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:13.349295 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311de38a-e636-4e46-9f3a-23a0445e6ed3 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:13.355659 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13236bda-50de-4c65-a9f9-1884d397f099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:13.356819 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13236bda-50de-4c65-a9f9-1884d397f099 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:13.357183 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13236bda-50de-4c65-a9f9-1884d397f099 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:13.357537 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13236bda-50de-4c65-a9f9-1884d397f099 admin admin] PATH_INFO: `/v3/projects/194a8971da404a29939de6f2086ae73c/users/2334bddf1448439e96f9483ae63f82e0/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:13.384795 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13236bda-50de-4c65-a9f9-1884d397f099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=194a8971da404a29939de6f2086ae73c, user_id=2334bddf1448439e96f9483ae63f82e0, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:13.389883 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13236bda-50de-4c65-a9f9-1884d397f099 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:13.419401 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 896/1824] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:13 2022] PUT /identity/v3/projects/194a8971da404a29939de6f2086ae73c/users/2334bddf1448439e96f9483ae63f82e0/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:13.419401 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13236bda-50de-4c65-a9f9-1884d397f099 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:13.471492 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b7b53188-9293-4b6c-b72a-dc9f5cb47d58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8323bb202894093bc5ad1a43857c581', 'request_id': 'req-b7b53188-9293-4b6c-b72a-dc9f5cb47d58'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:13.478125 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b7b53188-9293-4b6c-b72a-dc9f5cb47d58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8323bb202894093bc5ad1a43857c581', 'request_id': 'req-b7b53188-9293-4b6c-b72a-dc9f5cb47d58'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:13.560089 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b7b53188-9293-4b6c-b72a-dc9f5cb47d58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8323bb202894093bc5ad1a43857c581', 'request_id': 'req-b7b53188-9293-4b6c-b72a-dc9f5cb47d58'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:13.601204 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13236bda-50de-4c65-a9f9-1884d397f099 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:13.607376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b7b53188-9293-4b6c-b72a-dc9f5cb47d58 admin admin] The token cache is being invalidate because project d8323bb202894093bc5ad1a43857c581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:13.607693 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b7b53188-9293-4b6c-b72a-dc9f5cb47d58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:13.611418 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b7b53188-9293-4b6c-b72a-dc9f5cb47d58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:13.621423 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 929/1825] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:13 2022] DELETE /identity/v3/projects/d8323bb202894093bc5ad1a43857c581 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:13.625655 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b53188-9293-4b6c-b72a-dc9f5cb47d58 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:13.631964 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b7b53188-9293-4b6c-b72a-dc9f5cb47d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:13.745854 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b53188-9293-4b6c-b72a-dc9f5cb47d58 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:13.751889 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fec46-16fb-44e5-b210-995ae1149de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:13.752718 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fec46-16fb-44e5-b210-995ae1149de6 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:13.753210 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fec46-16fb-44e5-b210-995ae1149de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:13.754112 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558fec46-16fb-44e5-b210-995ae1149de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:13.754760 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fec46-16fb-44e5-b210-995ae1149de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:13.756873 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558fec46-16fb-44e5-b210-995ae1149de6 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:13.759657 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970b67b-8402-447e-bc3d-3502484a9dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:13.761204 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970b67b-8402-447e-bc3d-3502484a9dce admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:13.761828 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970b67b-8402-447e-bc3d-3502484a9dce admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:13.762117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970b67b-8402-447e-bc3d-3502484a9dce admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:13.763050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970b67b-8402-447e-bc3d-3502484a9dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:13.777680 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970b67b-8402-447e-bc3d-3502484a9dce admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:13.782015 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 897/1826] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:13.792592 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 930/1827] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:13 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:13.794036 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f9142-112d-4af2-8272-e078c57aae62 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:13.794329 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f9142-112d-4af2-8272-e078c57aae62 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:13.794811 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f9142-112d-4af2-8272-e078c57aae62 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:13.796136 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fec46-16fb-44e5-b210-995ae1149de6 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:13.796377 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 931/1828] 10.222.0.73 () {54 vars in 921 bytes} [Mon Apr 11 16:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:51:13.797164 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f9142-112d-4af2-8272-e078c57aae62 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:13.800654 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-1e5f9142-112d-4af2-8272-e078c57aae62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:13.809607 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-558fec46-16fb-44e5-b210-995ae1149de6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:13.826415 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558fec46-16fb-44e5-b210-995ae1149de6 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:13.834898 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a2378-2ded-40d5-8d3d-029b7862a0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:13.835856 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a2378-2ded-40d5-8d3d-029b7862a0db admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:13.836140 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a2378-2ded-40d5-8d3d-029b7862a0db admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:13.836417 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a2378-2ded-40d5-8d3d-029b7862a0db admin admin] PATH_INFO: `/v3/users/c554c8766387470bb094f3204e6ab5ce` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:13.838001 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a2378-2ded-40d5-8d3d-029b7862a0db admin admin] RBAC: Authorizing `identity:delete_user(user_id=c554c8766387470bb094f3204e6ab5ce)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:13.840461 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f9142-112d-4af2-8272-e078c57aae62 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:13.841363 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a2378-2ded-40d5-8d3d-029b7862a0db admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:13.847896 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b4985-2c73-46a6-a355-f957998d5bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:13.849019 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b4985-2c73-46a6-a355-f957998d5bec admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:13.849234 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b4985-2c73-46a6-a355-f957998d5bec admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:13.849513 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b4985-2c73-46a6-a355-f957998d5bec admin admin] PATH_INFO: `/v3/projects/1423696b9fd942a896ab82308d8d64e2/users/8524531cf15f47a2953ad5a007e9c45e/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:13.870313 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b4985-2c73-46a6-a355-f957998d5bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1423696b9fd942a896ab82308d8d64e2, user_id=8524531cf15f47a2953ad5a007e9c45e, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:13.882461 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b4985-2c73-46a6-a355-f957998d5bec admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:13.905052 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 932/1829] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:13 2022] PUT /identity/v3/projects/1423696b9fd942a896ab82308d8d64e2/users/8524531cf15f47a2953ad5a007e9c45e/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:13.912621 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b4985-2c73-46a6-a355-f957998d5bec admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:13.920354 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b85a2378-2ded-40d5-8d3d-029b7862a0db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c554c8766387470bb094f3204e6ab5ce'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:13.932883 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b85a2378-2ded-40d5-8d3d-029b7862a0db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c554c8766387470bb094f3204e6ab5ce'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:13.933639 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b85a2378-2ded-40d5-8d3d-029b7862a0db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c554c8766387470bb094f3204e6ab5ce'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:13.947343 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b85a2378-2ded-40d5-8d3d-029b7862a0db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c554c8766387470bb094f3204e6ab5ce'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:13.973699 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b85a2378-2ded-40d5-8d3d-029b7862a0db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c554c8766387470bb094f3204e6ab5ce'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:13.995099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 898/1830] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:13 2022] DELETE /identity/v3/users/c554c8766387470bb094f3204e6ab5ce => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:13.996581 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729e062-c930-40b2-a50a-1479eceaec67 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:13.996870 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729e062-c930-40b2-a50a-1479eceaec67 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:13.997308 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729e062-c930-40b2-a50a-1479eceaec67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:14.013896 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b4985-2c73-46a6-a355-f957998d5bec admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:14.037191 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9729e062-c930-40b2-a50a-1479eceaec67 None None] MFA Rules not processed for user `ba3665d046864985916fdd6c4a4edcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:14.038943 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9729e062-c930-40b2-a50a-1479eceaec67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:14.104740 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824906d-bf91-447e-aa8e-a9ea84a1dda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:14.105689 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824906d-bf91-447e-aa8e-a9ea84a1dda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:14.106025 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824906d-bf91-447e-aa8e-a9ea84a1dda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:14.106354 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824906d-bf91-447e-aa8e-a9ea84a1dda3 admin admin] PATH_INFO: `/v3/projects/194a8971da404a29939de6f2086ae73c/users/2334bddf1448439e96f9483ae63f82e0/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:14.110658 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824906d-bf91-447e-aa8e-a9ea84a1dda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=194a8971da404a29939de6f2086ae73c, user_id=2334bddf1448439e96f9483ae63f82e0, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:14.114934 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824906d-bf91-447e-aa8e-a9ea84a1dda3 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:14.134627 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 933/1831] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:13 2022] PUT /identity/v3/projects/194a8971da404a29939de6f2086ae73c/users/2334bddf1448439e96f9483ae63f82e0/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:14.134627 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824906d-bf91-447e-aa8e-a9ea84a1dda3 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:14.148918 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9824906d-bf91-447e-aa8e-a9ea84a1dda3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:14.235621 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 899/1832] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Apr 11 16:51:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:14.237347 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729e062-c930-40b2-a50a-1479eceaec67 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:14.240419 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9729e062-c930-40b2-a50a-1479eceaec67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:14.265636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729e062-c930-40b2-a50a-1479eceaec67 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:14.279469 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2c670-8541-4c40-a06f-639b6b038441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:14.280510 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2c670-8541-4c40-a06f-639b6b038441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:14.281971 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2c670-8541-4c40-a06f-639b6b038441 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:14.282407 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2c670-8541-4c40-a06f-639b6b038441 admin admin] PATH_INFO: `/v3/projects/a762adb6eae1477ba60a4d86a38aed2f` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:14.283875 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2c670-8541-4c40-a06f-639b6b038441 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a762adb6eae1477ba60a4d86a38aed2f)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:14.301209 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824906d-bf91-447e-aa8e-a9ea84a1dda3 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:14.302923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2c670-8541-4c40-a06f-639b6b038441 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:14.325393 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b110b57c-1b3d-49c9-bef7-90ae992e4806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:14.326085 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110b57c-1b3d-49c9-bef7-90ae992e4806 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:14.326400 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110b57c-1b3d-49c9-bef7-90ae992e4806 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:14.326834 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b110b57c-1b3d-49c9-bef7-90ae992e4806 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:14.328421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110b57c-1b3d-49c9-bef7-90ae992e4806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:14.330658 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b110b57c-1b3d-49c9-bef7-90ae992e4806 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:14.362785 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 934/1833] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:14.364449 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775677f4-9de2-415a-bb9d-1d5d6dcf7220 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:14.364743 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775677f4-9de2-415a-bb9d-1d5d6dcf7220 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:14.365021 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775677f4-9de2-415a-bb9d-1d5d6dcf7220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:14.419585 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-13c2c670-8541-4c40-a06f-639b6b038441 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a762adb6eae1477ba60a4d86a38aed2f', 'request_id': 'req-13c2c670-8541-4c40-a06f-639b6b038441'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:14.429447 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-775677f4-9de2-415a-bb9d-1d5d6dcf7220 None None] MFA Rules not processed for user `2334bddf1448439e96f9483ae63f82e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:14.431860 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-13c2c670-8541-4c40-a06f-639b6b038441 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a762adb6eae1477ba60a4d86a38aed2f', 'request_id': 'req-13c2c670-8541-4c40-a06f-639b6b038441'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:14.433287 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-775677f4-9de2-415a-bb9d-1d5d6dcf7220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:14.461582 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-13c2c670-8541-4c40-a06f-639b6b038441 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a762adb6eae1477ba60a4d86a38aed2f', 'request_id': 'req-13c2c670-8541-4c40-a06f-639b6b038441'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:14.491002 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-13c2c670-8541-4c40-a06f-639b6b038441 admin admin] The token cache is being invalidate because project a762adb6eae1477ba60a4d86a38aed2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:14.491374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-13c2c670-8541-4c40-a06f-639b6b038441 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:14.492271 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-13c2c670-8541-4c40-a06f-639b6b038441 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:14.494127 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 900/1834] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:14 2022] DELETE /identity/v3/projects/a762adb6eae1477ba60a4d86a38aed2f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:14.495469 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2c670-8541-4c40-a06f-639b6b038441 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:14.498523 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-13c2c670-8541-4c40-a06f-639b6b038441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:14.599681 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2c670-8541-4c40-a06f-639b6b038441 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:14.605422 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3b430-0700-4edb-a942-22ebc705113c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:14.606457 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3b430-0700-4edb-a942-22ebc705113c service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:14.606982 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3b430-0700-4edb-a942-22ebc705113c service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:14.607562 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3b430-0700-4edb-a942-22ebc705113c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:14.609646 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-36c3b430-0700-4edb-a942-22ebc705113c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:14.611645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 935/1835] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:14 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:14.612447 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775677f4-9de2-415a-bb9d-1d5d6dcf7220 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:14.615715 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-775677f4-9de2-415a-bb9d-1d5d6dcf7220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:14.623894 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3b430-0700-4edb-a942-22ebc705113c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:14.626365 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3b430-0700-4edb-a942-22ebc705113c service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:14.639321 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 901/1836] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:14.640344 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3b430-0700-4edb-a942-22ebc705113c service nova] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:14.642844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-36c3b430-0700-4edb-a942-22ebc705113c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:14.729840 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3b430-0700-4edb-a942-22ebc705113c service nova] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:14.733438 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775677f4-9de2-415a-bb9d-1d5d6dcf7220 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:14.736075 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8682c-6905-487d-a99c-559ec1b9adc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:14.737117 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8682c-6905-487d-a99c-559ec1b9adc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:14.737466 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8682c-6905-487d-a99c-559ec1b9adc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:14.737811 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8682c-6905-487d-a99c-559ec1b9adc5 admin admin] PATH_INFO: `/v3/users/8fd829a04a564b7391a23b0be272caa6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:14.739437 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8682c-6905-487d-a99c-559ec1b9adc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fd829a04a564b7391a23b0be272caa6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:14.741225 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb763c-c492-46b1-93df-a5c511dbd028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:14.741855 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8682c-6905-487d-a99c-559ec1b9adc5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:14.743084 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb763c-c492-46b1-93df-a5c511dbd028 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:14.743567 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb763c-c492-46b1-93df-a5c511dbd028 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:14.744175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb763c-c492-46b1-93df-a5c511dbd028 admin admin] PATH_INFO: `/v3/projects/1423696b9fd942a896ab82308d8d64e2/users/8524531cf15f47a2953ad5a007e9c45e/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:14.747657 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb763c-c492-46b1-93df-a5c511dbd028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1423696b9fd942a896ab82308d8d64e2, user_id=8524531cf15f47a2953ad5a007e9c45e, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:14.753819 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb763c-c492-46b1-93df-a5c511dbd028 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:14.773067 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 936/1837] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:14 2022] PUT /identity/v3/projects/1423696b9fd942a896ab82308d8d64e2/users/8524531cf15f47a2953ad5a007e9c45e/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:14.788839 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb763c-c492-46b1-93df-a5c511dbd028 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:14.795091 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-21fb763c-c492-46b1-93df-a5c511dbd028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:14.821733 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-08e8682c-6905-487d-a99c-559ec1b9adc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fd829a04a564b7391a23b0be272caa6'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:14.833909 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-08e8682c-6905-487d-a99c-559ec1b9adc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fd829a04a564b7391a23b0be272caa6'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:14.834967 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-08e8682c-6905-487d-a99c-559ec1b9adc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fd829a04a564b7391a23b0be272caa6'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:14.869813 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb763c-c492-46b1-93df-a5c511dbd028 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:14.874480 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-08e8682c-6905-487d-a99c-559ec1b9adc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fd829a04a564b7391a23b0be272caa6'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:14.877664 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f6991-6ea4-44ab-bc01-24b2d756d3ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:14.879215 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f6991-6ea4-44ab-bc01-24b2d756d3ad service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:14.879846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f6991-6ea4-44ab-bc01-24b2d756d3ad service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:14.880138 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f6991-6ea4-44ab-bc01-24b2d756d3ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:14.882302 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-845f6991-6ea4-44ab-bc01-24b2d756d3ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:14.899091 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-08e8682c-6905-487d-a99c-559ec1b9adc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fd829a04a564b7391a23b0be272caa6'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:14.916704 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 902/1838] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:14 2022] DELETE /identity/v3/users/8fd829a04a564b7391a23b0be272caa6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:14.926678 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9281967-061a-43a6-bf23-bde53daee96f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:14.927098 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9281967-061a-43a6-bf23-bde53daee96f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:14.927380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9281967-061a-43a6-bf23-bde53daee96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:14.989654 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b9281967-061a-43a6-bf23-bde53daee96f None None] MFA Rules not processed for user `8524531cf15f47a2953ad5a007e9c45e`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:14.991854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b9281967-061a-43a6-bf23-bde53daee96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:14.995592 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f6991-6ea4-44ab-bc01-24b2d756d3ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:14.997035 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845f6991-6ea4-44ab-bc01-24b2d756d3ad service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:15.008000 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 937/1839] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:14 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:15.009077 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f6991-6ea4-44ab-bc01-24b2d756d3ad service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:15.010533 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-845f6991-6ea4-44ab-bc01-24b2d756d3ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:15.088735 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 903/1840] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:15.101201 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f6991-6ea4-44ab-bc01-24b2d756d3ad service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:15.102616 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9281967-061a-43a6-bf23-bde53daee96f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:15.104061 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b9281967-061a-43a6-bf23-bde53daee96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:15.186778 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fbb77-dd76-4d35-8f07-0dddd0f803a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:15.188482 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fbb77-dd76-4d35-8f07-0dddd0f803a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:15.188660 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fbb77-dd76-4d35-8f07-0dddd0f803a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:15.188928 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fbb77-dd76-4d35-8f07-0dddd0f803a0 admin admin] PATH_INFO: `/v3/projects/8df2450b987b43fabd29bc93b47335e2` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:15.191779 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fbb77-dd76-4d35-8f07-0dddd0f803a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df2450b987b43fabd29bc93b47335e2)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:15.194380 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fbb77-dd76-4d35-8f07-0dddd0f803a0 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:15.213854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9281967-061a-43a6-bf23-bde53daee96f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:15.218566 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e83d59-51da-49e3-8bbd-ca6cf19e0c6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:15.220924 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e83d59-51da-49e3-8bbd-ca6cf19e0c6a service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:15.221371 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e83d59-51da-49e3-8bbd-ca6cf19e0c6a service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:15.221790 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e83d59-51da-49e3-8bbd-ca6cf19e0c6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:15.236987 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e83d59-51da-49e3-8bbd-ca6cf19e0c6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:15.241070 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e83d59-51da-49e3-8bbd-ca6cf19e0c6a service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:15.256566 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 904/1841] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:15 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:51:15.286009 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e83d59-51da-49e3-8bbd-ca6cf19e0c6a service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:15.288907 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-54e83d59-51da-49e3-8bbd-ca6cf19e0c6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:15.312464 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e83d59-51da-49e3-8bbd-ca6cf19e0c6a service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:15.318342 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-008fbb77-dd76-4d35-8f07-0dddd0f803a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df2450b987b43fabd29bc93b47335e2', 'request_id': 'req-008fbb77-dd76-4d35-8f07-0dddd0f803a0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:15.328324 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-008fbb77-dd76-4d35-8f07-0dddd0f803a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df2450b987b43fabd29bc93b47335e2', 'request_id': 'req-008fbb77-dd76-4d35-8f07-0dddd0f803a0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:15.338541 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-008fbb77-dd76-4d35-8f07-0dddd0f803a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df2450b987b43fabd29bc93b47335e2', 'request_id': 'req-008fbb77-dd76-4d35-8f07-0dddd0f803a0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:15.370030 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-008fbb77-dd76-4d35-8f07-0dddd0f803a0 admin admin] The token cache is being invalidate because project 8df2450b987b43fabd29bc93b47335e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:15.370317 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-008fbb77-dd76-4d35-8f07-0dddd0f803a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:15.371003 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-008fbb77-dd76-4d35-8f07-0dddd0f803a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:15.376794 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 938/1842] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:15 2022] DELETE /identity/v3/projects/8df2450b987b43fabd29bc93b47335e2 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:15.378198 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dc5c3-be06-4f53-9b5e-d645f2038ee6 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:15.379102 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dc5c3-be06-4f53-9b5e-d645f2038ee6 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:15.379575 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dc5c3-be06-4f53-9b5e-d645f2038ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:15.421023 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-f28dc5c3-be06-4f53-9b5e-d645f2038ee6 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:15.423110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f28dc5c3-be06-4f53-9b5e-d645f2038ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:15.428413 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53172d1-9bef-4d28-95b5-7a72a022edcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:15.429015 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53172d1-9bef-4d28-95b5-7a72a022edcf service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:15.429285 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53172d1-9bef-4d28-95b5-7a72a022edcf service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:15.429559 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53172d1-9bef-4d28-95b5-7a72a022edcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:15.432706 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c53172d1-9bef-4d28-95b5-7a72a022edcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:15.516083 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53172d1-9bef-4d28-95b5-7a72a022edcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:15.518046 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53172d1-9bef-4d28-95b5-7a72a022edcf service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:15.539386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 905/1843] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:15 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:15.540355 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53172d1-9bef-4d28-95b5-7a72a022edcf service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:15.544291 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c53172d1-9bef-4d28-95b5-7a72a022edcf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:15.565937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53172d1-9bef-4d28-95b5-7a72a022edcf service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:15.568449 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 939/1844] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:15.571302 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28dc5c3-be06-4f53-9b5e-d645f2038ee6 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:15.571500 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a8343-bc8d-4a4d-9ff7-b031f6505b9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:15.572409 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a8343-bc8d-4a4d-9ff7-b031f6505b9b service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:15.572833 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a8343-bc8d-4a4d-9ff7-b031f6505b9b service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:15.573254 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a8343-bc8d-4a4d-9ff7-b031f6505b9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:15.576629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f28dc5c3-be06-4f53-9b5e-d645f2038ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:15.582333 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3b4a8343-bc8d-4a4d-9ff7-b031f6505b9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:15.622623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28dc5c3-be06-4f53-9b5e-d645f2038ee6 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:15.627324 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc860d-1ec0-4db9-8cda-174126267423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:15.628417 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc860d-1ec0-4db9-8cda-174126267423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:15.629310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc860d-1ec0-4db9-8cda-174126267423 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:15.629731 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc860d-1ec0-4db9-8cda-174126267423 admin admin] PATH_INFO: `/v3/projects/7247935bba8840a8a43406d3c9889e83` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:15.631664 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc860d-1ec0-4db9-8cda-174126267423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7247935bba8840a8a43406d3c9889e83)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:15.633894 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc860d-1ec0-4db9-8cda-174126267423 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:15.697744 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a8343-bc8d-4a4d-9ff7-b031f6505b9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:15.700183 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4a8343-bc8d-4a4d-9ff7-b031f6505b9b service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:15.703020 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d3fc860d-1ec0-4db9-8cda-174126267423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7247935bba8840a8a43406d3c9889e83', 'request_id': 'req-d3fc860d-1ec0-4db9-8cda-174126267423'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:15.711531 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d3fc860d-1ec0-4db9-8cda-174126267423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7247935bba8840a8a43406d3c9889e83', 'request_id': 'req-d3fc860d-1ec0-4db9-8cda-174126267423'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:15.713377 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 906/1845] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:15.715306 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a074d-5094-42ab-8f1e-ef420c6ba893 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:15.715673 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a074d-5094-42ab-8f1e-ef420c6ba893 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:15.716121 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a074d-5094-42ab-8f1e-ef420c6ba893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:15.739148 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-7f7a074d-5094-42ab-8f1e-ef420c6ba893 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:15.740530 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7f7a074d-5094-42ab-8f1e-ef420c6ba893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:15.740665 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d3fc860d-1ec0-4db9-8cda-174126267423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7247935bba8840a8a43406d3c9889e83', 'request_id': 'req-d3fc860d-1ec0-4db9-8cda-174126267423'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:15.758530 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d3fc860d-1ec0-4db9-8cda-174126267423 admin admin] The token cache is being invalidate because project 7247935bba8840a8a43406d3c9889e83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:15.759677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d3fc860d-1ec0-4db9-8cda-174126267423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:15.760291 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d3fc860d-1ec0-4db9-8cda-174126267423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:15.762543 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 940/1846] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:15 2022] DELETE /identity/v3/projects/7247935bba8840a8a43406d3c9889e83 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:15.769059 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35828ed-1f07-4786-a7ba-9febae2979e7 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:15.769434 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35828ed-1f07-4786-a7ba-9febae2979e7 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:15.769825 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35828ed-1f07-4786-a7ba-9febae2979e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:15.792108 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-a35828ed-1f07-4786-a7ba-9febae2979e7 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:15.793407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a35828ed-1f07-4786-a7ba-9febae2979e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:15.826928 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 907/1847] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:15.831655 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a074d-5094-42ab-8f1e-ef420c6ba893 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:15.850021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a074d-5094-42ab-8f1e-ef420c6ba893 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:15.867130 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd176f80-5c67-40ef-ad0d-91e40f61bafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:15.867811 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd176f80-5c67-40ef-ad0d-91e40f61bafd admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:15.868097 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd176f80-5c67-40ef-ad0d-91e40f61bafd admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:15.868386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd176f80-5c67-40ef-ad0d-91e40f61bafd admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:15.869120 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd176f80-5c67-40ef-ad0d-91e40f61bafd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:51:15.869475 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd176f80-5c67-40ef-ad0d-91e40f61bafd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:15.871104 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd176f80-5c67-40ef-ad0d-91e40f61bafd admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:15.907699 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 908/1848] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:51:15.907699 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd176f80-5c67-40ef-ad0d-91e40f61bafd admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:15.916048 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 941/1849] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:15.927083 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9e689-6959-4889-b7df-b22c360aa8f1 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:15.927519 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd176f80-5c67-40ef-ad0d-91e40f61bafd admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:15.927842 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9e689-6959-4889-b7df-b22c360aa8f1 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:15.928325 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9e689-6959-4889-b7df-b22c360aa8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:15.934812 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b5a25-311c-40c3-85e2-0cae58bdeffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:15.935487 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b5a25-311c-40c3-85e2-0cae58bdeffd admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:15.935755 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b5a25-311c-40c3-85e2-0cae58bdeffd admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:15.936033 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9b5a25-311c-40c3-85e2-0cae58bdeffd admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:15.936728 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b5a25-311c-40c3-85e2-0cae58bdeffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:15.938734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9b5a25-311c-40c3-85e2-0cae58bdeffd admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:15.975791 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-8fb9e689-6959-4889-b7df-b22c360aa8f1 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:15.979441 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-8fb9e689-6959-4889-b7df-b22c360aa8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:16.001791 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 942/1850] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:16.003137 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 909/1851] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:15 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:16.004082 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9e689-6959-4889-b7df-b22c360aa8f1 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.004760 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b5a25-311c-40c3-85e2-0cae58bdeffd admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.021345 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9e689-6959-4889-b7df-b22c360aa8f1 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.100561 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9b5a25-311c-40c3-85e2-0cae58bdeffd admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.105513 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff81d8-5fa0-42fb-a2d6-88ab164b24d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.106301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff81d8-5fa0-42fb-a2d6-88ab164b24d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.106733 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff81d8-5fa0-42fb-a2d6-88ab164b24d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.107112 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff81d8-5fa0-42fb-a2d6-88ab164b24d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.107962 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff81d8-5fa0-42fb-a2d6-88ab164b24d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:51:16.108355 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff81d8-5fa0-42fb-a2d6-88ab164b24d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.110204 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff81d8-5fa0-42fb-a2d6-88ab164b24d4 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.134883 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 910/1852] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:51:16.135925 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff81d8-5fa0-42fb-a2d6-88ab164b24d4 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.136049 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb3ba1-c664-42d5-9a8a-b239d0078d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.136926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb3ba1-c664-42d5-9a8a-b239d0078d11 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.137200 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb3ba1-c664-42d5-9a8a-b239d0078d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.137470 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb3ba1-c664-42d5-9a8a-b239d0078d11 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.138182 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb3ba1-c664-42d5-9a8a-b239d0078d11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.140126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb3ba1-c664-42d5-9a8a-b239d0078d11 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.147486 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff81d8-5fa0-42fb-a2d6-88ab164b24d4 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.154680 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27479622-c447-40e8-b68c-ef7922d9b6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.155624 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27479622-c447-40e8-b68c-ef7922d9b6c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.155925 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27479622-c447-40e8-b68c-ef7922d9b6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.156334 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27479622-c447-40e8-b68c-ef7922d9b6c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.157000 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27479622-c447-40e8-b68c-ef7922d9b6c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.158954 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27479622-c447-40e8-b68c-ef7922d9b6c2 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.163035 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 943/1853] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:16 2022] POST /identity/v3/users => generated 295 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:16.166966 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb3ba1-c664-42d5-9a8a-b239d0078d11 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.179509 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb3ba1-c664-42d5-9a8a-b239d0078d11 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.185563 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7518bc-abdf-4358-a4b1-828a5e5077df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.186360 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7518bc-abdf-4358-a4b1-828a5e5077df admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.186658 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7518bc-abdf-4358-a4b1-828a5e5077df admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.186937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7518bc-abdf-4358-a4b1-828a5e5077df admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.187700 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7518bc-abdf-4358-a4b1-828a5e5077df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.189840 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7518bc-abdf-4358-a4b1-828a5e5077df admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.190503 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 911/1854] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:16 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:16.194396 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27479622-c447-40e8-b68c-ef7922d9b6c2 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.200982 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 944/1855] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:16.204990 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7518bc-abdf-4358-a4b1-828a5e5077df admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.215750 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7518bc-abdf-4358-a4b1-828a5e5077df admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.257458 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27479622-c447-40e8-b68c-ef7922d9b6c2 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.262441 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4543ba3-aea7-450f-a5e7-c8763bf50b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.263204 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4543ba3-aea7-450f-a5e7-c8763bf50b32 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.263491 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4543ba3-aea7-450f-a5e7-c8763bf50b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.263765 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4543ba3-aea7-450f-a5e7-c8763bf50b32 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.264443 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4543ba3-aea7-450f-a5e7-c8763bf50b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.266386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4543ba3-aea7-450f-a5e7-c8763bf50b32 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.269830 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7eb99d-5b3f-49a3-98da-3392e1a82845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.270478 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7eb99d-5b3f-49a3-98da-3392e1a82845 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.270785 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7eb99d-5b3f-49a3-98da-3392e1a82845 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.271058 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7eb99d-5b3f-49a3-98da-3392e1a82845 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.271772 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7eb99d-5b3f-49a3-98da-3392e1a82845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.273352 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7eb99d-5b3f-49a3-98da-3392e1a82845 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.287630 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 945/1856] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:16.287824 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 912/1857] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:16 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:51:16.288692 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7eb99d-5b3f-49a3-98da-3392e1a82845 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.290417 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4543ba3-aea7-450f-a5e7-c8763bf50b32 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.298624 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7eb99d-5b3f-49a3-98da-3392e1a82845 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.301077 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4543ba3-aea7-450f-a5e7-c8763bf50b32 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.303248 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5a488-4058-46a7-90c6-05c78f0c2a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.304107 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5a488-4058-46a7-90c6-05c78f0c2a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.304406 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5a488-4058-46a7-90c6-05c78f0c2a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.304658 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5a488-4058-46a7-90c6-05c78f0c2a1b admin admin] PATH_INFO: `/v3/projects/4e4898ee8afc4749899e65b818a31c9b/users/160a188099cd413b91fb86c8d7a4e54e/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.305859 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eea45-34a7-4b8b-bfa6-26eb6f79b37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.306574 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eea45-34a7-4b8b-bfa6-26eb6f79b37e admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.306887 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eea45-34a7-4b8b-bfa6-26eb6f79b37e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.307164 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eea45-34a7-4b8b-bfa6-26eb6f79b37e admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.307887 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737eea45-34a7-4b8b-bfa6-26eb6f79b37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.309532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737eea45-34a7-4b8b-bfa6-26eb6f79b37e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.318836 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5a488-4058-46a7-90c6-05c78f0c2a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4898ee8afc4749899e65b818a31c9b, user_id=160a188099cd413b91fb86c8d7a4e54e, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.319417 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 913/1858] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:16.321461 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb5a488-4058-46a7-90c6-05c78f0c2a1b admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.323594 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eea45-34a7-4b8b-bfa6-26eb6f79b37e admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.333106 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eea45-34a7-4b8b-bfa6-26eb6f79b37e admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.333854 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 946/1859] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:16 2022] PUT /identity/v3/projects/4e4898ee8afc4749899e65b818a31c9b/users/160a188099cd413b91fb86c8d7a4e54e/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:16.345536 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fda6a8-d26b-4fee-91da-8b618a73637d None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.345886 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fda6a8-d26b-4fee-91da-8b618a73637d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.346238 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fda6a8-d26b-4fee-91da-8b618a73637d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.372534 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-c5fda6a8-d26b-4fee-91da-8b618a73637d None None] MFA Rules not processed for user `160a188099cd413b91fb86c8d7a4e54e`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:16.373731 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-c5fda6a8-d26b-4fee-91da-8b618a73637d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:16.388542 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de1704-d0db-4d4b-8c3f-65195e3f2e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.389208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de1704-d0db-4d4b-8c3f-65195e3f2e1b admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.389502 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de1704-d0db-4d4b-8c3f-65195e3f2e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.389796 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de1704-d0db-4d4b-8c3f-65195e3f2e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.390518 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de1704-d0db-4d4b-8c3f-65195e3f2e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.392265 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06de1704-d0db-4d4b-8c3f-65195e3f2e1b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.401708 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 914/1860] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:16.406451 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de1704-d0db-4d4b-8c3f-65195e3f2e1b admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.416294 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de1704-d0db-4d4b-8c3f-65195e3f2e1b admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.421021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ceaa36-a786-4a5e-ae4f-949420fbec23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.422023 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceaa36-a786-4a5e-ae4f-949420fbec23 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.422355 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceaa36-a786-4a5e-ae4f-949420fbec23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.422659 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceaa36-a786-4a5e-ae4f-949420fbec23 admin admin] PATH_INFO: `/v3/projects/52324e179bff4d048025edcd83e213b6/users/c7dac9dd8c214082a18d33b366e11cdc/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.436863 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 947/1861] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:16.437488 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ceaa36-a786-4a5e-ae4f-949420fbec23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52324e179bff4d048025edcd83e213b6, user_id=c7dac9dd8c214082a18d33b366e11cdc, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.440925 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ceaa36-a786-4a5e-ae4f-949420fbec23 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.441928 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fda6a8-d26b-4fee-91da-8b618a73637d None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.452388 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fda6a8-d26b-4fee-91da-8b618a73637d None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.453631 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 915/1862] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:16 2022] PUT /identity/v3/projects/52324e179bff4d048025edcd83e213b6/users/c7dac9dd8c214082a18d33b366e11cdc/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:16.463649 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850257bd-3bec-4f4e-837e-7daae1a0472f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.463933 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850257bd-3bec-4f4e-837e-7daae1a0472f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.464205 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850257bd-3bec-4f4e-837e-7daae1a0472f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.489865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-850257bd-3bec-4f4e-837e-7daae1a0472f None None] MFA Rules not processed for user `c7dac9dd8c214082a18d33b366e11cdc`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:16.491080 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-850257bd-3bec-4f4e-837e-7daae1a0472f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:16.507094 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c08a67-1722-4fdf-8bfd-0207949998b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.507761 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c08a67-1722-4fdf-8bfd-0207949998b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.508043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c08a67-1722-4fdf-8bfd-0207949998b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.508321 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c08a67-1722-4fdf-8bfd-0207949998b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.509005 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c08a67-1722-4fdf-8bfd-0207949998b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.510976 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c08a67-1722-4fdf-8bfd-0207949998b8 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.538443 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 948/1863] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:16 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:51:16.539657 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c08a67-1722-4fdf-8bfd-0207949998b8 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.554195 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 916/1864] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:16.558539 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850257bd-3bec-4f4e-837e-7daae1a0472f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.568520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850257bd-3bec-4f4e-837e-7daae1a0472f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.600531 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c08a67-1722-4fdf-8bfd-0207949998b8 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.605141 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3108d2-9258-43d7-b4bf-060b20e139b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.605806 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3108d2-9258-43d7-b4bf-060b20e139b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.606090 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3108d2-9258-43d7-b4bf-060b20e139b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.606365 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3108d2-9258-43d7-b4bf-060b20e139b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.607098 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3108d2-9258-43d7-b4bf-060b20e139b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.609007 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3108d2-9258-43d7-b4bf-060b20e139b1 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.624103 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47428dc0-33d7-4f8c-8a92-2b1f0d780977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.624698 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47428dc0-33d7-4f8c-8a92-2b1f0d780977 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.624983 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47428dc0-33d7-4f8c-8a92-2b1f0d780977 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.625295 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47428dc0-33d7-4f8c-8a92-2b1f0d780977 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.626015 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47428dc0-33d7-4f8c-8a92-2b1f0d780977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.627940 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47428dc0-33d7-4f8c-8a92-2b1f0d780977 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.629162 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 949/1865] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:16 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:16.632793 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3108d2-9258-43d7-b4bf-060b20e139b1 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.643774 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3108d2-9258-43d7-b4bf-060b20e139b1 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.648634 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637dd8ec-9708-4569-9aaf-385efb701cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.649326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637dd8ec-9708-4569-9aaf-385efb701cff admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.649690 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637dd8ec-9708-4569-9aaf-385efb701cff admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.649947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637dd8ec-9708-4569-9aaf-385efb701cff admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.650739 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637dd8ec-9708-4569-9aaf-385efb701cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.652365 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637dd8ec-9708-4569-9aaf-385efb701cff admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.665276 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 950/1866] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:16.669904 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 917/1867] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:16 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:16.670047 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637dd8ec-9708-4569-9aaf-385efb701cff admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.670867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47428dc0-33d7-4f8c-8a92-2b1f0d780977 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.680193 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637dd8ec-9708-4569-9aaf-385efb701cff admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.737769 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47428dc0-33d7-4f8c-8a92-2b1f0d780977 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.742706 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026106ff-01b3-4ffc-bb1d-cad2805e0c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.743311 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db7b98-1b2b-4eeb-bb39-1929f5484ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.743582 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026106ff-01b3-4ffc-bb1d-cad2805e0c27 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.744233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026106ff-01b3-4ffc-bb1d-cad2805e0c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.744616 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026106ff-01b3-4ffc-bb1d-cad2805e0c27 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.744765 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db7b98-1b2b-4eeb-bb39-1929f5484ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.745034 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db7b98-1b2b-4eeb-bb39-1929f5484ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.745314 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db7b98-1b2b-4eeb-bb39-1929f5484ed0 admin admin] PATH_INFO: `/v3/projects/25e239c9a9fb40998a909e769fa88245/users/20d8ce45309246fb9d77d9f59d57b226/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.745682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026106ff-01b3-4ffc-bb1d-cad2805e0c27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.747707 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026106ff-01b3-4ffc-bb1d-cad2805e0c27 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.762986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db7b98-1b2b-4eeb-bb39-1929f5484ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e239c9a9fb40998a909e769fa88245, user_id=20d8ce45309246fb9d77d9f59d57b226, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.766536 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db7b98-1b2b-4eeb-bb39-1929f5484ed0 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.770380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 918/1868] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:16 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:16.774848 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026106ff-01b3-4ffc-bb1d-cad2805e0c27 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.781060 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 951/1869] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:16 2022] PUT /identity/v3/projects/25e239c9a9fb40998a909e769fa88245/users/20d8ce45309246fb9d77d9f59d57b226/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:16.785344 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db7b98-1b2b-4eeb-bb39-1929f5484ed0 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.798684 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026106ff-01b3-4ffc-bb1d-cad2805e0c27 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.842715 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db7b98-1b2b-4eeb-bb39-1929f5484ed0 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.848480 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7a250-1fe8-498d-b7b3-18ca6d9b6306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.849143 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7a250-1fe8-498d-b7b3-18ca6d9b6306 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.849428 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7a250-1fe8-498d-b7b3-18ca6d9b6306 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.849703 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7a250-1fe8-498d-b7b3-18ca6d9b6306 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.850420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7a250-1fe8-498d-b7b3-18ca6d9b6306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.852057 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7a250-1fe8-498d-b7b3-18ca6d9b6306 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.852949 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9176b81-0730-4a93-b2cf-8b4f7215c821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.853610 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9176b81-0730-4a93-b2cf-8b4f7215c821 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.853891 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9176b81-0730-4a93-b2cf-8b4f7215c821 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.854168 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9176b81-0730-4a93-b2cf-8b4f7215c821 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.854932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9176b81-0730-4a93-b2cf-8b4f7215c821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.856516 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9176b81-0730-4a93-b2cf-8b4f7215c821 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.861986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 952/1870] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:16.865831 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7a250-1fe8-498d-b7b3-18ca6d9b6306 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.866509 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 919/1871] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:16.870056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9176b81-0730-4a93-b2cf-8b4f7215c821 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.875452 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7a250-1fe8-498d-b7b3-18ca6d9b6306 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.879510 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9176b81-0730-4a93-b2cf-8b4f7215c821 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.879969 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbd810-903f-4a1f-aa2b-6aa56bb2d4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.880830 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbd810-903f-4a1f-aa2b-6aa56bb2d4ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.881109 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbd810-903f-4a1f-aa2b-6aa56bb2d4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.881384 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbd810-903f-4a1f-aa2b-6aa56bb2d4ec admin admin] PATH_INFO: `/v3/projects/25e239c9a9fb40998a909e769fa88245/users/20d8ce45309246fb9d77d9f59d57b226/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.883326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbd810-903f-4a1f-aa2b-6aa56bb2d4ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=25e239c9a9fb40998a909e769fa88245, user_id=20d8ce45309246fb9d77d9f59d57b226, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.884131 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b1d71-cd82-4dad-b0e9-64f9c7c44b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.884756 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b1d71-cd82-4dad-b0e9-64f9c7c44b71 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.885035 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b1d71-cd82-4dad-b0e9-64f9c7c44b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.885311 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b1d71-cd82-4dad-b0e9-64f9c7c44b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.885934 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bbd810-903f-4a1f-aa2b-6aa56bb2d4ec admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.886036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b1d71-cd82-4dad-b0e9-64f9c7c44b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.887863 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b1d71-cd82-4dad-b0e9-64f9c7c44b71 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:16.896721 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 953/1872] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:16 2022] PUT /identity/v3/projects/25e239c9a9fb40998a909e769fa88245/users/20d8ce45309246fb9d77d9f59d57b226/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:16.906371 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 920/1873] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:16.908180 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b1d71-cd82-4dad-b0e9-64f9c7c44b71 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:16.908686 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37209ea9-2feb-42d8-9edd-c1472ee33cbe None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.908968 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37209ea9-2feb-42d8-9edd-c1472ee33cbe None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.909241 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37209ea9-2feb-42d8-9edd-c1472ee33cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.918301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b1d71-cd82-4dad-b0e9-64f9c7c44b71 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:16.935309 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-37209ea9-2feb-42d8-9edd-c1472ee33cbe None None] MFA Rules not processed for user `20d8ce45309246fb9d77d9f59d57b226`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:16.936496 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-37209ea9-2feb-42d8-9edd-c1472ee33cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:16.979031 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97412a-66f7-4d41-b012-2302ff7af5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:16.979930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97412a-66f7-4d41-b012-2302ff7af5cf admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:16.980215 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97412a-66f7-4d41-b012-2302ff7af5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:16.980489 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97412a-66f7-4d41-b012-2302ff7af5cf admin admin] PATH_INFO: `/v3/projects/2ae3c8fa40c14e22a6358cce6e2552b0/users/b7170d3240714877a6d5fc72aa1ce755/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:16.994534 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97412a-66f7-4d41-b012-2302ff7af5cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ae3c8fa40c14e22a6358cce6e2552b0, user_id=b7170d3240714877a6d5fc72aa1ce755, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:16.997186 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97412a-66f7-4d41-b012-2302ff7af5cf admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:17.005123 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 954/1874] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:17.014429 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 921/1875] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:16 2022] PUT /identity/v3/projects/2ae3c8fa40c14e22a6358cce6e2552b0/users/b7170d3240714877a6d5fc72aa1ce755/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:17.016716 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37209ea9-2feb-42d8-9edd-c1472ee33cbe None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:17.018117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-37209ea9-2feb-42d8-9edd-c1472ee33cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:17.025751 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee229b-232c-4e7f-b6e6-18d4488c36d9 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:17.026039 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee229b-232c-4e7f-b6e6-18d4488c36d9 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:17.026318 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee229b-232c-4e7f-b6e6-18d4488c36d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:17.051704 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-83ee229b-232c-4e7f-b6e6-18d4488c36d9 None None] MFA Rules not processed for user `b7170d3240714877a6d5fc72aa1ce755`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:17.052893 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-83ee229b-232c-4e7f-b6e6-18d4488c36d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:17.085444 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37209ea9-2feb-42d8-9edd-c1472ee33cbe None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:17.129736 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 922/1876] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:17.134307 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee229b-232c-4e7f-b6e6-18d4488c36d9 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:17.140932 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53c8f9-add4-455d-85da-ce08fcbaa368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:17.142268 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53c8f9-add4-455d-85da-ce08fcbaa368 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:17.142568 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53c8f9-add4-455d-85da-ce08fcbaa368 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:17.142879 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53c8f9-add4-455d-85da-ce08fcbaa368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:17.209514 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee229b-232c-4e7f-b6e6-18d4488c36d9 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:17.213565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53c8f9-add4-455d-85da-ce08fcbaa368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:17.214277 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baea6e-9ea8-4766-ba1a-00dfca52a168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:17.215054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d53c8f9-add4-455d-85da-ce08fcbaa368 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:17.216444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baea6e-9ea8-4766-ba1a-00dfca52a168 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:17.216859 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baea6e-9ea8-4766-ba1a-00dfca52a168 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:17.217144 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13baea6e-9ea8-4766-ba1a-00dfca52a168 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:17.217893 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13baea6e-9ea8-4766-ba1a-00dfca52a168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:17.220417 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13baea6e-9ea8-4766-ba1a-00dfca52a168 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:17.226035 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 955/1877] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:17.250986 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 923/1878] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:17 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:51:17.257339 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53c8f9-add4-455d-85da-ce08fcbaa368 service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:17.270858 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53c8f9-add4-455d-85da-ce08fcbaa368 service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:17.354334 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae241ac8-cfd4-467c-ae28-87aeb36f03c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:17.355047 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae241ac8-cfd4-467c-ae28-87aeb36f03c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:17.355329 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae241ac8-cfd4-467c-ae28-87aeb36f03c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:17.355604 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae241ac8-cfd4-467c-ae28-87aeb36f03c3 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:17.356294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae241ac8-cfd4-467c-ae28-87aeb36f03c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:17.358238 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae241ac8-cfd4-467c-ae28-87aeb36f03c3 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:17.375402 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baea6e-9ea8-4766-ba1a-00dfca52a168 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:17.385865 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 956/1879] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:17 2022] POST /identity/v3/users => generated 299 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:17.389311 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13baea6e-9ea8-4766-ba1a-00dfca52a168 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:17.390302 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae241ac8-cfd4-467c-ae28-87aeb36f03c3 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:17.395416 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cbf75b-9aa6-413f-ace8-4f8efd446292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:17.396300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbf75b-9aa6-413f-ace8-4f8efd446292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:17.396581 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbf75b-9aa6-413f-ace8-4f8efd446292 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:17.396856 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cbf75b-9aa6-413f-ace8-4f8efd446292 admin admin] PATH_INFO: `/v3/users/160a188099cd413b91fb86c8d7a4e54e` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:17.398421 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbf75b-9aa6-413f-ace8-4f8efd446292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=160a188099cd413b91fb86c8d7a4e54e)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:17.400381 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cbf75b-9aa6-413f-ace8-4f8efd446292 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:17.402461 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae241ac8-cfd4-467c-ae28-87aeb36f03c3 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:17.407782 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc1dd6-aaee-4ce9-9807-b9e4a7e01bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:17.408611 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc1dd6-aaee-4ce9-9807-b9e4a7e01bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:17.408988 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc1dd6-aaee-4ce9-9807-b9e4a7e01bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:17.409386 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc1dd6-aaee-4ce9-9807-b9e4a7e01bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:17.410519 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc1dd6-aaee-4ce9-9807-b9e4a7e01bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:17.412375 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc1dd6-aaee-4ce9-9807-b9e4a7e01bd1 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:17.424543 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 957/1880] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:17.428948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc1dd6-aaee-4ce9-9807-b9e4a7e01bd1 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:17.439610 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc1dd6-aaee-4ce9-9807-b9e4a7e01bd1 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:17.444920 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038ffe2-4203-441b-9045-e7636457bf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:17.445835 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038ffe2-4203-441b-9045-e7636457bf2f admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:17.446117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038ffe2-4203-441b-9045-e7636457bf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:17.446391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038ffe2-4203-441b-9045-e7636457bf2f admin admin] PATH_INFO: `/v3/projects/e65bc6a761094b53a53007c4d5c874b2/users/8c8dc197a0854ef1b7fc59bd5438d7cc/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:17.453849 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a1cbf75b-9aa6-413f-ace8-4f8efd446292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '160a188099cd413b91fb86c8d7a4e54e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:17.462421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038ffe2-4203-441b-9045-e7636457bf2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65bc6a761094b53a53007c4d5c874b2, user_id=8c8dc197a0854ef1b7fc59bd5438d7cc, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:17.463137 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a1cbf75b-9aa6-413f-ace8-4f8efd446292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '160a188099cd413b91fb86c8d7a4e54e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:17.463859 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a1cbf75b-9aa6-413f-ace8-4f8efd446292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '160a188099cd413b91fb86c8d7a4e54e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:17.465152 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5038ffe2-4203-441b-9045-e7636457bf2f admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:17.475510 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a1cbf75b-9aa6-413f-ace8-4f8efd446292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '160a188099cd413b91fb86c8d7a4e54e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:17.486788 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 958/1881] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:17 2022] PUT /identity/v3/projects/e65bc6a761094b53a53007c4d5c874b2/users/8c8dc197a0854ef1b7fc59bd5438d7cc/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:17.487941 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038ffe2-4203-441b-9045-e7636457bf2f admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:17.491983 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-5038ffe2-4203-441b-9045-e7636457bf2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:17.493300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a1cbf75b-9aa6-413f-ace8-4f8efd446292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '160a188099cd413b91fb86c8d7a4e54e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:17.500962 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 924/1882] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:17 2022] DELETE /identity/v3/users/160a188099cd413b91fb86c8d7a4e54e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:17.508174 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba080b-3379-4eba-a1dc-ffb9dbb10371 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:17.508612 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba080b-3379-4eba-a1dc-ffb9dbb10371 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:17.509063 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba080b-3379-4eba-a1dc-ffb9dbb10371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:17.540099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-e8ba080b-3379-4eba-a1dc-ffb9dbb10371 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:17.541330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e8ba080b-3379-4eba-a1dc-ffb9dbb10371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:17.569876 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038ffe2-4203-441b-9045-e7636457bf2f admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:17.603028 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 925/1883] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:17.613380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba080b-3379-4eba-a1dc-ffb9dbb10371 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:17.614858 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e8ba080b-3379-4eba-a1dc-ffb9dbb10371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:17.624482 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805a28c-065d-4639-bac6-e962609c849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:17.625135 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805a28c-065d-4639-bac6-e962609c849e admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:17.625989 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805a28c-065d-4639-bac6-e962609c849e admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:17.626291 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805a28c-065d-4639-bac6-e962609c849e admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:17.627038 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805a28c-065d-4639-bac6-e962609c849e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:17.628623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805a28c-065d-4639-bac6-e962609c849e admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:17.641433 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 959/1884] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:17.642626 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805a28c-065d-4639-bac6-e962609c849e admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:17.652439 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805a28c-065d-4639-bac6-e962609c849e admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:17.657444 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca24a6f-9225-499a-992c-8beeb0a24c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:17.658331 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca24a6f-9225-499a-992c-8beeb0a24c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:17.658636 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca24a6f-9225-499a-992c-8beeb0a24c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:17.658918 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca24a6f-9225-499a-992c-8beeb0a24c5a admin admin] PATH_INFO: `/v3/projects/e65bc6a761094b53a53007c4d5c874b2/users/8c8dc197a0854ef1b7fc59bd5438d7cc/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:17.660868 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca24a6f-9225-499a-992c-8beeb0a24c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65bc6a761094b53a53007c4d5c874b2, user_id=8c8dc197a0854ef1b7fc59bd5438d7cc, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:17.663692 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca24a6f-9225-499a-992c-8beeb0a24c5a admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:17.669087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba080b-3379-4eba-a1dc-ffb9dbb10371 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:17.674270 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 960/1885] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:17 2022] PUT /identity/v3/projects/e65bc6a761094b53a53007c4d5c874b2/users/8c8dc197a0854ef1b7fc59bd5438d7cc/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:17.684011 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffb1d6-9c54-44a4-828e-f3663bf101cb None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:17.684369 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffb1d6-9c54-44a4-828e-f3663bf101cb None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:17.684712 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ffb1d6-9c54-44a4-828e-f3663bf101cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:17.710489 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-75ffb1d6-9c54-44a4-828e-f3663bf101cb None None] MFA Rules not processed for user `8c8dc197a0854ef1b7fc59bd5438d7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:17.711699 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-75ffb1d6-9c54-44a4-828e-f3663bf101cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:17.717092 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e47ee-acd5-4e0b-b8d4-ec44a3c18b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:17.717738 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e47ee-acd5-4e0b-b8d4-ec44a3c18b81 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:17.718020 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e47ee-acd5-4e0b-b8d4-ec44a3c18b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:17.718298 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e47ee-acd5-4e0b-b8d4-ec44a3c18b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:17.777914 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e47ee-acd5-4e0b-b8d4-ec44a3c18b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:17.778509 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 961/1886] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:17.779381 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e47ee-acd5-4e0b-b8d4-ec44a3c18b81 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:17.788928 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 926/1887] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:51:17.789580 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffb1d6-9c54-44a4-828e-f3663bf101cb None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:17.791004 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-75ffb1d6-9c54-44a4-828e-f3663bf101cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:17.850727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ffb1d6-9c54-44a4-828e-f3663bf101cb None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:17.859635 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbeb72-3d02-45fb-9a5b-b0210dd7d9c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:17.860307 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbeb72-3d02-45fb-9a5b-b0210dd7d9c3 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:17.860584 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbeb72-3d02-45fb-9a5b-b0210dd7d9c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:17.860857 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fbeb72-3d02-45fb-9a5b-b0210dd7d9c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:17.872785 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fbeb72-3d02-45fb-9a5b-b0210dd7d9c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:17.874719 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fbeb72-3d02-45fb-9a5b-b0210dd7d9c3 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:17.887074 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 962/1888] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:51:18.106914 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e47ee-acd5-4e0b-b8d4-ec44a3c18b81 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:18.108322 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f06e47ee-acd5-4e0b-b8d4-ec44a3c18b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:18.133331 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e47ee-acd5-4e0b-b8d4-ec44a3c18b81 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:18.140377 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cdc20-cfdf-4f8d-92ca-273f7e21cf5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:18.141477 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cdc20-cfdf-4f8d-92ca-273f7e21cf5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:18.141820 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cdc20-cfdf-4f8d-92ca-273f7e21cf5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:18.142211 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cdc20-cfdf-4f8d-92ca-273f7e21cf5f admin admin] PATH_INFO: `/v3/projects/4e4898ee8afc4749899e65b818a31c9b` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:18.143612 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cdc20-cfdf-4f8d-92ca-273f7e21cf5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e4898ee8afc4749899e65b818a31c9b)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:18.145563 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cdc20-cfdf-4f8d-92ca-273f7e21cf5f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:18.201070 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-684cdc20-cfdf-4f8d-92ca-273f7e21cf5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4898ee8afc4749899e65b818a31c9b', 'request_id': 'req-684cdc20-cfdf-4f8d-92ca-273f7e21cf5f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:18.209219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-684cdc20-cfdf-4f8d-92ca-273f7e21cf5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4898ee8afc4749899e65b818a31c9b', 'request_id': 'req-684cdc20-cfdf-4f8d-92ca-273f7e21cf5f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:18.215572 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-684cdc20-cfdf-4f8d-92ca-273f7e21cf5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4898ee8afc4749899e65b818a31c9b', 'request_id': 'req-684cdc20-cfdf-4f8d-92ca-273f7e21cf5f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:18.229573 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-684cdc20-cfdf-4f8d-92ca-273f7e21cf5f admin admin] The token cache is being invalidate because project 4e4898ee8afc4749899e65b818a31c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:18.229860 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-684cdc20-cfdf-4f8d-92ca-273f7e21cf5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:18.230584 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-684cdc20-cfdf-4f8d-92ca-273f7e21cf5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:18.232194 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 927/1889] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:18 2022] DELETE /identity/v3/projects/4e4898ee8afc4749899e65b818a31c9b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:18.237093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbeb72-3d02-45fb-9a5b-b0210dd7d9c3 service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:18.248862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fbeb72-3d02-45fb-9a5b-b0210dd7d9c3 service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:18.329666 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdf3f9-254e-49c6-a80f-31481ca81c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:18.330231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdf3f9-254e-49c6-a80f-31481ca81c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:18.330512 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdf3f9-254e-49c6-a80f-31481ca81c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:18.331517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cdf3f9-254e-49c6-a80f-31481ca81c7c admin admin] PATH_INFO: `/v3/users/20d8ce45309246fb9d77d9f59d57b226` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:18.332545 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdf3f9-254e-49c6-a80f-31481ca81c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=20d8ce45309246fb9d77d9f59d57b226)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:18.338994 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cdf3f9-254e-49c6-a80f-31481ca81c7c admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:18.493511 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-95cdf3f9-254e-49c6-a80f-31481ca81c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20d8ce45309246fb9d77d9f59d57b226'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:18.494313 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-95cdf3f9-254e-49c6-a80f-31481ca81c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20d8ce45309246fb9d77d9f59d57b226'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:18.512816 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-95cdf3f9-254e-49c6-a80f-31481ca81c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20d8ce45309246fb9d77d9f59d57b226'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:18.521103 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-95cdf3f9-254e-49c6-a80f-31481ca81c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20d8ce45309246fb9d77d9f59d57b226'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:18.539848 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-95cdf3f9-254e-49c6-a80f-31481ca81c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20d8ce45309246fb9d77d9f59d57b226'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:18.548972 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 963/1890] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:18 2022] DELETE /identity/v3/users/20d8ce45309246fb9d77d9f59d57b226 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:19.025819 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cdc20-cfdf-4f8d-92ca-273f7e21cf5f admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:19.028417 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-684cdc20-cfdf-4f8d-92ca-273f7e21cf5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:19.133284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cdc20-cfdf-4f8d-92ca-273f7e21cf5f admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:19.189936 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad460760-6578-4f80-87ba-b4fa14314584 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:19.190764 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad460760-6578-4f80-87ba-b4fa14314584 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:19.191275 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad460760-6578-4f80-87ba-b4fa14314584 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:19.191625 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad460760-6578-4f80-87ba-b4fa14314584 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:19.193634 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ad460760-6578-4f80-87ba-b4fa14314584 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:19.259242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad460760-6578-4f80-87ba-b4fa14314584 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:19.260979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad460760-6578-4f80-87ba-b4fa14314584 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:19.271722 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 928/1891] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:19.337617 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdf3f9-254e-49c6-a80f-31481ca81c7c admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:19.340266 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-95cdf3f9-254e-49c6-a80f-31481ca81c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:19.429420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cdf3f9-254e-49c6-a80f-31481ca81c7c admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:19.433764 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128b7db-7572-4c3d-b18e-263046607109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:19.434844 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128b7db-7572-4c3d-b18e-263046607109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:19.434977 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128b7db-7572-4c3d-b18e-263046607109 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:19.435323 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128b7db-7572-4c3d-b18e-263046607109 admin admin] PATH_INFO: `/v3/projects/25e239c9a9fb40998a909e769fa88245` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:19.436727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128b7db-7572-4c3d-b18e-263046607109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25e239c9a9fb40998a909e769fa88245)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:19.439474 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128b7db-7572-4c3d-b18e-263046607109 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:19.493347 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5128b7db-7572-4c3d-b18e-263046607109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25e239c9a9fb40998a909e769fa88245', 'request_id': 'req-5128b7db-7572-4c3d-b18e-263046607109'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:19.499283 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5128b7db-7572-4c3d-b18e-263046607109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25e239c9a9fb40998a909e769fa88245', 'request_id': 'req-5128b7db-7572-4c3d-b18e-263046607109'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:19.506537 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5128b7db-7572-4c3d-b18e-263046607109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25e239c9a9fb40998a909e769fa88245', 'request_id': 'req-5128b7db-7572-4c3d-b18e-263046607109'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:19.520722 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5128b7db-7572-4c3d-b18e-263046607109 admin admin] The token cache is being invalidate because project 25e239c9a9fb40998a909e769fa88245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:19.521009 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5128b7db-7572-4c3d-b18e-263046607109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:19.521631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5128b7db-7572-4c3d-b18e-263046607109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:19.523252 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 964/1892] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:19 2022] DELETE /identity/v3/projects/25e239c9a9fb40998a909e769fa88245 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:19.528406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dffcc-cfb8-498c-9bcd-b0cc0f086707 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:19.529430 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dffcc-cfb8-498c-9bcd-b0cc0f086707 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:19.529786 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4dffcc-cfb8-498c-9bcd-b0cc0f086707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:19.550031 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3a4dffcc-cfb8-498c-9bcd-b0cc0f086707 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:19.551400 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3a4dffcc-cfb8-498c-9bcd-b0cc0f086707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:19.630822 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 929/1893] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:19.638765 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef257d-135b-46d5-970e-87afb5bce9fa None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:19.639052 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef257d-135b-46d5-970e-87afb5bce9fa None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:19.639329 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef257d-135b-46d5-970e-87afb5bce9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:19.659081 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-adef257d-135b-46d5-970e-87afb5bce9fa None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:19.660264 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-adef257d-135b-46d5-970e-87afb5bce9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:19.667973 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 965/1894] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:19.672245 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dffcc-cfb8-498c-9bcd-b0cc0f086707 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:19.683580 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4dffcc-cfb8-498c-9bcd-b0cc0f086707 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:19.688121 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f75ea-bace-40c4-96be-373ea085cf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:19.688775 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f75ea-bace-40c4-96be-373ea085cf90 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:19.689060 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f75ea-bace-40c4-96be-373ea085cf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:19.689332 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f75ea-bace-40c4-96be-373ea085cf90 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:19.690051 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f75ea-bace-40c4-96be-373ea085cf90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:51:19.690355 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f75ea-bace-40c4-96be-373ea085cf90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:19.692038 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f75ea-bace-40c4-96be-373ea085cf90 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:19.707659 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 930/1895] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:51:19.708983 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef257d-135b-46d5-970e-87afb5bce9fa None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:19.717941 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef257d-135b-46d5-970e-87afb5bce9fa None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:19.723370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424a633-7e07-4fd2-a965-64adba186749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:19.724147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424a633-7e07-4fd2-a965-64adba186749 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:19.724440 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424a633-7e07-4fd2-a965-64adba186749 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:19.724717 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424a633-7e07-4fd2-a965-64adba186749 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:19.726078 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424a633-7e07-4fd2-a965-64adba186749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:19.728070 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424a633-7e07-4fd2-a965-64adba186749 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:19.756104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 966/1896] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:19 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:19.757241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f75ea-bace-40c4-96be-373ea085cf90 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:19.767850 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f75ea-bace-40c4-96be-373ea085cf90 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:19.825510 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ee3cd-96b0-4b3f-92db-79b401d21856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:19.826209 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ee3cd-96b0-4b3f-92db-79b401d21856 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:19.826499 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ee3cd-96b0-4b3f-92db-79b401d21856 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:19.826806 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ee3cd-96b0-4b3f-92db-79b401d21856 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:19.827754 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ee3cd-96b0-4b3f-92db-79b401d21856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:19.830482 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ee3cd-96b0-4b3f-92db-79b401d21856 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:19.851164 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 931/1897] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:19 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:51:19.855846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424a633-7e07-4fd2-a965-64adba186749 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:19.867235 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424a633-7e07-4fd2-a965-64adba186749 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:19.872927 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151164e-6a75-489e-a9f1-0c4c41461607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:19.873685 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151164e-6a75-489e-a9f1-0c4c41461607 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:19.873969 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151164e-6a75-489e-a9f1-0c4c41461607 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:19.874241 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151164e-6a75-489e-a9f1-0c4c41461607 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:19.875081 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151164e-6a75-489e-a9f1-0c4c41461607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:19.876794 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151164e-6a75-489e-a9f1-0c4c41461607 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:19.893733 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 967/1898] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:19.897489 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ee3cd-96b0-4b3f-92db-79b401d21856 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:19.907674 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ee3cd-96b0-4b3f-92db-79b401d21856 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:19.912619 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5bcd01-0437-4403-bb53-e429ae81be6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:19.913278 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bcd01-0437-4403-bb53-e429ae81be6f admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:19.913564 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bcd01-0437-4403-bb53-e429ae81be6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:19.913841 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5bcd01-0437-4403-bb53-e429ae81be6f admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:19.914714 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bcd01-0437-4403-bb53-e429ae81be6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:19.916280 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5bcd01-0437-4403-bb53-e429ae81be6f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:19.926785 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 932/1899] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:19.930897 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151164e-6a75-489e-a9f1-0c4c41461607 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:19.941150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151164e-6a75-489e-a9f1-0c4c41461607 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:19.945733 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3799d92-8d9f-4eb9-8e9d-dd110e2b82da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:19.946632 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3799d92-8d9f-4eb9-8e9d-dd110e2b82da admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:19.946916 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3799d92-8d9f-4eb9-8e9d-dd110e2b82da admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:19.947218 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3799d92-8d9f-4eb9-8e9d-dd110e2b82da admin admin] PATH_INFO: `/v3/projects/cee486a5e0144b2bb646e6ef0f0b14ce/users/6f441a65acce4ae3894fb094c912e238/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:19.963063 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3799d92-8d9f-4eb9-8e9d-dd110e2b82da admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee486a5e0144b2bb646e6ef0f0b14ce, user_id=6f441a65acce4ae3894fb094c912e238, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:19.966180 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3799d92-8d9f-4eb9-8e9d-dd110e2b82da admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:19.979974 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 968/1900] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:19 2022] PUT /identity/v3/projects/cee486a5e0144b2bb646e6ef0f0b14ce/users/6f441a65acce4ae3894fb094c912e238/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:19.991271 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb340c-7924-497b-9be9-b905b2b447bb None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:19.991558 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb340c-7924-497b-9be9-b905b2b447bb None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:19.991834 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb340c-7924-497b-9be9-b905b2b447bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:20.018265 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-92bb340c-7924-497b-9be9-b905b2b447bb None None] MFA Rules not processed for user `6f441a65acce4ae3894fb094c912e238`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:20.019440 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-92bb340c-7924-497b-9be9-b905b2b447bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:20.084160 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 933/1901] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:20.088488 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3799d92-8d9f-4eb9-8e9d-dd110e2b82da admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:20.157173 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3799d92-8d9f-4eb9-8e9d-dd110e2b82da admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:20.162547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57237869-b193-4e35-bbe6-608caa03ab7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:20.163243 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57237869-b193-4e35-bbe6-608caa03ab7a admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:20.163523 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57237869-b193-4e35-bbe6-608caa03ab7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:20.163798 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57237869-b193-4e35-bbe6-608caa03ab7a admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:20.164483 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57237869-b193-4e35-bbe6-608caa03ab7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:20.166451 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57237869-b193-4e35-bbe6-608caa03ab7a admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:20.192769 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 969/1902] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:20 2022] POST /identity/v3/projects => generated 387 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:20.196732 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb340c-7924-497b-9be9-b905b2b447bb None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:20.207926 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb340c-7924-497b-9be9-b905b2b447bb None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:20.261789 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4b68c-74ad-42d3-a1fc-441cd2cdd1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:20.262454 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4b68c-74ad-42d3-a1fc-441cd2cdd1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:20.262769 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4b68c-74ad-42d3-a1fc-441cd2cdd1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:20.263049 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4b68c-74ad-42d3-a1fc-441cd2cdd1d3 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:20.263786 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4b68c-74ad-42d3-a1fc-441cd2cdd1d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:20.265636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4b68c-74ad-42d3-a1fc-441cd2cdd1d3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:20.287854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 934/1903] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:20 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:20.291733 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57237869-b193-4e35-bbe6-608caa03ab7a admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:20.301685 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57237869-b193-4e35-bbe6-608caa03ab7a admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:20.306288 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dcd7f3-151e-4820-a418-073ead5f6234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:20.306990 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcd7f3-151e-4820-a418-073ead5f6234 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:20.307273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcd7f3-151e-4820-a418-073ead5f6234 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:20.307543 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dcd7f3-151e-4820-a418-073ead5f6234 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:20.308256 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dcd7f3-151e-4820-a418-073ead5f6234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:20.309830 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dcd7f3-151e-4820-a418-073ead5f6234 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:20.320503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 970/1904] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:20.324438 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4b68c-74ad-42d3-a1fc-441cd2cdd1d3 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:20.334559 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4b68c-74ad-42d3-a1fc-441cd2cdd1d3 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:20.339184 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bfe77-985f-47be-af99-a0245b060d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:20.340041 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bfe77-985f-47be-af99-a0245b060d64 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:20.340367 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bfe77-985f-47be-af99-a0245b060d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:20.340618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bfe77-985f-47be-af99-a0245b060d64 admin admin] PATH_INFO: `/v3/projects/e0d4a264259b45c28d5c8fa5f4659c88/users/4a44f70831c2419b823a003c0970e927/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:20.354406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bfe77-985f-47be-af99-a0245b060d64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d4a264259b45c28d5c8fa5f4659c88, user_id=4a44f70831c2419b823a003c0970e927, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:20.357044 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bfe77-985f-47be-af99-a0245b060d64 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:20.370414 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 935/1905] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:20 2022] PUT /identity/v3/projects/e0d4a264259b45c28d5c8fa5f4659c88/users/4a44f70831c2419b823a003c0970e927/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:20.374458 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dcd7f3-151e-4820-a418-073ead5f6234 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:20.384976 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dcd7f3-151e-4820-a418-073ead5f6234 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:20.440284 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43b074-79de-4398-8ae3-46059e2c5649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:20.440945 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43b074-79de-4398-8ae3-46059e2c5649 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:20.441223 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43b074-79de-4398-8ae3-46059e2c5649 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:20.441494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43b074-79de-4398-8ae3-46059e2c5649 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:20.442209 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43b074-79de-4398-8ae3-46059e2c5649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:20.443828 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43b074-79de-4398-8ae3-46059e2c5649 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:20.453270 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 971/1906] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:20.457426 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bfe77-985f-47be-af99-a0245b060d64 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:20.467670 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bfe77-985f-47be-af99-a0245b060d64 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:20.472358 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5701e-b901-4fba-b910-73cbcb4a7c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:20.473235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5701e-b901-4fba-b910-73cbcb4a7c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:20.473520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5701e-b901-4fba-b910-73cbcb4a7c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:20.473797 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab5701e-b901-4fba-b910-73cbcb4a7c6e admin admin] PATH_INFO: `/v3/projects/e0d4a264259b45c28d5c8fa5f4659c88/users/4a44f70831c2419b823a003c0970e927/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:20.475800 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5701e-b901-4fba-b910-73cbcb4a7c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d4a264259b45c28d5c8fa5f4659c88, user_id=4a44f70831c2419b823a003c0970e927, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:20.478490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab5701e-b901-4fba-b910-73cbcb4a7c6e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:20.489998 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 936/1907] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:20 2022] PUT /identity/v3/projects/e0d4a264259b45c28d5c8fa5f4659c88/users/4a44f70831c2419b823a003c0970e927/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:20.500252 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ece9ac-7661-4843-b1f0-663dc0c6ccb9 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:20.500548 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ece9ac-7661-4843-b1f0-663dc0c6ccb9 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:20.500832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ece9ac-7661-4843-b1f0-663dc0c6ccb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:20.527615 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-d3ece9ac-7661-4843-b1f0-663dc0c6ccb9 None None] MFA Rules not processed for user `4a44f70831c2419b823a003c0970e927`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:20.528744 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d3ece9ac-7661-4843-b1f0-663dc0c6ccb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:20.594335 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 972/1908] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:20.604857 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5701e-b901-4fba-b910-73cbcb4a7c6e admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:20.606568 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-cab5701e-b901-4fba-b910-73cbcb4a7c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:20.662863 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab5701e-b901-4fba-b910-73cbcb4a7c6e admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:20.666510 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922dd884-8e13-41a7-ad05-9dd2d5fd9564 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:20.667179 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dd884-8e13-41a7-ad05-9dd2d5fd9564 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:20.667464 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dd884-8e13-41a7-ad05-9dd2d5fd9564 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:20.667737 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922dd884-8e13-41a7-ad05-9dd2d5fd9564 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:20.676915 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922dd884-8e13-41a7-ad05-9dd2d5fd9564 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:20.678328 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922dd884-8e13-41a7-ad05-9dd2d5fd9564 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:20.687457 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 937/1909] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:21.284684 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ece9ac-7661-4843-b1f0-663dc0c6ccb9 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:21.357898 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ece9ac-7661-4843-b1f0-663dc0c6ccb9 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:21.363342 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37140e7-5a9b-44e1-94fa-f867c7b66215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:21.364295 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37140e7-5a9b-44e1-94fa-f867c7b66215 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:21.364656 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37140e7-5a9b-44e1-94fa-f867c7b66215 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:21.365008 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37140e7-5a9b-44e1-94fa-f867c7b66215 admin admin] PATH_INFO: `/v3/users/6f441a65acce4ae3894fb094c912e238` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:21.366296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37140e7-5a9b-44e1-94fa-f867c7b66215 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f441a65acce4ae3894fb094c912e238)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:21.368350 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37140e7-5a9b-44e1-94fa-f867c7b66215 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:21.424183 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d37140e7-5a9b-44e1-94fa-f867c7b66215 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f441a65acce4ae3894fb094c912e238'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:21.425381 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d37140e7-5a9b-44e1-94fa-f867c7b66215 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f441a65acce4ae3894fb094c912e238'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:21.433164 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d37140e7-5a9b-44e1-94fa-f867c7b66215 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f441a65acce4ae3894fb094c912e238'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:21.445184 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d37140e7-5a9b-44e1-94fa-f867c7b66215 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f441a65acce4ae3894fb094c912e238'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:21.456480 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-d37140e7-5a9b-44e1-94fa-f867c7b66215 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f441a65acce4ae3894fb094c912e238'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:21.462315 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 973/1910] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:21 2022] DELETE /identity/v3/users/6f441a65acce4ae3894fb094c912e238 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:21.466872 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1733610-46ca-4980-b253-4c4954f15a30 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:21.467315 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1733610-46ca-4980-b253-4c4954f15a30 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:21.467453 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1733610-46ca-4980-b253-4c4954f15a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:21.485450 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c1733610-46ca-4980-b253-4c4954f15a30 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:21.486651 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c1733610-46ca-4980-b253-4c4954f15a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:21.542542 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 938/1911] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:21.552837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37140e7-5a9b-44e1-94fa-f867c7b66215 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:21.554255 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d37140e7-5a9b-44e1-94fa-f867c7b66215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:21.609268 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37140e7-5a9b-44e1-94fa-f867c7b66215 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:21.613625 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006d18c-6ad2-4766-82a2-99280180dad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:21.614272 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006d18c-6ad2-4766-82a2-99280180dad4 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:21.614556 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006d18c-6ad2-4766-82a2-99280180dad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:21.614863 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006d18c-6ad2-4766-82a2-99280180dad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:21.624012 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006d18c-6ad2-4766-82a2-99280180dad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:21.625494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006d18c-6ad2-4766-82a2-99280180dad4 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:21.635022 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 974/1912] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:22.074509 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1733610-46ca-4980-b253-4c4954f15a30 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:22.076326 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c1733610-46ca-4980-b253-4c4954f15a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:22.096700 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1733610-46ca-4980-b253-4c4954f15a30 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:22.102577 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedce16f-f66c-4194-8e03-3f43e76e1b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:22.104061 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedce16f-f66c-4194-8e03-3f43e76e1b50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:22.104411 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedce16f-f66c-4194-8e03-3f43e76e1b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:22.104751 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedce16f-f66c-4194-8e03-3f43e76e1b50 admin admin] PATH_INFO: `/v3/projects/cee486a5e0144b2bb646e6ef0f0b14ce` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:22.106325 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedce16f-f66c-4194-8e03-3f43e76e1b50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee486a5e0144b2bb646e6ef0f0b14ce)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:22.108443 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedce16f-f66c-4194-8e03-3f43e76e1b50 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:22.162994 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-aedce16f-f66c-4194-8e03-3f43e76e1b50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee486a5e0144b2bb646e6ef0f0b14ce', 'request_id': 'req-aedce16f-f66c-4194-8e03-3f43e76e1b50'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:22.169949 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-aedce16f-f66c-4194-8e03-3f43e76e1b50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee486a5e0144b2bb646e6ef0f0b14ce', 'request_id': 'req-aedce16f-f66c-4194-8e03-3f43e76e1b50'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:22.177951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-aedce16f-f66c-4194-8e03-3f43e76e1b50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee486a5e0144b2bb646e6ef0f0b14ce', 'request_id': 'req-aedce16f-f66c-4194-8e03-3f43e76e1b50'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:22.194940 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-aedce16f-f66c-4194-8e03-3f43e76e1b50 admin admin] The token cache is being invalidate because project cee486a5e0144b2bb646e6ef0f0b14ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:22.195233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-aedce16f-f66c-4194-8e03-3f43e76e1b50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:22.195888 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-aedce16f-f66c-4194-8e03-3f43e76e1b50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:22.197448 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 939/1913] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:22 2022] DELETE /identity/v3/projects/cee486a5e0144b2bb646e6ef0f0b14ce => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:22.201480 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006d18c-6ad2-4766-82a2-99280180dad4 service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:22.211517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006d18c-6ad2-4766-82a2-99280180dad4 service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:22.268210 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6efd3-feb5-4194-812b-a75fbe1e0b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:22.269085 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6efd3-feb5-4194-812b-a75fbe1e0b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:22.269469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6efd3-feb5-4194-812b-a75fbe1e0b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:22.269683 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6efd3-feb5-4194-812b-a75fbe1e0b88 admin admin] PATH_INFO: `/v3/users/4a44f70831c2419b823a003c0970e927` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:22.271054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6efd3-feb5-4194-812b-a75fbe1e0b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a44f70831c2419b823a003c0970e927)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:22.272993 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6efd3-feb5-4194-812b-a75fbe1e0b88 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:22.340427 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-fce6efd3-feb5-4194-812b-a75fbe1e0b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a44f70831c2419b823a003c0970e927'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:22.341097 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-fce6efd3-feb5-4194-812b-a75fbe1e0b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a44f70831c2419b823a003c0970e927'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:22.349531 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-fce6efd3-feb5-4194-812b-a75fbe1e0b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a44f70831c2419b823a003c0970e927'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:22.356442 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-fce6efd3-feb5-4194-812b-a75fbe1e0b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a44f70831c2419b823a003c0970e927'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:22.368193 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-fce6efd3-feb5-4194-812b-a75fbe1e0b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a44f70831c2419b823a003c0970e927'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:22.374743 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 975/1914] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:22 2022] DELETE /identity/v3/users/4a44f70831c2419b823a003c0970e927 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:22.672186 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedce16f-f66c-4194-8e03-3f43e76e1b50 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:22.674290 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-aedce16f-f66c-4194-8e03-3f43e76e1b50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:22.691416 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedce16f-f66c-4194-8e03-3f43e76e1b50 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:22.772017 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99048526-b107-4754-89f3-f5ad0ceb0f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:22.773253 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048526-b107-4754-89f3-f5ad0ceb0f9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:22.773758 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048526-b107-4754-89f3-f5ad0ceb0f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:22.774248 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99048526-b107-4754-89f3-f5ad0ceb0f9e admin admin] PATH_INFO: `/v3/projects/e0d4a264259b45c28d5c8fa5f4659c88` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:22.776467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99048526-b107-4754-89f3-f5ad0ceb0f9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0d4a264259b45c28d5c8fa5f4659c88)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:22.779429 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99048526-b107-4754-89f3-f5ad0ceb0f9e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:22.834387 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-99048526-b107-4754-89f3-f5ad0ceb0f9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0d4a264259b45c28d5c8fa5f4659c88', 'request_id': 'req-99048526-b107-4754-89f3-f5ad0ceb0f9e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:22.840689 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-99048526-b107-4754-89f3-f5ad0ceb0f9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0d4a264259b45c28d5c8fa5f4659c88', 'request_id': 'req-99048526-b107-4754-89f3-f5ad0ceb0f9e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:22.848562 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-99048526-b107-4754-89f3-f5ad0ceb0f9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0d4a264259b45c28d5c8fa5f4659c88', 'request_id': 'req-99048526-b107-4754-89f3-f5ad0ceb0f9e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:22.860572 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-99048526-b107-4754-89f3-f5ad0ceb0f9e admin admin] The token cache is being invalidate because project e0d4a264259b45c28d5c8fa5f4659c88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:22.860863 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-99048526-b107-4754-89f3-f5ad0ceb0f9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:22.861550 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-99048526-b107-4754-89f3-f5ad0ceb0f9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:22.863338 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 940/1915] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:22 2022] DELETE /identity/v3/projects/e0d4a264259b45c28d5c8fa5f4659c88 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:22.870142 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903534ff-01a8-45ca-964f-ea889b9f80d2 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:22.870603 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903534ff-01a8-45ca-964f-ea889b9f80d2 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:22.870738 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903534ff-01a8-45ca-964f-ea889b9f80d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:22.888528 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-903534ff-01a8-45ca-964f-ea889b9f80d2 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:22.889686 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-903534ff-01a8-45ca-964f-ea889b9f80d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:22.947846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 976/1916] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:22.955079 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7b2c6-0354-4019-aaaf-b3369e2deb0b None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:22.955372 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7b2c6-0354-4019-aaaf-b3369e2deb0b None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:22.955654 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7b2c6-0354-4019-aaaf-b3369e2deb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:22.976793 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-00f7b2c6-0354-4019-aaaf-b3369e2deb0b None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:22.977986 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-00f7b2c6-0354-4019-aaaf-b3369e2deb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:22.986185 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 941/1917] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:22.990442 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903534ff-01a8-45ca-964f-ea889b9f80d2 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:23.000608 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903534ff-01a8-45ca-964f-ea889b9f80d2 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:23.005126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a290b-47da-44c7-b34a-b636123fa79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:23.005780 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a290b-47da-44c7-b34a-b636123fa79a admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:23.006064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a290b-47da-44c7-b34a-b636123fa79a admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:23.006338 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669a290b-47da-44c7-b34a-b636123fa79a admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:23.007102 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a290b-47da-44c7-b34a-b636123fa79a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:51:23.007409 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a290b-47da-44c7-b34a-b636123fa79a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:23.008995 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669a290b-47da-44c7-b34a-b636123fa79a admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:23.020977 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 977/1918] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:51:23.025219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7b2c6-0354-4019-aaaf-b3369e2deb0b None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:23.034113 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7b2c6-0354-4019-aaaf-b3369e2deb0b None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:23.038783 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71239ef9-aab0-4323-8f8c-44a9152e1508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:23.039424 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71239ef9-aab0-4323-8f8c-44a9152e1508 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:23.039704 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71239ef9-aab0-4323-8f8c-44a9152e1508 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:23.039977 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71239ef9-aab0-4323-8f8c-44a9152e1508 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:23.040666 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71239ef9-aab0-4323-8f8c-44a9152e1508 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:23.042517 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71239ef9-aab0-4323-8f8c-44a9152e1508 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:23.066501 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 942/1919] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:23 2022] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:23.070473 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a290b-47da-44c7-b34a-b636123fa79a admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:23.080760 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669a290b-47da-44c7-b34a-b636123fa79a admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:23.134804 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8747e-1aab-4cd3-aba6-15e93ad9243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:23.135486 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8747e-1aab-4cd3-aba6-15e93ad9243b admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:23.135765 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8747e-1aab-4cd3-aba6-15e93ad9243b admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:23.136034 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8747e-1aab-4cd3-aba6-15e93ad9243b admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:23.136996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8747e-1aab-4cd3-aba6-15e93ad9243b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:23.138910 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8747e-1aab-4cd3-aba6-15e93ad9243b admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:23.157071 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 978/1920] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:23 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:23.161085 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71239ef9-aab0-4323-8f8c-44a9152e1508 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:23.171061 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71239ef9-aab0-4323-8f8c-44a9152e1508 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:23.175582 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac794f7-055a-46e5-9573-c3063be71af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:23.176226 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac794f7-055a-46e5-9573-c3063be71af0 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:23.176510 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac794f7-055a-46e5-9573-c3063be71af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:23.176784 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac794f7-055a-46e5-9573-c3063be71af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:23.177500 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac794f7-055a-46e5-9573-c3063be71af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:23.179111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac794f7-055a-46e5-9573-c3063be71af0 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:23.189457 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 943/1921] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:23.193050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8747e-1aab-4cd3-aba6-15e93ad9243b admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:23.202643 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8747e-1aab-4cd3-aba6-15e93ad9243b admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:23.207707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307e000-306d-4616-b81c-93d2bbf2e495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:23.208354 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307e000-306d-4616-b81c-93d2bbf2e495 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:23.208632 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307e000-306d-4616-b81c-93d2bbf2e495 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:23.208902 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307e000-306d-4616-b81c-93d2bbf2e495 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:23.209608 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307e000-306d-4616-b81c-93d2bbf2e495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:23.211206 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307e000-306d-4616-b81c-93d2bbf2e495 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:23.221343 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 979/1922] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:23.225377 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac794f7-055a-46e5-9573-c3063be71af0 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:23.234969 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac794f7-055a-46e5-9573-c3063be71af0 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:23.239480 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba86f8-3db3-47e7-9276-2319eca9a4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:23.240344 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba86f8-3db3-47e7-9276-2319eca9a4a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:23.240627 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba86f8-3db3-47e7-9276-2319eca9a4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:23.240900 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ba86f8-3db3-47e7-9276-2319eca9a4a3 admin admin] PATH_INFO: `/v3/projects/3005863d507649d3ba7854fb41792452/users/a0721ecc1e5c4953aabac3fdad59b261/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:23.255091 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba86f8-3db3-47e7-9276-2319eca9a4a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3005863d507649d3ba7854fb41792452, user_id=a0721ecc1e5c4953aabac3fdad59b261, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:23.257684 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ba86f8-3db3-47e7-9276-2319eca9a4a3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:23.270959 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 944/1923] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:23 2022] PUT /identity/v3/projects/3005863d507649d3ba7854fb41792452/users/a0721ecc1e5c4953aabac3fdad59b261/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:23.275847 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16a230-b5d5-480c-b074-3839f1ebd65d None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:23.276170 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16a230-b5d5-480c-b074-3839f1ebd65d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:23.276433 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc16a230-b5d5-480c-b074-3839f1ebd65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:23.293182 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-fc16a230-b5d5-480c-b074-3839f1ebd65d None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:23.294361 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-fc16a230-b5d5-480c-b074-3839f1ebd65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:23.349508 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 980/1924] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:23.359120 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba86f8-3db3-47e7-9276-2319eca9a4a3 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:23.361312 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f4ba86f8-3db3-47e7-9276-2319eca9a4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:23.417051 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ba86f8-3db3-47e7-9276-2319eca9a4a3 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:23.420712 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01d0af-0067-4e1c-9d63-16dd62a1a60d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:23.421350 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01d0af-0067-4e1c-9d63-16dd62a1a60d service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:23.421634 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01d0af-0067-4e1c-9d63-16dd62a1a60d service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:23.422423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01d0af-0067-4e1c-9d63-16dd62a1a60d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:23.431134 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01d0af-0067-4e1c-9d63-16dd62a1a60d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:23.432547 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01d0af-0067-4e1c-9d63-16dd62a1a60d service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:23.442170 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 945/1925] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:27.386583 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16a230-b5d5-480c-b074-3839f1ebd65d None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:27.388258 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-fc16a230-b5d5-480c-b074-3839f1ebd65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:27.409429 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc16a230-b5d5-480c-b074-3839f1ebd65d None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:27.420756 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47d3a7-098a-43c6-b5e7-18f29433097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:27.422175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47d3a7-098a-43c6-b5e7-18f29433097e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:27.422651 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47d3a7-098a-43c6-b5e7-18f29433097e admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:27.423069 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47d3a7-098a-43c6-b5e7-18f29433097e admin admin] PATH_INFO: `/v3/users/99d47aa456f4489caf79805890884f6b` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:27.425454 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47d3a7-098a-43c6-b5e7-18f29433097e admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d47aa456f4489caf79805890884f6b)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:27.427628 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe47d3a7-098a-43c6-b5e7-18f29433097e admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:27.529294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-fe47d3a7-098a-43c6-b5e7-18f29433097e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d47aa456f4489caf79805890884f6b'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:27.530205 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-fe47d3a7-098a-43c6-b5e7-18f29433097e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d47aa456f4489caf79805890884f6b'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:27.549415 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-fe47d3a7-098a-43c6-b5e7-18f29433097e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d47aa456f4489caf79805890884f6b'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:27.563297 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-fe47d3a7-098a-43c6-b5e7-18f29433097e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d47aa456f4489caf79805890884f6b'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:27.595676 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-fe47d3a7-098a-43c6-b5e7-18f29433097e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d47aa456f4489caf79805890884f6b'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:27.610887 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 981/1926] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:27 2022] DELETE /identity/v3/users/99d47aa456f4489caf79805890884f6b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:27.617632 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ca15b-c5d1-4d0a-9b32-e107b2b4b60c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:27.618208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ca15b-c5d1-4d0a-9b32-e107b2b4b60c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:27.618208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ca15b-c5d1-4d0a-9b32-e107b2b4b60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:27.655661 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c14ca15b-c5d1-4d0a-9b32-e107b2b4b60c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:27.666084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c14ca15b-c5d1-4d0a-9b32-e107b2b4b60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:27.889933 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 946/1927] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:27.900681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47d3a7-098a-43c6-b5e7-18f29433097e admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:27.911828 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-fe47d3a7-098a-43c6-b5e7-18f29433097e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:27.997443 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51c9f7-497f-45f7-93bb-7f4b2dafc033 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:27.998293 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51c9f7-497f-45f7-93bb-7f4b2dafc033 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:27.998696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb51c9f7-497f-45f7-93bb-7f4b2dafc033 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:28.002867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 947/1928] 10.222.0.73 () {54 vars in 921 bytes} [Mon Apr 11 16:51:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:51:28.035031 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47d3a7-098a-43c6-b5e7-18f29433097e admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:28.039645 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2904b76-9c9a-45b5-bd86-92d177b9bb9f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:28.039986 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2904b76-9c9a-45b5-bd86-92d177b9bb9f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:28.040436 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2904b76-9c9a-45b5-bd86-92d177b9bb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:28.053550 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3e24e-30f1-47c2-86f1-dc663e2e29ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:28.056977 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3e24e-30f1-47c2-86f1-dc663e2e29ba service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:28.057291 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3e24e-30f1-47c2-86f1-dc663e2e29ba service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:28.057528 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc3e24e-30f1-47c2-86f1-dc663e2e29ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:28.078644 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f2904b76-9c9a-45b5-bd86-92d177b9bb9f None None] MFA Rules not processed for user `ba3665d046864985916fdd6c4a4edcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:28.081511 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3e24e-30f1-47c2-86f1-dc663e2e29ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:28.082269 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f2904b76-9c9a-45b5-bd86-92d177b9bb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:28.084569 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc3e24e-30f1-47c2-86f1-dc663e2e29ba service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:28.110684 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 982/1929] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:28.200298 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 948/1930] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Apr 11 16:51:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:28.251724 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3e24e-30f1-47c2-86f1-dc663e2e29ba service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:28.253472 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-0cc3e24e-30f1-47c2-86f1-dc663e2e29ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:28.277646 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc3e24e-30f1-47c2-86f1-dc663e2e29ba service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:28.298749 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae60e5-4240-4ad8-a4de-581ff6c6db6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:28.299523 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae60e5-4240-4ad8-a4de-581ff6c6db6b service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:28.299867 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae60e5-4240-4ad8-a4de-581ff6c6db6b service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:28.300215 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae60e5-4240-4ad8-a4de-581ff6c6db6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:28.315841 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae60e5-4240-4ad8-a4de-581ff6c6db6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:28.318494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fae60e5-4240-4ad8-a4de-581ff6c6db6b service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:28.330373 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 983/1931] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:28.714540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2904b76-9c9a-45b5-bd86-92d177b9bb9f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:28.716181 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f2904b76-9c9a-45b5-bd86-92d177b9bb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:28.740241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2904b76-9c9a-45b5-bd86-92d177b9bb9f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:28.747020 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c690e3-b981-4109-943b-fa312cfca961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:28.748380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c690e3-b981-4109-943b-fa312cfca961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:28.748997 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c690e3-b981-4109-943b-fa312cfca961 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:28.753707 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c690e3-b981-4109-943b-fa312cfca961 admin admin] PATH_INFO: `/v3/users/09caf2b0382744e7a5cbbcbf983cea2b` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:28.758797 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c690e3-b981-4109-943b-fa312cfca961 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09caf2b0382744e7a5cbbcbf983cea2b)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:28.761528 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c690e3-b981-4109-943b-fa312cfca961 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:28.818427 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae60e5-4240-4ad8-a4de-581ff6c6db6b service nova] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:28.820518 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9fae60e5-4240-4ad8-a4de-581ff6c6db6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:28.849426 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae60e5-4240-4ad8-a4de-581ff6c6db6b service nova] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:28.859069 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93227ee4-20f4-457d-9e5d-e2422d080e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:28.860130 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93227ee4-20f4-457d-9e5d-e2422d080e43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:28.860547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93227ee4-20f4-457d-9e5d-e2422d080e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:28.860962 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93227ee4-20f4-457d-9e5d-e2422d080e43 admin admin] PATH_INFO: `/v3/projects/0656539df03841f182fa6cb574ae2865` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:28.863281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93227ee4-20f4-457d-9e5d-e2422d080e43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0656539df03841f182fa6cb574ae2865)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:28.867537 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93227ee4-20f4-457d-9e5d-e2422d080e43 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:28.896268 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d8c690e3-b981-4109-943b-fa312cfca961 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09caf2b0382744e7a5cbbcbf983cea2b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:28.913505 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d8c690e3-b981-4109-943b-fa312cfca961 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09caf2b0382744e7a5cbbcbf983cea2b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:28.914918 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d8c690e3-b981-4109-943b-fa312cfca961 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09caf2b0382744e7a5cbbcbf983cea2b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:28.926649 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d8c690e3-b981-4109-943b-fa312cfca961 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09caf2b0382744e7a5cbbcbf983cea2b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:28.953687 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d8c690e3-b981-4109-943b-fa312cfca961 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09caf2b0382744e7a5cbbcbf983cea2b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:28.962201 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 949/1932] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:28 2022] DELETE /identity/v3/users/09caf2b0382744e7a5cbbcbf983cea2b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:28.971364 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06eb93f-fd3a-4d40-8cbf-8bf7935a47f9 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:28.971832 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06eb93f-fd3a-4d40-8cbf-8bf7935a47f9 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:28.972402 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06eb93f-fd3a-4d40-8cbf-8bf7935a47f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:29.004633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f06eb93f-fd3a-4d40-8cbf-8bf7935a47f9 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:29.006179 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f06eb93f-fd3a-4d40-8cbf-8bf7935a47f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:29.016348 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-93227ee4-20f4-457d-9e5d-e2422d080e43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0656539df03841f182fa6cb574ae2865', 'request_id': 'req-93227ee4-20f4-457d-9e5d-e2422d080e43'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:29.042380 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-93227ee4-20f4-457d-9e5d-e2422d080e43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0656539df03841f182fa6cb574ae2865', 'request_id': 'req-93227ee4-20f4-457d-9e5d-e2422d080e43'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:29.051680 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-93227ee4-20f4-457d-9e5d-e2422d080e43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0656539df03841f182fa6cb574ae2865', 'request_id': 'req-93227ee4-20f4-457d-9e5d-e2422d080e43'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:29.072424 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-93227ee4-20f4-457d-9e5d-e2422d080e43 admin admin] The token cache is being invalidate because project 0656539df03841f182fa6cb574ae2865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:29.074779 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-93227ee4-20f4-457d-9e5d-e2422d080e43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:29.075970 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-93227ee4-20f4-457d-9e5d-e2422d080e43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:29.081868 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 984/1933] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:28 2022] DELETE /identity/v3/projects/0656539df03841f182fa6cb574ae2865 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:29.083421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93227ee4-20f4-457d-9e5d-e2422d080e43 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:29.086079 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-93227ee4-20f4-457d-9e5d-e2422d080e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:29.150348 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 950/1934] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:29.160817 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06eb93f-fd3a-4d40-8cbf-8bf7935a47f9 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:29.164124 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f06eb93f-fd3a-4d40-8cbf-8bf7935a47f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:29.207627 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93227ee4-20f4-457d-9e5d-e2422d080e43 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:29.228573 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaf7bd-b4e3-4667-8618-a05bbcb281db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:29.240850 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaf7bd-b4e3-4667-8618-a05bbcb281db admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:29.241624 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaf7bd-b4e3-4667-8618-a05bbcb281db admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:29.242007 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaf7bd-b4e3-4667-8618-a05bbcb281db admin admin] PATH_INFO: `/v3/users/2334bddf1448439e96f9483ae63f82e0` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:29.251703 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaaf7bd-b4e3-4667-8618-a05bbcb281db admin admin] RBAC: Authorizing `identity:delete_user(user_id=2334bddf1448439e96f9483ae63f82e0)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:29.253944 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaaf7bd-b4e3-4667-8618-a05bbcb281db admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:29.333220 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06eb93f-fd3a-4d40-8cbf-8bf7935a47f9 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:29.340492 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29916ab9-726c-411a-acf6-5e4ea45e5e39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:29.342363 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29916ab9-726c-411a-acf6-5e4ea45e5e39 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:29.343073 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29916ab9-726c-411a-acf6-5e4ea45e5e39 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:29.344593 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29916ab9-726c-411a-acf6-5e4ea45e5e39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:29.358335 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29916ab9-726c-411a-acf6-5e4ea45e5e39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:29.360687 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29916ab9-726c-411a-acf6-5e4ea45e5e39 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:29.375305 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 951/1935] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:29.381751 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-edaaf7bd-b4e3-4667-8618-a05bbcb281db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2334bddf1448439e96f9483ae63f82e0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:29.383146 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-edaaf7bd-b4e3-4667-8618-a05bbcb281db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2334bddf1448439e96f9483ae63f82e0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:29.411410 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-edaaf7bd-b4e3-4667-8618-a05bbcb281db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2334bddf1448439e96f9483ae63f82e0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:29.426825 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-edaaf7bd-b4e3-4667-8618-a05bbcb281db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2334bddf1448439e96f9483ae63f82e0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:29.465594 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-edaaf7bd-b4e3-4667-8618-a05bbcb281db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2334bddf1448439e96f9483ae63f82e0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:29.484298 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 985/1936] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:29 2022] DELETE /identity/v3/users/2334bddf1448439e96f9483ae63f82e0 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:29.561624 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29916ab9-726c-411a-acf6-5e4ea45e5e39 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:29.563485 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-29916ab9-726c-411a-acf6-5e4ea45e5e39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:29.700233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29916ab9-726c-411a-acf6-5e4ea45e5e39 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:29.839031 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1f728-e034-4f3e-a95e-8937de4bf822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:29.841388 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1f728-e034-4f3e-a95e-8937de4bf822 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:29.842150 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1f728-e034-4f3e-a95e-8937de4bf822 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:29.842686 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a1f728-e034-4f3e-a95e-8937de4bf822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:29.845351 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-70a1f728-e034-4f3e-a95e-8937de4bf822 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:29.967374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1f728-e034-4f3e-a95e-8937de4bf822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:29.973204 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a1f728-e034-4f3e-a95e-8937de4bf822 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:29.994679 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 952/1937] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:30.082919 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaf7bd-b4e3-4667-8618-a05bbcb281db admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:30.084872 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-edaaf7bd-b4e3-4667-8618-a05bbcb281db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:30.251187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaaf7bd-b4e3-4667-8618-a05bbcb281db admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:30.268315 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c411da-22c0-41e5-a53c-74bf4b7e2a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:30.269946 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c411da-22c0-41e5-a53c-74bf4b7e2a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:30.270345 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c411da-22c0-41e5-a53c-74bf4b7e2a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:30.270790 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c411da-22c0-41e5-a53c-74bf4b7e2a30 admin admin] PATH_INFO: `/v3/projects/194a8971da404a29939de6f2086ae73c` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:30.291512 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c411da-22c0-41e5-a53c-74bf4b7e2a30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=194a8971da404a29939de6f2086ae73c)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:30.299668 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c411da-22c0-41e5-a53c-74bf4b7e2a30 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:30.344680 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1f728-e034-4f3e-a95e-8937de4bf822 service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:30.346382 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-70a1f728-e034-4f3e-a95e-8937de4bf822 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:30.368230 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a1f728-e034-4f3e-a95e-8937de4bf822 service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:30.383311 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec2abd-5c6f-496b-b98c-8b236fe56c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:30.384099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec2abd-5c6f-496b-b98c-8b236fe56c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:30.384453 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec2abd-5c6f-496b-b98c-8b236fe56c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:30.384648 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec2abd-5c6f-496b-b98c-8b236fe56c1c admin admin] PATH_INFO: `/v3/projects/534ef3581f814eb58d65bced712f1652` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:30.385942 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec2abd-5c6f-496b-b98c-8b236fe56c1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=534ef3581f814eb58d65bced712f1652)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:30.388138 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec2abd-5c6f-496b-b98c-8b236fe56c1c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:30.427851 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-36c411da-22c0-41e5-a53c-74bf4b7e2a30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194a8971da404a29939de6f2086ae73c', 'request_id': 'req-36c411da-22c0-41e5-a53c-74bf4b7e2a30'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:30.438298 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-36c411da-22c0-41e5-a53c-74bf4b7e2a30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194a8971da404a29939de6f2086ae73c', 'request_id': 'req-36c411da-22c0-41e5-a53c-74bf4b7e2a30'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:30.460743 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-36c411da-22c0-41e5-a53c-74bf4b7e2a30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194a8971da404a29939de6f2086ae73c', 'request_id': 'req-36c411da-22c0-41e5-a53c-74bf4b7e2a30'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:30.485573 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-36c411da-22c0-41e5-a53c-74bf4b7e2a30 admin admin] The token cache is being invalidate because project 194a8971da404a29939de6f2086ae73c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:30.486000 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-36c411da-22c0-41e5-a53c-74bf4b7e2a30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:30.487714 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-36c411da-22c0-41e5-a53c-74bf4b7e2a30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:30.490034 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 986/1938] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:30 2022] DELETE /identity/v3/projects/194a8971da404a29939de6f2086ae73c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:30.495942 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c0a36-f1c4-4107-a6ad-32e62cdc1d24 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:30.496308 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c0a36-f1c4-4107-a6ad-32e62cdc1d24 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:30.496707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c0a36-f1c4-4107-a6ad-32e62cdc1d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:30.527398 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-d03c0a36-f1c4-4107-a6ad-32e62cdc1d24 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:30.528761 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d03c0a36-f1c4-4107-a6ad-32e62cdc1d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:30.544963 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b9ec2abd-5c6f-496b-b98c-8b236fe56c1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '534ef3581f814eb58d65bced712f1652', 'request_id': 'req-b9ec2abd-5c6f-496b-b98c-8b236fe56c1c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:30.558306 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b9ec2abd-5c6f-496b-b98c-8b236fe56c1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '534ef3581f814eb58d65bced712f1652', 'request_id': 'req-b9ec2abd-5c6f-496b-b98c-8b236fe56c1c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:30.571594 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b9ec2abd-5c6f-496b-b98c-8b236fe56c1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '534ef3581f814eb58d65bced712f1652', 'request_id': 'req-b9ec2abd-5c6f-496b-b98c-8b236fe56c1c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:30.623007 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 987/1939] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:30.624271 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b9ec2abd-5c6f-496b-b98c-8b236fe56c1c admin admin] The token cache is being invalidate because project 534ef3581f814eb58d65bced712f1652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:30.625114 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b9ec2abd-5c6f-496b-b98c-8b236fe56c1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:30.629569 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b9ec2abd-5c6f-496b-b98c-8b236fe56c1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:30.632412 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551b317-b95d-4b70-86bd-20e6fdd97d32 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:30.634678 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551b317-b95d-4b70-86bd-20e6fdd97d32 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:30.635452 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 953/1940] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:30 2022] DELETE /identity/v3/projects/534ef3581f814eb58d65bced712f1652 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:30.641049 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551b317-b95d-4b70-86bd-20e6fdd97d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:30.641277 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec2abd-5c6f-496b-b98c-8b236fe56c1c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:30.644430 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b9ec2abd-5c6f-496b-b98c-8b236fe56c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:30.684696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec2abd-5c6f-496b-b98c-8b236fe56c1c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:30.699036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f0e81-42e0-4d7e-a660-204676102609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:30.700064 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f0e81-42e0-4d7e-a660-204676102609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:30.700354 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f0e81-42e0-4d7e-a660-204676102609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:30.700638 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f0e81-42e0-4d7e-a660-204676102609 admin admin] PATH_INFO: `/v3/users/4471e3c399b64b599804420ee84f158b` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:30.704241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f0e81-42e0-4d7e-a660-204676102609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4471e3c399b64b599804420ee84f158b)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:30.705419 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-a551b317-b95d-4b70-86bd-20e6fdd97d32 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:30.709123 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a551b317-b95d-4b70-86bd-20e6fdd97d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:30.709261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f0e81-42e0-4d7e-a660-204676102609 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:30.737595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 988/1941] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:30.738921 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551b317-b95d-4b70-86bd-20e6fdd97d32 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:30.779198 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551b317-b95d-4b70-86bd-20e6fdd97d32 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:30.801834 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13bb61-2164-4628-a719-8bc686b8432b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:30.802888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13bb61-2164-4628-a719-8bc686b8432b admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:30.803479 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13bb61-2164-4628-a719-8bc686b8432b admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:30.803961 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13bb61-2164-4628-a719-8bc686b8432b admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:30.804886 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13bb61-2164-4628-a719-8bc686b8432b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:51:30.805526 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13bb61-2164-4628-a719-8bc686b8432b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:30.807421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13bb61-2164-4628-a719-8bc686b8432b admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:30.826483 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ce0f0e81-42e0-4d7e-a660-204676102609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4471e3c399b64b599804420ee84f158b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:30.844268 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 989/1942] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:51:30.845523 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13bb61-2164-4628-a719-8bc686b8432b admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:30.850058 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ce0f0e81-42e0-4d7e-a660-204676102609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4471e3c399b64b599804420ee84f158b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:30.851958 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ce0f0e81-42e0-4d7e-a660-204676102609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4471e3c399b64b599804420ee84f158b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:30.873374 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13bb61-2164-4628-a719-8bc686b8432b admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:30.875682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ce0f0e81-42e0-4d7e-a660-204676102609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4471e3c399b64b599804420ee84f158b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:30.883644 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af490790-49dc-4e6e-b4dc-bb65071611ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:30.884666 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af490790-49dc-4e6e-b4dc-bb65071611ef admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:30.885222 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af490790-49dc-4e6e-b4dc-bb65071611ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:30.893090 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af490790-49dc-4e6e-b4dc-bb65071611ef admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:30.894287 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af490790-49dc-4e6e-b4dc-bb65071611ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:30.897121 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af490790-49dc-4e6e-b4dc-bb65071611ef admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:30.899784 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ce0f0e81-42e0-4d7e-a660-204676102609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4471e3c399b64b599804420ee84f158b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:30.911282 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 954/1943] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:30 2022] DELETE /identity/v3/users/4471e3c399b64b599804420ee84f158b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:30.988395 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 990/1944] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:30 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:30.991155 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f0e81-42e0-4d7e-a660-204676102609 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:30.993520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ce0f0e81-42e0-4d7e-a660-204676102609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:31.085650 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903e254-4235-482d-a582-a5c8de0a77fd None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:31.086572 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903e254-4235-482d-a582-a5c8de0a77fd None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:31.087024 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9903e254-4235-482d-a582-a5c8de0a77fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:31.150237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f0e81-42e0-4d7e-a660-204676102609 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:31.161852 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-9903e254-4235-482d-a582-a5c8de0a77fd None None] MFA Rules not processed for user `a0721ecc1e5c4953aabac3fdad59b261`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:31.163103 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9903e254-4235-482d-a582-a5c8de0a77fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:31.279760 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b115b7-7866-482e-b731-0992903f5dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:31.280964 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b115b7-7866-482e-b731-0992903f5dfd admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:31.281620 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b115b7-7866-482e-b731-0992903f5dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:31.282002 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b115b7-7866-482e-b731-0992903f5dfd admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:31.284683 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b115b7-7866-482e-b731-0992903f5dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:31.287417 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b115b7-7866-482e-b731-0992903f5dfd admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:31.323442 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 991/1945] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:31.324511 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903e254-4235-482d-a582-a5c8de0a77fd None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:31.328708 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9903e254-4235-482d-a582-a5c8de0a77fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:31.330849 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 955/1946] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:30 2022] POST /identity/v3/users => generated 289 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:31.333714 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b115b7-7866-482e-b731-0992903f5dfd admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:31.369027 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b115b7-7866-482e-b731-0992903f5dfd admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:31.372399 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9903e254-4235-482d-a582-a5c8de0a77fd None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:31.374225 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fce82-f05e-4be5-aa4c-0a74c27052e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:31.375685 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fce82-f05e-4be5-aa4c-0a74c27052e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:31.375838 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fce82-f05e-4be5-aa4c-0a74c27052e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:31.376314 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fce82-f05e-4be5-aa4c-0a74c27052e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:31.377272 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65fce82-f05e-4be5-aa4c-0a74c27052e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:31.381736 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65fce82-f05e-4be5-aa4c-0a74c27052e3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:31.393453 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b82f0d-a93e-4aed-91cf-254f9e629efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:31.394150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b82f0d-a93e-4aed-91cf-254f9e629efd admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:31.395986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b82f0d-a93e-4aed-91cf-254f9e629efd admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:31.396276 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b82f0d-a93e-4aed-91cf-254f9e629efd admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:31.399057 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b82f0d-a93e-4aed-91cf-254f9e629efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:31.404823 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b82f0d-a93e-4aed-91cf-254f9e629efd admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:31.411024 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 956/1947] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:31.414578 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fce82-f05e-4be5-aa4c-0a74c27052e3 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:31.435720 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fce82-f05e-4be5-aa4c-0a74c27052e3 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:31.463637 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c8b30-59c9-4e83-a8c0-12ab6c324181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:31.464581 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c8b30-59c9-4e83-a8c0-12ab6c324181 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:31.464869 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c8b30-59c9-4e83-a8c0-12ab6c324181 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:31.465151 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5c8b30-59c9-4e83-a8c0-12ab6c324181 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:31.470121 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c8b30-59c9-4e83-a8c0-12ab6c324181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:31.470701 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 992/1948] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:31 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:31.471822 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5c8b30-59c9-4e83-a8c0-12ab6c324181 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:31.474532 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b82f0d-a93e-4aed-91cf-254f9e629efd admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:31.516088 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 957/1949] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:31.520111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c8b30-59c9-4e83-a8c0-12ab6c324181 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:31.550909 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5c8b30-59c9-4e83-a8c0-12ab6c324181 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:31.704885 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b82f0d-a93e-4aed-91cf-254f9e629efd admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:31.717549 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40cfe0-a762-458a-8faa-3257c10bad0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:31.720441 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40cfe0-a762-458a-8faa-3257c10bad0d admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:31.720884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40cfe0-a762-458a-8faa-3257c10bad0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:31.722268 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40cfe0-a762-458a-8faa-3257c10bad0d admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:31.724659 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40cfe0-a762-458a-8faa-3257c10bad0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:31.728659 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f40cfe0-a762-458a-8faa-3257c10bad0d admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:31.747652 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135ccb9-2777-4be3-828d-77703b4dae27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:31.750520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135ccb9-2777-4be3-828d-77703b4dae27 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:31.750839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135ccb9-2777-4be3-828d-77703b4dae27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:31.752842 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4135ccb9-2777-4be3-828d-77703b4dae27 admin admin] PATH_INFO: `/v3/projects/06b618a614784f7983497f22fbe073ad/users/067b5b8675b74949b24ec07a30b9303e/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:31.763091 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 993/1950] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:31 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:31.768022 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40cfe0-a762-458a-8faa-3257c10bad0d admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:31.780989 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f40cfe0-a762-458a-8faa-3257c10bad0d admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:31.786164 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135ccb9-2777-4be3-828d-77703b4dae27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b618a614784f7983497f22fbe073ad, user_id=067b5b8675b74949b24ec07a30b9303e, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:31.788659 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77743c-1594-4321-a23f-9a5c8ceb9ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:31.789358 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4135ccb9-2777-4be3-828d-77703b4dae27 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:31.789646 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77743c-1594-4321-a23f-9a5c8ceb9ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:31.790037 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77743c-1594-4321-a23f-9a5c8ceb9ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:31.790498 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77743c-1594-4321-a23f-9a5c8ceb9ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:31.791612 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77743c-1594-4321-a23f-9a5c8ceb9ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:31.793669 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb77743c-1594-4321-a23f-9a5c8ceb9ff4 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:31.809755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 994/1951] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:31.813476 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 958/1952] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:31 2022] PUT /identity/v3/projects/06b618a614784f7983497f22fbe073ad/users/067b5b8675b74949b24ec07a30b9303e/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:31.816052 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135ccb9-2777-4be3-828d-77703b4dae27 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:31.816182 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77743c-1594-4321-a23f-9a5c8ceb9ff4 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:31.825463 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-eb77743c-1594-4321-a23f-9a5c8ceb9ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:31.840839 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77743c-1594-4321-a23f-9a5c8ceb9ff4 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:31.938870 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc91588-663a-4608-9010-74ad269519cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:31.940012 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc91588-663a-4608-9010-74ad269519cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:31.940304 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc91588-663a-4608-9010-74ad269519cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:31.940627 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc91588-663a-4608-9010-74ad269519cd admin admin] PATH_INFO: `/v3/projects/20f5af9668a649e09707c6bed02dac65` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:31.941881 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc91588-663a-4608-9010-74ad269519cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=20f5af9668a649e09707c6bed02dac65)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:31.943699 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4135ccb9-2777-4be3-828d-77703b4dae27 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:31.944140 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc91588-663a-4608-9010-74ad269519cd admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:31.949356 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d409a7-b662-4e97-be45-cc904a290c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:31.950306 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d409a7-b662-4e97-be45-cc904a290c45 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:31.950807 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d409a7-b662-4e97-be45-cc904a290c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:31.951373 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d409a7-b662-4e97-be45-cc904a290c45 admin admin] PATH_INFO: `/v3/projects/d0e02a55f7204ca098b4d52ac9c245c1/users/f8cdb68f5a8544b1a333c2413ca10bba/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:31.976211 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d409a7-b662-4e97-be45-cc904a290c45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0e02a55f7204ca098b4d52ac9c245c1, user_id=f8cdb68f5a8544b1a333c2413ca10bba, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:31.980415 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d409a7-b662-4e97-be45-cc904a290c45 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:32.006711 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 959/1953] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:31 2022] PUT /identity/v3/projects/d0e02a55f7204ca098b4d52ac9c245c1/users/f8cdb68f5a8544b1a333c2413ca10bba/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:32.008297 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c501580-224e-458a-9f3c-d16f76565c8d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:32.008763 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c501580-224e-458a-9f3c-d16f76565c8d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:32.009208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c501580-224e-458a-9f3c-d16f76565c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:32.048342 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-0c501580-224e-458a-9f3c-d16f76565c8d None None] MFA Rules not processed for user `067b5b8675b74949b24ec07a30b9303e`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:32.049011 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-1cc91588-663a-4608-9010-74ad269519cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20f5af9668a649e09707c6bed02dac65', 'request_id': 'req-1cc91588-663a-4608-9010-74ad269519cd'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:32.049964 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0c501580-224e-458a-9f3c-d16f76565c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:32.062773 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-1cc91588-663a-4608-9010-74ad269519cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20f5af9668a649e09707c6bed02dac65', 'request_id': 'req-1cc91588-663a-4608-9010-74ad269519cd'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:32.071338 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-1cc91588-663a-4608-9010-74ad269519cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20f5af9668a649e09707c6bed02dac65', 'request_id': 'req-1cc91588-663a-4608-9010-74ad269519cd'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:32.091371 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-1cc91588-663a-4608-9010-74ad269519cd admin admin] The token cache is being invalidate because project 20f5af9668a649e09707c6bed02dac65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:32.092014 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-1cc91588-663a-4608-9010-74ad269519cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:32.093933 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-1cc91588-663a-4608-9010-74ad269519cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:32.096593 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 995/1954] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:31 2022] DELETE /identity/v3/projects/20f5af9668a649e09707c6bed02dac65 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:32.099618 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc91588-663a-4608-9010-74ad269519cd admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:32.101449 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-1cc91588-663a-4608-9010-74ad269519cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:32.146640 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 960/1955] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:32.146640 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656533c-6d90-4d57-8a0e-fc51c9491a50 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:32.146640 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656533c-6d90-4d57-8a0e-fc51c9491a50 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:32.146640 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656533c-6d90-4d57-8a0e-fc51c9491a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:32.164657 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f656533c-6d90-4d57-8a0e-fc51c9491a50 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:32.167134 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f656533c-6d90-4d57-8a0e-fc51c9491a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:32.180335 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc91588-663a-4608-9010-74ad269519cd admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:32.184989 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a632a3-df8c-48c3-aa46-c0b2b66cf12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:32.186032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a632a3-df8c-48c3-aa46-c0b2b66cf12d admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:32.186032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a632a3-df8c-48c3-aa46-c0b2b66cf12d admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:32.186253 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a632a3-df8c-48c3-aa46-c0b2b66cf12d admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:32.187481 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a632a3-df8c-48c3-aa46-c0b2b66cf12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:32.189107 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a632a3-df8c-48c3-aa46-c0b2b66cf12d admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:32.205126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 996/1956] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:32.205126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a632a3-df8c-48c3-aa46-c0b2b66cf12d admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:32.206821 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f0a632a3-df8c-48c3-aa46-c0b2b66cf12d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:32.220860 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a632a3-df8c-48c3-aa46-c0b2b66cf12d admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:32.225643 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618ec6e-9c1e-426d-9319-5926afcc7d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:32.226379 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618ec6e-9c1e-426d-9319-5926afcc7d76 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:32.226777 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618ec6e-9c1e-426d-9319-5926afcc7d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:32.227128 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618ec6e-9c1e-426d-9319-5926afcc7d76 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:32.227880 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618ec6e-9c1e-426d-9319-5926afcc7d76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:32.229711 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 961/1957] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:32.229997 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618ec6e-9c1e-426d-9319-5926afcc7d76 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:32.230484 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656533c-6d90-4d57-8a0e-fc51c9491a50 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:32.239908 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656533c-6d90-4d57-8a0e-fc51c9491a50 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:32.244648 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0fe72-6667-4ee1-9180-1090a6af4404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:32.245533 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0fe72-6667-4ee1-9180-1090a6af4404 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:32.245816 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0fe72-6667-4ee1-9180-1090a6af4404 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:32.246090 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d0fe72-6667-4ee1-9180-1090a6af4404 admin admin] PATH_INFO: `/v3/projects/d0e02a55f7204ca098b4d52ac9c245c1/users/f8cdb68f5a8544b1a333c2413ca10bba/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:32.248115 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0fe72-6667-4ee1-9180-1090a6af4404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0e02a55f7204ca098b4d52ac9c245c1, user_id=f8cdb68f5a8544b1a333c2413ca10bba, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:32.251604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d0fe72-6667-4ee1-9180-1090a6af4404 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:32.262637 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 997/1958] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:32 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:32.262637 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2589757-35c2-453d-a100-1262905ceb08 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:32.262878 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 962/1959] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:32 2022] PUT /identity/v3/projects/d0e02a55f7204ca098b4d52ac9c245c1/users/f8cdb68f5a8544b1a333c2413ca10bba/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:32.262965 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2589757-35c2-453d-a100-1262905ceb08 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:32.262965 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2589757-35c2-453d-a100-1262905ceb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:32.264717 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0fe72-6667-4ee1-9180-1090a6af4404 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:32.305428 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-a2589757-35c2-453d-a100-1262905ceb08 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:32.306828 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a2589757-35c2-453d-a100-1262905ceb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:32.356366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d0fe72-6667-4ee1-9180-1090a6af4404 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:32.397813 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 998/1960] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:32.402097 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2589757-35c2-453d-a100-1262905ceb08 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:32.413193 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2589757-35c2-453d-a100-1262905ceb08 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:32.419108 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b256ae1-18b7-47b8-ae77-00ba65ba0946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:32.420017 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b256ae1-18b7-47b8-ae77-00ba65ba0946 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:32.420218 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b256ae1-18b7-47b8-ae77-00ba65ba0946 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:32.420487 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b256ae1-18b7-47b8-ae77-00ba65ba0946 admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:32.421201 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b256ae1-18b7-47b8-ae77-00ba65ba0946 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:51:32.422083 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b256ae1-18b7-47b8-ae77-00ba65ba0946 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:32.423776 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b256ae1-18b7-47b8-ae77-00ba65ba0946 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:32.436621 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15bc4f-dbae-4f82-b3a9-18eef5d9d553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:32.436932 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 999/1961] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:51:32.438565 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15bc4f-dbae-4f82-b3a9-18eef5d9d553 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:32.439082 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15bc4f-dbae-4f82-b3a9-18eef5d9d553 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:32.439588 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15bc4f-dbae-4f82-b3a9-18eef5d9d553 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:32.440480 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15bc4f-dbae-4f82-b3a9-18eef5d9d553 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:32.442064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b256ae1-18b7-47b8-ae77-00ba65ba0946 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:32.442872 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15bc4f-dbae-4f82-b3a9-18eef5d9d553 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:32.454177 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b256ae1-18b7-47b8-ae77-00ba65ba0946 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:32.460273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a66a81-9030-4cd8-87f9-a39819c7dc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:32.460948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a66a81-9030-4cd8-87f9-a39819c7dc54 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:32.461659 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a66a81-9030-4cd8-87f9-a39819c7dc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:32.461659 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a66a81-9030-4cd8-87f9-a39819c7dc54 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:32.462260 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a66a81-9030-4cd8-87f9-a39819c7dc54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:32.464844 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a66a81-9030-4cd8-87f9-a39819c7dc54 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:32.468109 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 963/1962] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:32 2022] POST /identity/v3/users => generated 297 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:32.473014 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15bc4f-dbae-4f82-b3a9-18eef5d9d553 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:32.488370 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15bc4f-dbae-4f82-b3a9-18eef5d9d553 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:32.493557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7abcb4-a05e-4d26-b19c-68a05d3110ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:32.494284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7abcb4-a05e-4d26-b19c-68a05d3110ec admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:32.494665 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7abcb4-a05e-4d26-b19c-68a05d3110ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:32.495119 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7abcb4-a05e-4d26-b19c-68a05d3110ec admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:32.496162 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7abcb4-a05e-4d26-b19c-68a05d3110ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:32.497426 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7abcb4-a05e-4d26-b19c-68a05d3110ec admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:32.502632 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1000/1963] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:32 2022] POST /identity/v3/projects => generated 399 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:32.506582 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a66a81-9030-4cd8-87f9-a39819c7dc54 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:32.513982 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 964/1964] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:32.515122 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7abcb4-a05e-4d26-b19c-68a05d3110ec admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:32.547976 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7abcb4-a05e-4d26-b19c-68a05d3110ec admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:32.610204 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a66a81-9030-4cd8-87f9-a39819c7dc54 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:32.621724 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c5017-415f-4c64-8b45-8c59b2b19b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:32.622419 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c5017-415f-4c64-8b45-8c59b2b19b53 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:32.622818 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c5017-415f-4c64-8b45-8c59b2b19b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:32.623017 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4c5017-415f-4c64-8b45-8c59b2b19b53 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:32.623707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c5017-415f-4c64-8b45-8c59b2b19b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:32.627856 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4c5017-415f-4c64-8b45-8c59b2b19b53 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:32.652749 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31472da6-5d70-4004-80ab-6367f63179b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:32.653669 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31472da6-5d70-4004-80ab-6367f63179b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:32.653951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31472da6-5d70-4004-80ab-6367f63179b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:32.654223 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31472da6-5d70-4004-80ab-6367f63179b8 admin admin] PATH_INFO: `/v3/projects/b903a25529c7438ca8b6a6d07ab90547/users/d99ae5bebaa643b2a2a59525efd3721d/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:32.670636 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1001/1965] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:32 2022] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:32.675316 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c5017-415f-4c64-8b45-8c59b2b19b53 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:32.693798 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4c5017-415f-4c64-8b45-8c59b2b19b53 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:32.696918 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31472da6-5d70-4004-80ab-6367f63179b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b903a25529c7438ca8b6a6d07ab90547, user_id=d99ae5bebaa643b2a2a59525efd3721d, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:32.699639 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31472da6-5d70-4004-80ab-6367f63179b8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:32.719642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036699f6-abf9-4a16-a533-aa197b1d7139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:32.720330 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036699f6-abf9-4a16-a533-aa197b1d7139 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:32.720614 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036699f6-abf9-4a16-a533-aa197b1d7139 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:32.720890 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036699f6-abf9-4a16-a533-aa197b1d7139 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:32.721620 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036699f6-abf9-4a16-a533-aa197b1d7139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:32.723278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036699f6-abf9-4a16-a533-aa197b1d7139 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:32.755908 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 965/1966] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:32 2022] PUT /identity/v3/projects/b903a25529c7438ca8b6a6d07ab90547/users/d99ae5bebaa643b2a2a59525efd3721d/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:32.757160 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31472da6-5d70-4004-80ab-6367f63179b8 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:32.770846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1002/1967] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:32.778827 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036699f6-abf9-4a16-a533-aa197b1d7139 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:32.802722 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036699f6-abf9-4a16-a533-aa197b1d7139 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:32.913052 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31472da6-5d70-4004-80ab-6367f63179b8 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:32.923337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c68f4-f503-4518-a43c-3e2ed7e5f3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:32.924024 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c68f4-f503-4518-a43c-3e2ed7e5f3dc admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:32.924307 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c68f4-f503-4518-a43c-3e2ed7e5f3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:32.924584 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c68f4-f503-4518-a43c-3e2ed7e5f3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:32.925327 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c68f4-f503-4518-a43c-3e2ed7e5f3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:32.926995 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c68f4-f503-4518-a43c-3e2ed7e5f3dc admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:32.953838 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2ee7b-743a-48d1-866f-84e366fd318d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:32.954516 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2ee7b-743a-48d1-866f-84e366fd318d admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:32.954814 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2ee7b-743a-48d1-866f-84e366fd318d admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:32.955092 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2ee7b-743a-48d1-866f-84e366fd318d admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:32.955840 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2ee7b-743a-48d1-866f-84e366fd318d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:32.957452 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f2ee7b-743a-48d1-866f-84e366fd318d admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:32.965379 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 966/1968] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:32.983166 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c68f4-f503-4518-a43c-3e2ed7e5f3dc admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:33.005560 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1003/1969] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:32 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:33.007104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2ee7b-743a-48d1-866f-84e366fd318d admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:33.019868 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c68f4-f503-4518-a43c-3e2ed7e5f3dc admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:33.027866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2ee7b-743a-48d1-866f-84e366fd318d admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:33.029820 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c524f-3cda-4644-8429-8472d2bcd8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:33.031739 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c524f-3cda-4644-8429-8472d2bcd8e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:33.031739 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c524f-3cda-4644-8429-8472d2bcd8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:33.031987 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c524f-3cda-4644-8429-8472d2bcd8e0 admin admin] PATH_INFO: `/v3/projects/b903a25529c7438ca8b6a6d07ab90547/users/d99ae5bebaa643b2a2a59525efd3721d/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:33.035021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c524f-3cda-4644-8429-8472d2bcd8e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b903a25529c7438ca8b6a6d07ab90547, user_id=d99ae5bebaa643b2a2a59525efd3721d, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:33.037681 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82c524f-3cda-4644-8429-8472d2bcd8e0 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:33.043251 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d4959-9580-4e3c-83b9-11925a9ae44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:33.044157 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d4959-9580-4e3c-83b9-11925a9ae44d admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:33.044441 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d4959-9580-4e3c-83b9-11925a9ae44d admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:33.044718 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d4959-9580-4e3c-83b9-11925a9ae44d admin admin] PATH_INFO: `/v3/projects/79724e6b90c347f8b8779339ddd8aca7/users/0b5e0c3db2524b4c985ca6d920432e90/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:33.074753 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 967/1970] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:32 2022] PUT /identity/v3/projects/b903a25529c7438ca8b6a6d07ab90547/users/d99ae5bebaa643b2a2a59525efd3721d/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:33.077036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed2577-3eb0-4a46-b67d-4dc259214465 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:33.077317 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed2577-3eb0-4a46-b67d-4dc259214465 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:33.078155 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ed2577-3eb0-4a46-b67d-4dc259214465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:33.084222 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d4959-9580-4e3c-83b9-11925a9ae44d admin admin] RBAC: Authorizing `identity:create_grant(project_id=79724e6b90c347f8b8779339ddd8aca7, user_id=0b5e0c3db2524b4c985ca6d920432e90, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:33.089866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d4959-9580-4e3c-83b9-11925a9ae44d admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:33.131611 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1004/1971] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:33 2022] PUT /identity/v3/projects/79724e6b90c347f8b8779339ddd8aca7/users/0b5e0c3db2524b4c985ca6d920432e90/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:33.132259 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c0ed2577-3eb0-4a46-b67d-4dc259214465 None None] MFA Rules not processed for user `d99ae5bebaa643b2a2a59525efd3721d`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:33.132259 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c0ed2577-3eb0-4a46-b67d-4dc259214465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:33.135400 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f024b8-4387-4810-838d-eca81c34545a None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:33.135400 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f024b8-4387-4810-838d-eca81c34545a None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:33.135822 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f024b8-4387-4810-838d-eca81c34545a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:33.203685 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-a8f024b8-4387-4810-838d-eca81c34545a None None] MFA Rules not processed for user `0b5e0c3db2524b4c985ca6d920432e90`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:33.204947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a8f024b8-4387-4810-838d-eca81c34545a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:33.328237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 968/1972] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:33.354642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1005/1973] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:33.358265 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed2577-3eb0-4a46-b67d-4dc259214465 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:33.479562 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f024b8-4387-4810-838d-eca81c34545a None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:33.481059 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a8f024b8-4387-4810-838d-eca81c34545a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:33.536844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ed2577-3eb0-4a46-b67d-4dc259214465 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:33.554026 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9463d87-7483-4423-8f38-85eb75a71d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:33.554806 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9463d87-7483-4423-8f38-85eb75a71d13 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:33.555191 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9463d87-7483-4423-8f38-85eb75a71d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:33.555191 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9463d87-7483-4423-8f38-85eb75a71d13 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:33.555923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9463d87-7483-4423-8f38-85eb75a71d13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:33.560716 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9463d87-7483-4423-8f38-85eb75a71d13 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:33.627235 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f024b8-4387-4810-838d-eca81c34545a None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:33.636656 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bfcf7-1f9b-417f-a03a-0204dfc3bcd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:33.637459 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bfcf7-1f9b-417f-a03a-0204dfc3bcd4 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:33.638348 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bfcf7-1f9b-417f-a03a-0204dfc3bcd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:33.638930 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bfcf7-1f9b-417f-a03a-0204dfc3bcd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:33.652238 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 969/1974] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:33 2022] POST /identity/v3/projects => generated 401 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:33.654931 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9463d87-7483-4423-8f38-85eb75a71d13 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:33.655079 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bfcf7-1f9b-417f-a03a-0204dfc3bcd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:33.657356 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1bfcf7-1f9b-417f-a03a-0204dfc3bcd4 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:33.674066 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1006/1975] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:51:33.797659 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9463d87-7483-4423-8f38-85eb75a71d13 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:33.804109 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e98778-a005-4747-b5d5-8ef767b1a4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:33.804964 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e98778-a005-4747-b5d5-8ef767b1a4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:33.805362 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e98778-a005-4747-b5d5-8ef767b1a4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:33.805809 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e98778-a005-4747-b5d5-8ef767b1a4c4 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:33.806834 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e98778-a005-4747-b5d5-8ef767b1a4c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:33.809483 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e98778-a005-4747-b5d5-8ef767b1a4c4 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:33.841417 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 970/1976] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:33 2022] POST /identity/v3/users => generated 307 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:33.845894 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bfcf7-1f9b-417f-a03a-0204dfc3bcd4 service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:33.857947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bfcf7-1f9b-417f-a03a-0204dfc3bcd4 service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:33.863359 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60b1fe-168b-48c1-8d39-82cf2a8945a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:33.864039 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60b1fe-168b-48c1-8d39-82cf2a8945a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:33.864371 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60b1fe-168b-48c1-8d39-82cf2a8945a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:33.864649 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60b1fe-168b-48c1-8d39-82cf2a8945a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:33.865565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60b1fe-168b-48c1-8d39-82cf2a8945a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:33.867602 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60b1fe-168b-48c1-8d39-82cf2a8945a4 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:33.890907 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e98778-a005-4747-b5d5-8ef767b1a4c4 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:33.897570 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1007/1977] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:33 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:33.916758 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e98778-a005-4747-b5d5-8ef767b1a4c4 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:33.933978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f0acd-3812-48ec-899b-ded5460d95d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:33.935117 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f0acd-3812-48ec-899b-ded5460d95d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:33.935786 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f0acd-3812-48ec-899b-ded5460d95d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:33.937859 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f0acd-3812-48ec-899b-ded5460d95d1 admin admin] PATH_INFO: `/v3/projects/8969123badd74a6faeb86c97bda6710b/users/21ef846dea454c15bd582c6bf018290e/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:33.976157 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f0acd-3812-48ec-899b-ded5460d95d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8969123badd74a6faeb86c97bda6710b, user_id=21ef846dea454c15bd582c6bf018290e, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:33.981743 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f0acd-3812-48ec-899b-ded5460d95d1 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:34.017508 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60b1fe-168b-48c1-8d39-82cf2a8945a4 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:34.018332 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 971/1978] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:33 2022] PUT /identity/v3/projects/8969123badd74a6faeb86c97bda6710b/users/21ef846dea454c15bd582c6bf018290e/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:34.024367 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f0acd-3812-48ec-899b-ded5460d95d1 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:34.032694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8a6f0acd-3812-48ec-899b-ded5460d95d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:34.033931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60b1fe-168b-48c1-8d39-82cf2a8945a4 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:34.147388 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2de677-3580-4ed0-9110-649086377831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:34.149566 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2de677-3580-4ed0-9110-649086377831 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:34.149919 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2de677-3580-4ed0-9110-649086377831 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:34.151410 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2de677-3580-4ed0-9110-649086377831 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:34.152208 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2de677-3580-4ed0-9110-649086377831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:34.154565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2de677-3580-4ed0-9110-649086377831 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:34.179639 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1008/1979] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:34.185977 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2de677-3580-4ed0-9110-649086377831 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:34.198166 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f0acd-3812-48ec-899b-ded5460d95d1 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:34.203812 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d8ca2-5880-4255-91ed-a3a23fb39e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:34.204730 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d8ca2-5880-4255-91ed-a3a23fb39e0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:34.204967 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2de677-3580-4ed0-9110-649086377831 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:34.205098 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d8ca2-5880-4255-91ed-a3a23fb39e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:34.205289 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d8ca2-5880-4255-91ed-a3a23fb39e0c admin admin] PATH_INFO: `/v3/users/c7dac9dd8c214082a18d33b366e11cdc` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:34.206506 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d8ca2-5880-4255-91ed-a3a23fb39e0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7dac9dd8c214082a18d33b366e11cdc)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:34.208451 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d8ca2-5880-4255-91ed-a3a23fb39e0c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:34.228904 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40985aa9-da6d-4e5c-b37c-13fe0d45abd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:34.230045 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40985aa9-da6d-4e5c-b37c-13fe0d45abd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:34.230400 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40985aa9-da6d-4e5c-b37c-13fe0d45abd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:34.230766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40985aa9-da6d-4e5c-b37c-13fe0d45abd4 admin admin] PATH_INFO: `/v3/projects/8969123badd74a6faeb86c97bda6710b/users/21ef846dea454c15bd582c6bf018290e/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:34.235807 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40985aa9-da6d-4e5c-b37c-13fe0d45abd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8969123badd74a6faeb86c97bda6710b, user_id=21ef846dea454c15bd582c6bf018290e, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:34.238578 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40985aa9-da6d-4e5c-b37c-13fe0d45abd4 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:34.283912 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1009/1980] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:34 2022] PUT /identity/v3/projects/8969123badd74a6faeb86c97bda6710b/users/21ef846dea454c15bd582c6bf018290e/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:34.298117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc66e-cd07-447f-a999-d33a8aad7d55 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:34.298411 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc66e-cd07-447f-a999-d33a8aad7d55 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:34.298880 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc66e-cd07-447f-a999-d33a8aad7d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:34.300547 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-783d8ca2-5880-4255-91ed-a3a23fb39e0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7dac9dd8c214082a18d33b366e11cdc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:34.315471 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-783d8ca2-5880-4255-91ed-a3a23fb39e0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7dac9dd8c214082a18d33b366e11cdc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:34.316894 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-783d8ca2-5880-4255-91ed-a3a23fb39e0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7dac9dd8c214082a18d33b366e11cdc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:34.327850 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-783d8ca2-5880-4255-91ed-a3a23fb39e0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7dac9dd8c214082a18d33b366e11cdc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:34.343632 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-783d8ca2-5880-4255-91ed-a3a23fb39e0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7dac9dd8c214082a18d33b366e11cdc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:34.352614 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 972/1981] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:34 2022] DELETE /identity/v3/users/c7dac9dd8c214082a18d33b366e11cdc => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:34.357571 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab529065-e3f1-42ab-a0f4-c94dbe0c5e35 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:34.359719 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab529065-e3f1-42ab-a0f4-c94dbe0c5e35 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:34.361605 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab529065-e3f1-42ab-a0f4-c94dbe0c5e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:34.378096 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-3adfc66e-cd07-447f-a999-d33a8aad7d55 None None] MFA Rules not processed for user `21ef846dea454c15bd582c6bf018290e`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:34.379502 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3adfc66e-cd07-447f-a999-d33a8aad7d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:34.423907 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ab529065-e3f1-42ab-a0f4-c94dbe0c5e35 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:34.432848 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ab529065-e3f1-42ab-a0f4-c94dbe0c5e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:34.495947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1010/1982] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:34 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:34.514703 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfc66e-cd07-447f-a999-d33a8aad7d55 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:34.519803 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3adfc66e-cd07-447f-a999-d33a8aad7d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:34.623450 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfc66e-cd07-447f-a999-d33a8aad7d55 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:34.628741 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 973/1983] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:34.629778 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab529065-e3f1-42ab-a0f4-c94dbe0c5e35 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:34.631272 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24c069-3103-4703-a68b-b0fb51aae382 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:34.632384 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24c069-3103-4703-a68b-b0fb51aae382 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:34.632966 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24c069-3103-4703-a68b-b0fb51aae382 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:34.634220 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ab529065-e3f1-42ab-a0f4-c94dbe0c5e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:34.634812 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed24c069-3103-4703-a68b-b0fb51aae382 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:34.652143 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24c069-3103-4703-a68b-b0fb51aae382 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:34.654906 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed24c069-3103-4703-a68b-b0fb51aae382 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:34.664885 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab529065-e3f1-42ab-a0f4-c94dbe0c5e35 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:34.676428 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aeefb3-0322-4610-ada7-5970f37e5433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:34.677312 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aeefb3-0322-4610-ada7-5970f37e5433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:34.677593 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aeefb3-0322-4610-ada7-5970f37e5433 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:34.677866 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aeefb3-0322-4610-ada7-5970f37e5433 admin admin] PATH_INFO: `/v3/users/067b5b8675b74949b24ec07a30b9303e` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:34.683119 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aeefb3-0322-4610-ada7-5970f37e5433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=067b5b8675b74949b24ec07a30b9303e)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:34.685335 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aeefb3-0322-4610-ada7-5970f37e5433 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:34.685595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1011/1984] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:34 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:34.687257 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24c069-3103-4703-a68b-b0fb51aae382 service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:34.691973 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-ed24c069-3103-4703-a68b-b0fb51aae382 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:34.770910 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e8aeefb3-0322-4610-ada7-5970f37e5433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '067b5b8675b74949b24ec07a30b9303e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:34.779697 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e8aeefb3-0322-4610-ada7-5970f37e5433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '067b5b8675b74949b24ec07a30b9303e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:34.781471 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e8aeefb3-0322-4610-ada7-5970f37e5433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '067b5b8675b74949b24ec07a30b9303e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:34.784842 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed24c069-3103-4703-a68b-b0fb51aae382 service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:34.791669 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e8aeefb3-0322-4610-ada7-5970f37e5433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '067b5b8675b74949b24ec07a30b9303e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:34.797524 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c5b62d-fce6-4acb-b372-8781481d2193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:34.798400 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5b62d-fce6-4acb-b372-8781481d2193 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:34.798756 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5b62d-fce6-4acb-b372-8781481d2193 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:34.799906 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c5b62d-fce6-4acb-b372-8781481d2193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:34.801376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-e4c5b62d-fce6-4acb-b372-8781481d2193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:34.807366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e8aeefb3-0322-4610-ada7-5970f37e5433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '067b5b8675b74949b24ec07a30b9303e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:34.814309 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 974/1985] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:34 2022] DELETE /identity/v3/users/067b5b8675b74949b24ec07a30b9303e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:34.815358 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aeefb3-0322-4610-ada7-5970f37e5433 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:34.816665 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5b62d-fce6-4acb-b372-8781481d2193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:34.818173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e8aeefb3-0322-4610-ada7-5970f37e5433 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:34.818982 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c5b62d-fce6-4acb-b372-8781481d2193 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:34.832722 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1012/1986] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:34.834810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9f770-0d17-48f4-bbf3-f2f5fff61530 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:34.835431 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9f770-0d17-48f4-bbf3-f2f5fff61530 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:34.835725 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb9f770-0d17-48f4-bbf3-f2f5fff61530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:34.875191 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-cdb9f770-0d17-48f4-bbf3-f2f5fff61530 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:34.876582 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-cdb9f770-0d17-48f4-bbf3-f2f5fff61530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:34.993243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aeefb3-0322-4610-ada7-5970f37e5433 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:35.012896 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82230943-a2b6-47cf-a84f-8033a2068e70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:35.013559 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82230943-a2b6-47cf-a84f-8033a2068e70 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:35.013809 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1013/1987] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:35.013916 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82230943-a2b6-47cf-a84f-8033a2068e70 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:35.014102 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82230943-a2b6-47cf-a84f-8033a2068e70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:35.020098 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-82230943-a2b6-47cf-a84f-8033a2068e70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:35.115971 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9f770-0d17-48f4-bbf3-f2f5fff61530 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:35.119765 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-cdb9f770-0d17-48f4-bbf3-f2f5fff61530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:35.201763 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82230943-a2b6-47cf-a84f-8033a2068e70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:35.204519 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82230943-a2b6-47cf-a84f-8033a2068e70 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:35.226253 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 975/1988] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:35.236649 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb9f770-0d17-48f4-bbf3-f2f5fff61530 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:35.244663 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2434c11-d344-4ef6-9750-91c1d80d46ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:35.245450 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2434c11-d344-4ef6-9750-91c1d80d46ab service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:35.245832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2434c11-d344-4ef6-9750-91c1d80d46ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:35.246203 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2434c11-d344-4ef6-9750-91c1d80d46ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:35.272402 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2434c11-d344-4ef6-9750-91c1d80d46ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:35.274109 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2434c11-d344-4ef6-9750-91c1d80d46ab service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:35.292844 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1014/1989] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:36.324285 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82230943-a2b6-47cf-a84f-8033a2068e70 service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:36.326696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-82230943-a2b6-47cf-a84f-8033a2068e70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:36.338349 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2434c11-d344-4ef6-9750-91c1d80d46ab service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:36.340464 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-e2434c11-d344-4ef6-9750-91c1d80d46ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:36.360507 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82230943-a2b6-47cf-a84f-8033a2068e70 service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:36.377466 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125140bc-de1e-4e7f-95f1-e1c185886ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:36.379810 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125140bc-de1e-4e7f-95f1-e1c185886ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:36.381291 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125140bc-de1e-4e7f-95f1-e1c185886ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:36.381737 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125140bc-de1e-4e7f-95f1-e1c185886ea3 admin admin] PATH_INFO: `/v3/projects/52324e179bff4d048025edcd83e213b6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:36.385545 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125140bc-de1e-4e7f-95f1-e1c185886ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52324e179bff4d048025edcd83e213b6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:36.391544 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125140bc-de1e-4e7f-95f1-e1c185886ea3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:36.393082 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2434c11-d344-4ef6-9750-91c1d80d46ab service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:36.418258 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16585dad-19fd-4acf-a46d-3c007648f7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:36.419526 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16585dad-19fd-4acf-a46d-3c007648f7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:36.420015 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16585dad-19fd-4acf-a46d-3c007648f7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:36.420493 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16585dad-19fd-4acf-a46d-3c007648f7a8 admin admin] PATH_INFO: `/v3/projects/06b618a614784f7983497f22fbe073ad` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:36.435584 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16585dad-19fd-4acf-a46d-3c007648f7a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06b618a614784f7983497f22fbe073ad)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:36.439972 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16585dad-19fd-4acf-a46d-3c007648f7a8 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:36.549896 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-16585dad-19fd-4acf-a46d-3c007648f7a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b618a614784f7983497f22fbe073ad', 'request_id': 'req-16585dad-19fd-4acf-a46d-3c007648f7a8'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:36.559369 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-125140bc-de1e-4e7f-95f1-e1c185886ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52324e179bff4d048025edcd83e213b6', 'request_id': 'req-125140bc-de1e-4e7f-95f1-e1c185886ea3'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:36.565557 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-16585dad-19fd-4acf-a46d-3c007648f7a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b618a614784f7983497f22fbe073ad', 'request_id': 'req-16585dad-19fd-4acf-a46d-3c007648f7a8'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:36.574839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-125140bc-de1e-4e7f-95f1-e1c185886ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52324e179bff4d048025edcd83e213b6', 'request_id': 'req-125140bc-de1e-4e7f-95f1-e1c185886ea3'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:36.584817 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-125140bc-de1e-4e7f-95f1-e1c185886ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52324e179bff4d048025edcd83e213b6', 'request_id': 'req-125140bc-de1e-4e7f-95f1-e1c185886ea3'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:36.606629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-16585dad-19fd-4acf-a46d-3c007648f7a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b618a614784f7983497f22fbe073ad', 'request_id': 'req-16585dad-19fd-4acf-a46d-3c007648f7a8'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:36.615464 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-125140bc-de1e-4e7f-95f1-e1c185886ea3 admin admin] The token cache is being invalidate because project 52324e179bff4d048025edcd83e213b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:36.615760 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-125140bc-de1e-4e7f-95f1-e1c185886ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:36.617593 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-125140bc-de1e-4e7f-95f1-e1c185886ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:36.620396 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 976/1990] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:36 2022] DELETE /identity/v3/projects/52324e179bff4d048025edcd83e213b6 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:36.625355 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125140bc-de1e-4e7f-95f1-e1c185886ea3 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:36.631078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-125140bc-de1e-4e7f-95f1-e1c185886ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:36.650500 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-16585dad-19fd-4acf-a46d-3c007648f7a8 admin admin] The token cache is being invalidate because project 06b618a614784f7983497f22fbe073ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:36.650815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-16585dad-19fd-4acf-a46d-3c007648f7a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:36.651488 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-16585dad-19fd-4acf-a46d-3c007648f7a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:36.657539 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1015/1991] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:36 2022] DELETE /identity/v3/projects/06b618a614784f7983497f22fbe073ad => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:36.662583 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16585dad-19fd-4acf-a46d-3c007648f7a8 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:36.664246 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-16585dad-19fd-4acf-a46d-3c007648f7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:36.797735 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125140bc-de1e-4e7f-95f1-e1c185886ea3 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:36.863731 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16585dad-19fd-4acf-a46d-3c007648f7a8 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:36.886355 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f59e3-14ec-48ef-a215-bffb4c65ead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:36.903335 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f59e3-14ec-48ef-a215-bffb4c65ead4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:36.904023 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f59e3-14ec-48ef-a215-bffb4c65ead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:36.904023 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f59e3-14ec-48ef-a215-bffb4c65ead4 admin admin] PATH_INFO: `/v3/users/d99ae5bebaa643b2a2a59525efd3721d` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:36.919552 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f59e3-14ec-48ef-a215-bffb4c65ead4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d99ae5bebaa643b2a2a59525efd3721d)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:36.932314 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f59e3-14ec-48ef-a215-bffb4c65ead4 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:36.991982 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d1bb07-9dee-4064-9e02-c7780badff25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:36.993199 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1bb07-9dee-4064-9e02-c7780badff25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:36.993911 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1bb07-9dee-4064-9e02-c7780badff25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:36.997609 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d1bb07-9dee-4064-9e02-c7780badff25 admin admin] PATH_INFO: `/v3/users/b7170d3240714877a6d5fc72aa1ce755` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:37.027462 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1bb07-9dee-4064-9e02-c7780badff25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7170d3240714877a6d5fc72aa1ce755)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:37.029540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d1bb07-9dee-4064-9e02-c7780badff25 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:37.121982 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-e15f59e3-14ec-48ef-a215-bffb4c65ead4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd99ae5bebaa643b2a2a59525efd3721d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:37.122549 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-e15f59e3-14ec-48ef-a215-bffb4c65ead4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd99ae5bebaa643b2a2a59525efd3721d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:37.146093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-e15f59e3-14ec-48ef-a215-bffb4c65ead4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd99ae5bebaa643b2a2a59525efd3721d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:37.175615 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-e15f59e3-14ec-48ef-a215-bffb4c65ead4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd99ae5bebaa643b2a2a59525efd3721d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:37.179968 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-27d1bb07-9dee-4064-9e02-c7780badff25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7170d3240714877a6d5fc72aa1ce755'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:37.207471 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-27d1bb07-9dee-4064-9e02-c7780badff25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7170d3240714877a6d5fc72aa1ce755'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:37.208198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-27d1bb07-9dee-4064-9e02-c7780badff25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7170d3240714877a6d5fc72aa1ce755'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:37.215624 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-e15f59e3-14ec-48ef-a215-bffb4c65ead4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd99ae5bebaa643b2a2a59525efd3721d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:37.223318 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-27d1bb07-9dee-4064-9e02-c7780badff25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7170d3240714877a6d5fc72aa1ce755'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:37.242515 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1016/1992] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:36 2022] DELETE /identity/v3/users/d99ae5bebaa643b2a2a59525efd3721d => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:37.255354 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-27d1bb07-9dee-4064-9e02-c7780badff25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7170d3240714877a6d5fc72aa1ce755'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:37.270635 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 977/1993] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:36 2022] DELETE /identity/v3/users/b7170d3240714877a6d5fc72aa1ce755 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:38.406939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f59e3-14ec-48ef-a215-bffb4c65ead4 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:38.408704 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-e15f59e3-14ec-48ef-a215-bffb4c65ead4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:38.485870 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f59e3-14ec-48ef-a215-bffb4c65ead4 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:38.580207 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec8c44-276c-4e1d-9031-6700f7cb229e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:38.581719 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec8c44-276c-4e1d-9031-6700f7cb229e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:38.581994 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec8c44-276c-4e1d-9031-6700f7cb229e admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:38.582274 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec8c44-276c-4e1d-9031-6700f7cb229e admin admin] PATH_INFO: `/v3/projects/b903a25529c7438ca8b6a6d07ab90547` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:38.583499 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec8c44-276c-4e1d-9031-6700f7cb229e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b903a25529c7438ca8b6a6d07ab90547)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:38.585582 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec8c44-276c-4e1d-9031-6700f7cb229e admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:38.676735 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b4ec8c44-276c-4e1d-9031-6700f7cb229e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b903a25529c7438ca8b6a6d07ab90547', 'request_id': 'req-b4ec8c44-276c-4e1d-9031-6700f7cb229e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:38.684044 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b4ec8c44-276c-4e1d-9031-6700f7cb229e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b903a25529c7438ca8b6a6d07ab90547', 'request_id': 'req-b4ec8c44-276c-4e1d-9031-6700f7cb229e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:38.696928 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b4ec8c44-276c-4e1d-9031-6700f7cb229e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b903a25529c7438ca8b6a6d07ab90547', 'request_id': 'req-b4ec8c44-276c-4e1d-9031-6700f7cb229e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:38.734219 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b4ec8c44-276c-4e1d-9031-6700f7cb229e admin admin] The token cache is being invalidate because project b903a25529c7438ca8b6a6d07ab90547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:38.734508 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b4ec8c44-276c-4e1d-9031-6700f7cb229e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:38.735549 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b4ec8c44-276c-4e1d-9031-6700f7cb229e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:38.738321 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1017/1994] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:38 2022] DELETE /identity/v3/projects/b903a25529c7438ca8b6a6d07ab90547 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:38.745706 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa6aeb-ef55-4c54-a3e4-0e5726c5c410 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:38.746779 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa6aeb-ef55-4c54-a3e4-0e5726c5c410 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:38.747639 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa6aeb-ef55-4c54-a3e4-0e5726c5c410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:38.786501 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-20aa6aeb-ef55-4c54-a3e4-0e5726c5c410 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:38.787787 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-20aa6aeb-ef55-4c54-a3e4-0e5726c5c410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:38.910448 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 978/1995] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:38.918304 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eb6fd-89aa-418d-a6de-50c1b4e03dfd None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:38.918784 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eb6fd-89aa-418d-a6de-50c1b4e03dfd None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:38.919216 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8eb6fd-89aa-418d-a6de-50c1b4e03dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:38.953950 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-fc8eb6fd-89aa-418d-a6de-50c1b4e03dfd None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:38.956381 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-fc8eb6fd-89aa-418d-a6de-50c1b4e03dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:38.971097 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1018/1996] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:38.975197 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa6aeb-ef55-4c54-a3e4-0e5726c5c410 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:38.992090 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa6aeb-ef55-4c54-a3e4-0e5726c5c410 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:39.011789 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1e4a0-bcc4-4793-80f6-dfe9da947574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:39.012467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1e4a0-bcc4-4793-80f6-dfe9da947574 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:39.012748 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1e4a0-bcc4-4793-80f6-dfe9da947574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:39.013016 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b1e4a0-bcc4-4793-80f6-dfe9da947574 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:39.013743 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1e4a0-bcc4-4793-80f6-dfe9da947574 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:51:39.014048 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1e4a0-bcc4-4793-80f6-dfe9da947574 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:39.016215 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b1e4a0-bcc4-4793-80f6-dfe9da947574 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:39.037873 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eb6fd-89aa-418d-a6de-50c1b4e03dfd None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:39.044416 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 979/1997] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:51:39.049168 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8eb6fd-89aa-418d-a6de-50c1b4e03dfd None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:39.059316 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2d037-3ec9-4365-81bd-cb49f3668d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:39.059986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2d037-3ec9-4365-81bd-cb49f3668d08 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:39.060434 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2d037-3ec9-4365-81bd-cb49f3668d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:39.060712 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2d037-3ec9-4365-81bd-cb49f3668d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:39.061397 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2d037-3ec9-4365-81bd-cb49f3668d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:39.063909 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2d037-3ec9-4365-81bd-cb49f3668d08 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:39.117170 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1e4a0-bcc4-4793-80f6-dfe9da947574 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:39.125372 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1019/1998] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:39 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:39.132633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b1e4a0-bcc4-4793-80f6-dfe9da947574 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:39.258380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db517d-4846-46e3-97d7-d17c3118c4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:39.259313 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db517d-4846-46e3-97d7-d17c3118c4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:39.259750 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db517d-4846-46e3-97d7-d17c3118c4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:39.260206 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db517d-4846-46e3-97d7-d17c3118c4e5 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:39.261385 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db517d-4846-46e3-97d7-d17c3118c4e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:39.263799 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db517d-4846-46e3-97d7-d17c3118c4e5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:39.315025 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 980/1999] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:39 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:39.318701 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2d037-3ec9-4365-81bd-cb49f3668d08 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:39.336244 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2d037-3ec9-4365-81bd-cb49f3668d08 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:39.352388 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b5250-48e7-4024-8ac0-fd47e4d8e869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:39.353343 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b5250-48e7-4024-8ac0-fd47e4d8e869 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:39.353861 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b5250-48e7-4024-8ac0-fd47e4d8e869 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:39.354452 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b5250-48e7-4024-8ac0-fd47e4d8e869 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:39.355792 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b5250-48e7-4024-8ac0-fd47e4d8e869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:39.359492 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b5250-48e7-4024-8ac0-fd47e4d8e869 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:39.381354 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1020/2000] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:39.382784 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db517d-4846-46e3-97d7-d17c3118c4e5 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:39.396886 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db517d-4846-46e3-97d7-d17c3118c4e5 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:39.402100 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9954962-e445-4171-ad44-c1e7f4bd5a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:39.402793 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9954962-e445-4171-ad44-c1e7f4bd5a67 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:39.403174 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9954962-e445-4171-ad44-c1e7f4bd5a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:39.403340 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9954962-e445-4171-ad44-c1e7f4bd5a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:39.404187 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9954962-e445-4171-ad44-c1e7f4bd5a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:39.405846 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9954962-e445-4171-ad44-c1e7f4bd5a67 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:39.429862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b5250-48e7-4024-8ac0-fd47e4d8e869 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:39.440505 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 981/2001] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:39.448233 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b5250-48e7-4024-8ac0-fd47e4d8e869 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:39.463258 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a07efb-c437-4825-88b3-d180598411a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:39.469846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a07efb-c437-4825-88b3-d180598411a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:39.470471 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a07efb-c437-4825-88b3-d180598411a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:39.471012 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a07efb-c437-4825-88b3-d180598411a8 admin admin] PATH_INFO: `/v3/projects/6bd700b997704c278a54c7063d071819/users/7e40df13156f45f7bbe2177533ba3472/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:39.504407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a07efb-c437-4825-88b3-d180598411a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd700b997704c278a54c7063d071819, user_id=7e40df13156f45f7bbe2177533ba3472, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:39.521364 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a07efb-c437-4825-88b3-d180598411a8 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:39.544895 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1021/2002] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:39 2022] PUT /identity/v3/projects/6bd700b997704c278a54c7063d071819/users/7e40df13156f45f7bbe2177533ba3472/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:39.556683 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add778f-f574-4643-bab5-04588ce07866 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:39.557087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add778f-f574-4643-bab5-04588ce07866 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:39.557370 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add778f-f574-4643-bab5-04588ce07866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:39.592128 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-8add778f-f574-4643-bab5-04588ce07866 None None] MFA Rules not processed for user `7e40df13156f45f7bbe2177533ba3472`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:39.597618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8add778f-f574-4643-bab5-04588ce07866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:39.660755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a07efb-c437-4825-88b3-d180598411a8 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:39.663036 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d3a07efb-c437-4825-88b3-d180598411a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:39.708305 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 982/2003] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:39.717061 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add778f-f574-4643-bab5-04588ce07866 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:39.719369 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8add778f-f574-4643-bab5-04588ce07866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:39.781382 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a07efb-c437-4825-88b3-d180598411a8 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:39.788414 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5f677-c745-49a3-8236-19b71955f7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:39.789606 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5f677-c745-49a3-8236-19b71955f7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:39.790667 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5f677-c745-49a3-8236-19b71955f7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:39.791100 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5f677-c745-49a3-8236-19b71955f7e7 admin admin] PATH_INFO: `/v3/projects/2ae3c8fa40c14e22a6358cce6e2552b0` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:39.793527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5f677-c745-49a3-8236-19b71955f7e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ae3c8fa40c14e22a6358cce6e2552b0)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:39.795474 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5f677-c745-49a3-8236-19b71955f7e7 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:39.806617 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add778f-f574-4643-bab5-04588ce07866 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:39.811436 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db01adc-08b1-49c0-b754-c51a3696ca77 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92dc1464c4b24c6c8ea5dfcc796f0279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:39.812787 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db01adc-08b1-49c0-b754-c51a3696ca77 service glance] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:39.813213 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db01adc-08b1-49c0-b754-c51a3696ca77 service glance] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:39.813649 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db01adc-08b1-49c0-b754-c51a3696ca77 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:39.828659 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db01adc-08b1-49c0-b754-c51a3696ca77 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:39.830117 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db01adc-08b1-49c0-b754-c51a3696ca77 service glance] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:39.840928 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 983/2004] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:39.877193 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-edc5f677-c745-49a3-8236-19b71955f7e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ae3c8fa40c14e22a6358cce6e2552b0', 'request_id': 'req-edc5f677-c745-49a3-8236-19b71955f7e7'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:39.888451 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-edc5f677-c745-49a3-8236-19b71955f7e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ae3c8fa40c14e22a6358cce6e2552b0', 'request_id': 'req-edc5f677-c745-49a3-8236-19b71955f7e7'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:39.895856 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-edc5f677-c745-49a3-8236-19b71955f7e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ae3c8fa40c14e22a6358cce6e2552b0', 'request_id': 'req-edc5f677-c745-49a3-8236-19b71955f7e7'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:39.918616 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-edc5f677-c745-49a3-8236-19b71955f7e7 admin admin] The token cache is being invalidate because project 2ae3c8fa40c14e22a6358cce6e2552b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:39.919636 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-edc5f677-c745-49a3-8236-19b71955f7e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:39.920271 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-edc5f677-c745-49a3-8236-19b71955f7e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:39.926695 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1022/2005] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:39 2022] DELETE /identity/v3/projects/2ae3c8fa40c14e22a6358cce6e2552b0 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:39.927679 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db01adc-08b1-49c0-b754-c51a3696ca77 service glance] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:39.940339 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db01adc-08b1-49c0-b754-c51a3696ca77 service glance] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:40.027505 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608be68e-3382-43f8-84b0-a1589cc42644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:40.028491 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608be68e-3382-43f8-84b0-a1589cc42644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:40.029008 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608be68e-3382-43f8-84b0-a1589cc42644 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:40.029406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608be68e-3382-43f8-84b0-a1589cc42644 admin admin] PATH_INFO: `/v3/users/8c8dc197a0854ef1b7fc59bd5438d7cc` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:40.030855 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608be68e-3382-43f8-84b0-a1589cc42644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c8dc197a0854ef1b7fc59bd5438d7cc)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:40.033868 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608be68e-3382-43f8-84b0-a1589cc42644 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:40.114243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-608be68e-3382-43f8-84b0-a1589cc42644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c8dc197a0854ef1b7fc59bd5438d7cc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:40.127875 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-608be68e-3382-43f8-84b0-a1589cc42644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c8dc197a0854ef1b7fc59bd5438d7cc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:40.128949 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-608be68e-3382-43f8-84b0-a1589cc42644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c8dc197a0854ef1b7fc59bd5438d7cc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:40.142332 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-608be68e-3382-43f8-84b0-a1589cc42644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c8dc197a0854ef1b7fc59bd5438d7cc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:40.163655 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-608be68e-3382-43f8-84b0-a1589cc42644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c8dc197a0854ef1b7fc59bd5438d7cc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:40.170633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 984/2006] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:39 2022] DELETE /identity/v3/users/8c8dc197a0854ef1b7fc59bd5438d7cc => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:41.028278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5f677-c745-49a3-8236-19b71955f7e7 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:41.030812 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-edc5f677-c745-49a3-8236-19b71955f7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:41.080126 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608be68e-3382-43f8-84b0-a1589cc42644 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:41.084110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-608be68e-3382-43f8-84b0-a1589cc42644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:41.086079 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5f677-c745-49a3-8236-19b71955f7e7 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:41.211261 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3016459-f944-4e9d-adf8-e779c9cc4418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:41.212730 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3016459-f944-4e9d-adf8-e779c9cc4418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:41.213468 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3016459-f944-4e9d-adf8-e779c9cc4418 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:41.213942 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3016459-f944-4e9d-adf8-e779c9cc4418 admin admin] PATH_INFO: `/v3/projects/e65bc6a761094b53a53007c4d5c874b2` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:41.216259 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3016459-f944-4e9d-adf8-e779c9cc4418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e65bc6a761094b53a53007c4d5c874b2)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:41.218696 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3016459-f944-4e9d-adf8-e779c9cc4418 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:41.248834 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608be68e-3382-43f8-84b0-a1589cc42644 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:41.269685 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd4a35-8ea6-4722-81c0-2b7de7bc2a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:41.270568 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd4a35-8ea6-4722-81c0-2b7de7bc2a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:41.271037 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd4a35-8ea6-4722-81c0-2b7de7bc2a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:41.271461 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd4a35-8ea6-4722-81c0-2b7de7bc2a2a admin admin] PATH_INFO: `/v3/users/0b5e0c3db2524b4c985ca6d920432e90` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:41.274077 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd4a35-8ea6-4722-81c0-2b7de7bc2a2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b5e0c3db2524b4c985ca6d920432e90)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:41.279049 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd4a35-8ea6-4722-81c0-2b7de7bc2a2a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:41.299784 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b3016459-f944-4e9d-adf8-e779c9cc4418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e65bc6a761094b53a53007c4d5c874b2', 'request_id': 'req-b3016459-f944-4e9d-adf8-e779c9cc4418'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:41.308105 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b3016459-f944-4e9d-adf8-e779c9cc4418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e65bc6a761094b53a53007c4d5c874b2', 'request_id': 'req-b3016459-f944-4e9d-adf8-e779c9cc4418'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:41.327283 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b3016459-f944-4e9d-adf8-e779c9cc4418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e65bc6a761094b53a53007c4d5c874b2', 'request_id': 'req-b3016459-f944-4e9d-adf8-e779c9cc4418'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:41.351956 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b3016459-f944-4e9d-adf8-e779c9cc4418 admin admin] The token cache is being invalidate because project e65bc6a761094b53a53007c4d5c874b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:41.352313 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b3016459-f944-4e9d-adf8-e779c9cc4418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:41.359171 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b3016459-f944-4e9d-adf8-e779c9cc4418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:41.366795 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1023/2007] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:41 2022] DELETE /identity/v3/projects/e65bc6a761094b53a53007c4d5c874b2 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:41.369685 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e49723-92ea-4b85-8c3e-72ec52841ab1 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:41.369903 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e49723-92ea-4b85-8c3e-72ec52841ab1 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:41.371241 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e49723-92ea-4b85-8c3e-72ec52841ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:41.379996 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0fdd4a35-8ea6-4722-81c0-2b7de7bc2a2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b5e0c3db2524b4c985ca6d920432e90'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:41.395261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0fdd4a35-8ea6-4722-81c0-2b7de7bc2a2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b5e0c3db2524b4c985ca6d920432e90'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:41.396253 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0fdd4a35-8ea6-4722-81c0-2b7de7bc2a2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b5e0c3db2524b4c985ca6d920432e90'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:41.411584 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0fdd4a35-8ea6-4722-81c0-2b7de7bc2a2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b5e0c3db2524b4c985ca6d920432e90'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:41.423171 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-d6e49723-92ea-4b85-8c3e-72ec52841ab1 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:41.424395 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d6e49723-92ea-4b85-8c3e-72ec52841ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:41.439118 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0fdd4a35-8ea6-4722-81c0-2b7de7bc2a2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b5e0c3db2524b4c985ca6d920432e90'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:41.464021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 985/2008] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:41 2022] DELETE /identity/v3/users/0b5e0c3db2524b4c985ca6d920432e90 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:41.468566 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43613d-ca44-4263-ab70-4f43da4ae3a8 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:41.468864 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43613d-ca44-4263-ab70-4f43da4ae3a8 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:41.469146 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43613d-ca44-4263-ab70-4f43da4ae3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:41.536955 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-7f43613d-ca44-4263-ab70-4f43da4ae3a8 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:41.538758 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7f43613d-ca44-4263-ab70-4f43da4ae3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:41.593852 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1024/2009] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:41.602718 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca0df1-f202-45ff-8c1d-476574af97be None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:41.603010 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca0df1-f202-45ff-8c1d-476574af97be None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:41.603348 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca0df1-f202-45ff-8c1d-476574af97be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:41.641221 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-96ca0df1-f202-45ff-8c1d-476574af97be None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:41.642440 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-96ca0df1-f202-45ff-8c1d-476574af97be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:41.654123 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 986/2010] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:41.668578 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1025/2011] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:41.672993 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca0df1-f202-45ff-8c1d-476574af97be None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:41.676666 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43613d-ca44-4263-ab70-4f43da4ae3a8 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:41.678438 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7f43613d-ca44-4263-ab70-4f43da4ae3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:41.686278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca0df1-f202-45ff-8c1d-476574af97be None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:41.701621 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac6315-9d88-4dec-985a-afd0cc36c46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:41.703116 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac6315-9d88-4dec-985a-afd0cc36c46c admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:41.703545 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac6315-9d88-4dec-985a-afd0cc36c46c admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:41.703963 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac6315-9d88-4dec-985a-afd0cc36c46c admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:41.704832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac6315-9d88-4dec-985a-afd0cc36c46c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:51:41.705290 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac6315-9d88-4dec-985a-afd0cc36c46c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:41.707124 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac6315-9d88-4dec-985a-afd0cc36c46c admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:41.741498 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1026/2012] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:51:41.743058 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac6315-9d88-4dec-985a-afd0cc36c46c admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:41.761577 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac6315-9d88-4dec-985a-afd0cc36c46c admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:41.771372 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c18efe-4a13-4a2e-986c-984f592c3729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:41.772040 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c18efe-4a13-4a2e-986c-984f592c3729 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:41.772490 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c18efe-4a13-4a2e-986c-984f592c3729 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:41.772912 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c18efe-4a13-4a2e-986c-984f592c3729 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:41.774010 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c18efe-4a13-4a2e-986c-984f592c3729 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:41.775869 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43613d-ca44-4263-ab70-4f43da4ae3a8 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:41.776277 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c18efe-4a13-4a2e-986c-984f592c3729 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:41.780758 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ebd64-ca8d-4004-b3d9-89c751e4822a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:41.781661 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ebd64-ca8d-4004-b3d9-89c751e4822a service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:41.782895 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ebd64-ca8d-4004-b3d9-89c751e4822a service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:41.783327 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ebd64-ca8d-4004-b3d9-89c751e4822a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:41.803038 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ebd64-ca8d-4004-b3d9-89c751e4822a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:41.805068 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ebd64-ca8d-4004-b3d9-89c751e4822a service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:41.830855 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1027/2013] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:41 2022] POST /identity/v3/projects => generated 393 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:51:41.831055 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 987/2014] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:41.834832 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ebd64-ca8d-4004-b3d9-89c751e4822a service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:41.849037 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ebd64-ca8d-4004-b3d9-89c751e4822a service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:41.944623 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6c224-2756-45c1-bb77-c0165de063cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:41.945318 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6c224-2756-45c1-bb77-c0165de063cd admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:41.945798 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6c224-2756-45c1-bb77-c0165de063cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:41.946224 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6c224-2756-45c1-bb77-c0165de063cd admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:41.947894 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6c224-2756-45c1-bb77-c0165de063cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:41.950035 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6c224-2756-45c1-bb77-c0165de063cd admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:41.979294 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 988/2015] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:41 2022] POST /identity/v3/users => generated 297 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:41.983172 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c18efe-4a13-4a2e-986c-984f592c3729 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:42.002417 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c18efe-4a13-4a2e-986c-984f592c3729 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:42.007449 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4151c-ed36-419f-90d4-cad195c9370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:42.008129 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4151c-ed36-419f-90d4-cad195c9370f admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:42.008669 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4151c-ed36-419f-90d4-cad195c9370f admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:42.009117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4151c-ed36-419f-90d4-cad195c9370f admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:42.010218 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4151c-ed36-419f-90d4-cad195c9370f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:42.012212 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4151c-ed36-419f-90d4-cad195c9370f admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:42.022647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1028/2016] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:42.026787 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6c224-2756-45c1-bb77-c0165de063cd admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:42.039237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6c224-2756-45c1-bb77-c0165de063cd admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:42.044501 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68da604-08a8-4d6c-8e69-902a8e71e308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:42.045330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68da604-08a8-4d6c-8e69-902a8e71e308 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:42.045617 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68da604-08a8-4d6c-8e69-902a8e71e308 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:42.046548 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68da604-08a8-4d6c-8e69-902a8e71e308 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:42.047252 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68da604-08a8-4d6c-8e69-902a8e71e308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:42.048819 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68da604-08a8-4d6c-8e69-902a8e71e308 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:42.062701 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 989/2017] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:42.065231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4151c-ed36-419f-90d4-cad195c9370f admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:42.084844 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4151c-ed36-419f-90d4-cad195c9370f admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:42.107107 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43924d33-01d5-429b-8cbd-eb51442bd468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:42.108020 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43924d33-01d5-429b-8cbd-eb51442bd468 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:42.108837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43924d33-01d5-429b-8cbd-eb51442bd468 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:42.109116 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43924d33-01d5-429b-8cbd-eb51442bd468 admin admin] PATH_INFO: `/v3/projects/6c96bb56afea479dab18438ecd6db665/users/1c29820c6d754148b0677d9065ec9871/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:42.134859 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43924d33-01d5-429b-8cbd-eb51442bd468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c96bb56afea479dab18438ecd6db665, user_id=1c29820c6d754148b0677d9065ec9871, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:42.139102 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43924d33-01d5-429b-8cbd-eb51442bd468 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:42.164489 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1029/2018] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:42 2022] PUT /identity/v3/projects/6c96bb56afea479dab18438ecd6db665/users/1c29820c6d754148b0677d9065ec9871/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:42.176867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6bfde-2c95-4032-ba19-73be84859f7b None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:42.177439 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6bfde-2c95-4032-ba19-73be84859f7b None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:42.177439 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6bfde-2c95-4032-ba19-73be84859f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:42.204765 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-09d6bfde-2c95-4032-ba19-73be84859f7b None None] MFA Rules not processed for user `1c29820c6d754148b0677d9065ec9871`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:42.206005 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-09d6bfde-2c95-4032-ba19-73be84859f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:42.289921 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 990/2019] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:42.292958 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43924d33-01d5-429b-8cbd-eb51442bd468 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:42.337679 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83f863-6318-47ea-8ef6-4a2bc0518d84 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:42.337997 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83f863-6318-47ea-8ef6-4a2bc0518d84 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:42.338796 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83f863-6318-47ea-8ef6-4a2bc0518d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:42.401781 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ce83f863-6318-47ea-8ef6-4a2bc0518d84 None None] MFA Rules not processed for user `f8cdb68f5a8544b1a333c2413ca10bba`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:42.403084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ce83f863-6318-47ea-8ef6-4a2bc0518d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:42.444500 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43924d33-01d5-429b-8cbd-eb51442bd468 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:42.469301 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c793d-4e45-4d1a-8ae0-a213d3f786cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:42.469988 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c793d-4e45-4d1a-8ae0-a213d3f786cb admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:42.470270 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c793d-4e45-4d1a-8ae0-a213d3f786cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:42.470547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c793d-4e45-4d1a-8ae0-a213d3f786cb admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:42.471510 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c793d-4e45-4d1a-8ae0-a213d3f786cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:42.475318 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c793d-4e45-4d1a-8ae0-a213d3f786cb admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:42.555556 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1030/2020] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:42 2022] POST /identity/v3/projects => generated 393 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:51:42.556779 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c793d-4e45-4d1a-8ae0-a213d3f786cb admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:42.593959 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 991/2021] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:42.595098 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83f863-6318-47ea-8ef6-4a2bc0518d84 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:42.596851 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ce83f863-6318-47ea-8ef6-4a2bc0518d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:42.615852 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83f863-6318-47ea-8ef6-4a2bc0518d84 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:42.651110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c793d-4e45-4d1a-8ae0-a213d3f786cb admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:42.657959 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c704da-ebef-4832-86cf-8b53c7fbef46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:42.658854 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c704da-ebef-4832-86cf-8b53c7fbef46 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:42.659273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c704da-ebef-4832-86cf-8b53c7fbef46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:42.659714 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c704da-ebef-4832-86cf-8b53c7fbef46 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:42.660553 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c704da-ebef-4832-86cf-8b53c7fbef46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:42.663570 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c704da-ebef-4832-86cf-8b53c7fbef46 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:42.688417 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d02077-0f2e-4e09-a2af-6f5c00f2dd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:42.689299 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d02077-0f2e-4e09-a2af-6f5c00f2dd2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:42.689582 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d02077-0f2e-4e09-a2af-6f5c00f2dd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:42.690047 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d02077-0f2e-4e09-a2af-6f5c00f2dd2c admin admin] PATH_INFO: `/v3/projects/79724e6b90c347f8b8779339ddd8aca7` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:42.691437 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d02077-0f2e-4e09-a2af-6f5c00f2dd2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=79724e6b90c347f8b8779339ddd8aca7)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:42.695310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1031/2022] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:42 2022] POST /identity/v3/users => generated 303 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:42.695459 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d02077-0f2e-4e09-a2af-6f5c00f2dd2c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:42.695578 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c704da-ebef-4832-86cf-8b53c7fbef46 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:42.696231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-20c704da-ebef-4832-86cf-8b53c7fbef46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:42.764878 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-46d02077-0f2e-4e09-a2af-6f5c00f2dd2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79724e6b90c347f8b8779339ddd8aca7', 'request_id': 'req-46d02077-0f2e-4e09-a2af-6f5c00f2dd2c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:42.771133 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-46d02077-0f2e-4e09-a2af-6f5c00f2dd2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79724e6b90c347f8b8779339ddd8aca7', 'request_id': 'req-46d02077-0f2e-4e09-a2af-6f5c00f2dd2c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:42.781982 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-46d02077-0f2e-4e09-a2af-6f5c00f2dd2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79724e6b90c347f8b8779339ddd8aca7', 'request_id': 'req-46d02077-0f2e-4e09-a2af-6f5c00f2dd2c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:42.802008 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c704da-ebef-4832-86cf-8b53c7fbef46 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:42.803127 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-46d02077-0f2e-4e09-a2af-6f5c00f2dd2c admin admin] The token cache is being invalidate because project 79724e6b90c347f8b8779339ddd8aca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:42.803564 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-46d02077-0f2e-4e09-a2af-6f5c00f2dd2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:42.804570 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-46d02077-0f2e-4e09-a2af-6f5c00f2dd2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:42.806338 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 992/2023] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:42 2022] DELETE /identity/v3/projects/79724e6b90c347f8b8779339ddd8aca7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:42.807385 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d02077-0f2e-4e09-a2af-6f5c00f2dd2c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:42.808804 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-46d02077-0f2e-4e09-a2af-6f5c00f2dd2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:42.916564 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74faac8-cc32-4efd-8c1c-9084c996edde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:42.917312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74faac8-cc32-4efd-8c1c-9084c996edde service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:42.917591 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74faac8-cc32-4efd-8c1c-9084c996edde service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:42.917862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74faac8-cc32-4efd-8c1c-9084c996edde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:42.928092 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f74faac8-cc32-4efd-8c1c-9084c996edde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:42.931216 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d02077-0f2e-4e09-a2af-6f5c00f2dd2c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:42.941579 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72495039-4eeb-413a-97cb-5e8020c1edee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:42.942392 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72495039-4eeb-413a-97cb-5e8020c1edee admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:42.942826 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72495039-4eeb-413a-97cb-5e8020c1edee admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:42.944180 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72495039-4eeb-413a-97cb-5e8020c1edee admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:42.946404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72495039-4eeb-413a-97cb-5e8020c1edee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:42.951773 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72495039-4eeb-413a-97cb-5e8020c1edee admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:42.965899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 993/2024] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:42.967362 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72495039-4eeb-413a-97cb-5e8020c1edee admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:42.969339 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-72495039-4eeb-413a-97cb-5e8020c1edee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:42.986571 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72495039-4eeb-413a-97cb-5e8020c1edee admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:42.992637 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306111e-a315-4d27-a5cc-2ccff9baee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:42.993799 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306111e-a315-4d27-a5cc-2ccff9baee7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:42.994132 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306111e-a315-4d27-a5cc-2ccff9baee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:42.994900 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306111e-a315-4d27-a5cc-2ccff9baee7e admin admin] PATH_INFO: `/v3/users/21ef846dea454c15bd582c6bf018290e` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:42.995651 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306111e-a315-4d27-a5cc-2ccff9baee7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=21ef846dea454c15bd582c6bf018290e)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:42.997635 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306111e-a315-4d27-a5cc-2ccff9baee7e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:43.041147 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74faac8-cc32-4efd-8c1c-9084c996edde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:43.043371 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74faac8-cc32-4efd-8c1c-9084c996edde service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:43.064392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1032/2025] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:43.065314 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74faac8-cc32-4efd-8c1c-9084c996edde service nova] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:43.089884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74faac8-cc32-4efd-8c1c-9084c996edde service nova] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:43.091896 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c306111e-a315-4d27-a5cc-2ccff9baee7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21ef846dea454c15bd582c6bf018290e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:43.095914 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe46475-1556-460a-aa77-d287bc1054e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:43.097876 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46475-1556-460a-aa77-d287bc1054e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:43.098161 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46475-1556-460a-aa77-d287bc1054e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:43.098440 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe46475-1556-460a-aa77-d287bc1054e9 admin admin] PATH_INFO: `/v3/projects/02653989b37f4e7b9072a938dbd0ab19/users/4b9664f5f2c8420c81cc95e572efb0b2/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:43.110520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c306111e-a315-4d27-a5cc-2ccff9baee7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21ef846dea454c15bd582c6bf018290e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:43.111462 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c306111e-a315-4d27-a5cc-2ccff9baee7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21ef846dea454c15bd582c6bf018290e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:43.127637 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c306111e-a315-4d27-a5cc-2ccff9baee7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21ef846dea454c15bd582c6bf018290e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:43.133590 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe46475-1556-460a-aa77-d287bc1054e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02653989b37f4e7b9072a938dbd0ab19, user_id=4b9664f5f2c8420c81cc95e572efb0b2, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:43.138637 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe46475-1556-460a-aa77-d287bc1054e9 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:43.157709 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c306111e-a315-4d27-a5cc-2ccff9baee7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21ef846dea454c15bd582c6bf018290e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:43.165291 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 994/2026] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:42 2022] DELETE /identity/v3/users/21ef846dea454c15bd582c6bf018290e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:43.176047 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1033/2027] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:43 2022] PUT /identity/v3/projects/02653989b37f4e7b9072a938dbd0ab19/users/4b9664f5f2c8420c81cc95e572efb0b2/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:43.183371 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306111e-a315-4d27-a5cc-2ccff9baee7e admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:43.185017 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c306111e-a315-4d27-a5cc-2ccff9baee7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:43.282252 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306111e-a315-4d27-a5cc-2ccff9baee7e admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:43.295658 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5706f36-9c7a-4387-8188-a73a6e3e4179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:43.299301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5706f36-9c7a-4387-8188-a73a6e3e4179 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:43.299641 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5706f36-9c7a-4387-8188-a73a6e3e4179 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:43.299926 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5706f36-9c7a-4387-8188-a73a6e3e4179 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:43.303835 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5706f36-9c7a-4387-8188-a73a6e3e4179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:43.305458 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5706f36-9c7a-4387-8188-a73a6e3e4179 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:43.328351 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 995/2028] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:43.332212 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe46475-1556-460a-aa77-d287bc1054e9 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:43.470115 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe46475-1556-460a-aa77-d287bc1054e9 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:43.482020 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bfa9a-92cd-463d-b740-25797166b1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:43.482980 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bfa9a-92cd-463d-b740-25797166b1ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:43.483309 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bfa9a-92cd-463d-b740-25797166b1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:43.483661 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1bfa9a-92cd-463d-b740-25797166b1ed admin admin] PATH_INFO: `/v3/projects/02653989b37f4e7b9072a938dbd0ab19/users/4b9664f5f2c8420c81cc95e572efb0b2/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:43.485681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bfa9a-92cd-463d-b740-25797166b1ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=02653989b37f4e7b9072a938dbd0ab19, user_id=4b9664f5f2c8420c81cc95e572efb0b2, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:43.491339 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1bfa9a-92cd-463d-b740-25797166b1ed admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:43.509427 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1034/2029] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:43 2022] PUT /identity/v3/projects/02653989b37f4e7b9072a938dbd0ab19/users/4b9664f5f2c8420c81cc95e572efb0b2/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:43.520813 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf10887-0696-41bb-92ae-329854c23505 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:43.521309 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf10887-0696-41bb-92ae-329854c23505 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:43.521703 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf10887-0696-41bb-92ae-329854c23505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:43.559337 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bfa9a-92cd-463d-b740-25797166b1ed admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:43.562447 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-bb1bfa9a-92cd-463d-b740-25797166b1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:43.623341 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-bdf10887-0696-41bb-92ae-329854c23505 None None] MFA Rules not processed for user `4b9664f5f2c8420c81cc95e572efb0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:43.625903 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bdf10887-0696-41bb-92ae-329854c23505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:43.776661 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1bfa9a-92cd-463d-b740-25797166b1ed admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:43.794570 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4e58e-550e-46b5-9758-0791f9ecc332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:43.795362 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4e58e-550e-46b5-9758-0791f9ecc332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:43.795611 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4e58e-550e-46b5-9758-0791f9ecc332 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:43.796399 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4e58e-550e-46b5-9758-0791f9ecc332 admin admin] PATH_INFO: `/v3/projects/8969123badd74a6faeb86c97bda6710b` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:43.797754 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4e58e-550e-46b5-9758-0791f9ecc332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8969123badd74a6faeb86c97bda6710b)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:43.800592 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d4e58e-550e-46b5-9758-0791f9ecc332 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:43.871521 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 996/2030] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:43.908717 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf10887-0696-41bb-92ae-329854c23505 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:43.910432 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bdf10887-0696-41bb-92ae-329854c23505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:43.922394 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-17d4e58e-550e-46b5-9758-0791f9ecc332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8969123badd74a6faeb86c97bda6710b', 'request_id': 'req-17d4e58e-550e-46b5-9758-0791f9ecc332'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:43.938800 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-17d4e58e-550e-46b5-9758-0791f9ecc332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8969123badd74a6faeb86c97bda6710b', 'request_id': 'req-17d4e58e-550e-46b5-9758-0791f9ecc332'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:43.951957 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-17d4e58e-550e-46b5-9758-0791f9ecc332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8969123badd74a6faeb86c97bda6710b', 'request_id': 'req-17d4e58e-550e-46b5-9758-0791f9ecc332'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:43.984439 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-17d4e58e-550e-46b5-9758-0791f9ecc332 admin admin] The token cache is being invalidate because project 8969123badd74a6faeb86c97bda6710b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:43.985778 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-17d4e58e-550e-46b5-9758-0791f9ecc332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:43.987352 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-17d4e58e-550e-46b5-9758-0791f9ecc332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:43.991648 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1035/2031] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:43 2022] DELETE /identity/v3/projects/8969123badd74a6faeb86c97bda6710b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:44.000834 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12ea4a-1f0b-459f-90f8-85ae3fe7a631 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:44.000834 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12ea4a-1f0b-459f-90f8-85ae3fe7a631 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:44.000834 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12ea4a-1f0b-459f-90f8-85ae3fe7a631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:44.072807 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-3e12ea4a-1f0b-459f-90f8-85ae3fe7a631 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:44.077922 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3e12ea4a-1f0b-459f-90f8-85ae3fe7a631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:44.085932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf10887-0696-41bb-92ae-329854c23505 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:44.218899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d4dcc-0227-4055-b743-2ed50e6c1772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:44.219913 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d4dcc-0227-4055-b743-2ed50e6c1772 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:44.220207 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d4dcc-0227-4055-b743-2ed50e6c1772 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:44.220536 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5d4dcc-0227-4055-b743-2ed50e6c1772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:44.223082 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1036/2032] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:44.229120 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4a5d4dcc-0227-4055-b743-2ed50e6c1772 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:44.231594 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059003a3-9e9a-4157-939c-f55ce5110320 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:44.231891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059003a3-9e9a-4157-939c-f55ce5110320 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:44.232255 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059003a3-9e9a-4157-939c-f55ce5110320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:44.260001 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-059003a3-9e9a-4157-939c-f55ce5110320 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:44.262271 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-059003a3-9e9a-4157-939c-f55ce5110320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:44.287380 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1037/2033] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:44.290184 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059003a3-9e9a-4157-939c-f55ce5110320 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:44.299494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059003a3-9e9a-4157-939c-f55ce5110320 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:44.308599 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b1642-898a-4238-8aa9-b94736c8adb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:44.310392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b1642-898a-4238-8aa9-b94736c8adb6 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:44.310885 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b1642-898a-4238-8aa9-b94736c8adb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:44.313234 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b1642-898a-4238-8aa9-b94736c8adb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:44.314882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b1642-898a-4238-8aa9-b94736c8adb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:51:44.315334 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b1642-898a-4238-8aa9-b94736c8adb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:44.317178 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826b1642-898a-4238-8aa9-b94736c8adb6 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:44.336698 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d4dcc-0227-4055-b743-2ed50e6c1772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:44.339013 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1038/2034] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:51:44.340280 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5d4dcc-0227-4055-b743-2ed50e6c1772 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:44.342299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b1642-898a-4238-8aa9-b94736c8adb6 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:44.366552 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b1642-898a-4238-8aa9-b94736c8adb6 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:44.368666 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 997/2035] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:51:44.377588 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f568d-fee0-42c9-bee0-dac8eaa405f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:44.378228 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f568d-fee0-42c9-bee0-dac8eaa405f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:44.378564 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f568d-fee0-42c9-bee0-dac8eaa405f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:44.378867 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f568d-fee0-42c9-bee0-dac8eaa405f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:44.379550 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f568d-fee0-42c9-bee0-dac8eaa405f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:44.381523 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f568d-fee0-42c9-bee0-dac8eaa405f7 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:44.424659 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1039/2036] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:44 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:44.428503 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d4dcc-0227-4055-b743-2ed50e6c1772 service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:44.446971 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5d4dcc-0227-4055-b743-2ed50e6c1772 service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:44.449998 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f568d-fee0-42c9-bee0-dac8eaa405f7 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:44.451762 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-509f568d-fee0-42c9-bee0-dac8eaa405f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:44.545976 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6d861-1ee5-44b5-99f8-57b807f021bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:44.546901 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6d861-1ee5-44b5-99f8-57b807f021bf admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:44.547044 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6d861-1ee5-44b5-99f8-57b807f021bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:44.547329 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f6d861-1ee5-44b5-99f8-57b807f021bf admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:44.548030 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f6d861-1ee5-44b5-99f8-57b807f021bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:44.550173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f6d861-1ee5-44b5-99f8-57b807f021bf admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:44.559811 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f568d-fee0-42c9-bee0-dac8eaa405f7 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:44.564779 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96d4c0d-234b-4db1-923d-9c8f760a3796 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:44.565281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d4c0d-234b-4db1-923d-9c8f760a3796 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:44.565674 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d4c0d-234b-4db1-923d-9c8f760a3796 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:44.566064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96d4c0d-234b-4db1-923d-9c8f760a3796 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:44.569041 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d96d4c0d-234b-4db1-923d-9c8f760a3796 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:44.578219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 998/2037] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:44 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:44.582241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6d861-1ee5-44b5-99f8-57b807f021bf admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:44.598066 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f6d861-1ee5-44b5-99f8-57b807f021bf admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:44.603190 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755598ce-4b52-4a57-86c3-7212e1ffe697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:44.603862 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755598ce-4b52-4a57-86c3-7212e1ffe697 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:44.604140 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755598ce-4b52-4a57-86c3-7212e1ffe697 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:44.604410 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755598ce-4b52-4a57-86c3-7212e1ffe697 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:44.605226 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755598ce-4b52-4a57-86c3-7212e1ffe697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:44.606734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755598ce-4b52-4a57-86c3-7212e1ffe697 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:44.621206 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 999/2038] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:44.622836 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755598ce-4b52-4a57-86c3-7212e1ffe697 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:44.635028 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755598ce-4b52-4a57-86c3-7212e1ffe697 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:44.641676 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4f218-db84-47bf-8b21-21968e72345c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:44.641850 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4f218-db84-47bf-8b21-21968e72345c admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:44.642828 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4f218-db84-47bf-8b21-21968e72345c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:44.642828 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c4f218-db84-47bf-8b21-21968e72345c admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:44.643237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4f218-db84-47bf-8b21-21968e72345c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:44.644842 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c4f218-db84-47bf-8b21-21968e72345c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:44.674649 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1000/2039] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:44.676378 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4f218-db84-47bf-8b21-21968e72345c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:44.685978 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d4c0d-234b-4db1-923d-9c8f760a3796 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:44.689340 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96d4c0d-234b-4db1-923d-9c8f760a3796 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:44.693590 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c4f218-db84-47bf-8b21-21968e72345c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:44.703036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24880b83-278a-4d6f-a352-1a95a84ae25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:44.708714 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24880b83-278a-4d6f-a352-1a95a84ae25b admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:44.709084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24880b83-278a-4d6f-a352-1a95a84ae25b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:44.709367 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24880b83-278a-4d6f-a352-1a95a84ae25b admin admin] PATH_INFO: `/v3/projects/b79bfd7611ff47ab8b45805def42c0ce/users/ee7eab7b4e9b4f08898974a4e459c9f3/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:44.710144 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1040/2040] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:51:44.729096 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24880b83-278a-4d6f-a352-1a95a84ae25b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79bfd7611ff47ab8b45805def42c0ce, user_id=ee7eab7b4e9b4f08898974a4e459c9f3, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:44.732821 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24880b83-278a-4d6f-a352-1a95a84ae25b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:44.782548 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf890af-3546-468d-bb8b-5f02aa90f8ae None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:44.782996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf890af-3546-468d-bb8b-5f02aa90f8ae None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:44.783312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf890af-3546-468d-bb8b-5f02aa90f8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:44.786670 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1001/2041] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:44 2022] PUT /identity/v3/projects/b79bfd7611ff47ab8b45805def42c0ce/users/ee7eab7b4e9b4f08898974a4e459c9f3/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:44.848496 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-bcf890af-3546-468d-bb8b-5f02aa90f8ae None None] MFA Rules not processed for user `ee7eab7b4e9b4f08898974a4e459c9f3`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:44.850482 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-bcf890af-3546-468d-bb8b-5f02aa90f8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:44.957710 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24880b83-278a-4d6f-a352-1a95a84ae25b admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:44.972144 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1041/2042] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:45.093299 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24880b83-278a-4d6f-a352-1a95a84ae25b admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:45.098932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432753b-7581-4cf4-98be-05ff61451bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:45.100132 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432753b-7581-4cf4-98be-05ff61451bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:45.100621 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432753b-7581-4cf4-98be-05ff61451bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:45.101090 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432753b-7581-4cf4-98be-05ff61451bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:45.102056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432753b-7581-4cf4-98be-05ff61451bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:45.108726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432753b-7581-4cf4-98be-05ff61451bd4 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:45.169707 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1002/2043] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:44 2022] POST /identity/v3/projects => generated 383 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:45.176097 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf890af-3546-468d-bb8b-5f02aa90f8ae None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:45.210395 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf890af-3546-468d-bb8b-5f02aa90f8ae None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:45.339680 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6af73a-0e3e-446c-94bf-7490302e85dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:45.341651 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6af73a-0e3e-446c-94bf-7490302e85dc admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:45.342129 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6af73a-0e3e-446c-94bf-7490302e85dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:45.342675 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6af73a-0e3e-446c-94bf-7490302e85dc admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:45.343573 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6af73a-0e3e-446c-94bf-7490302e85dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:45.346630 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6af73a-0e3e-446c-94bf-7490302e85dc admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:45.377046 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b625b-cd77-40d9-a3a6-becd43f12690 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:45.377490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b625b-cd77-40d9-a3a6-becd43f12690 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:45.377575 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442b625b-cd77-40d9-a3a6-becd43f12690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:45.407394 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-442b625b-cd77-40d9-a3a6-becd43f12690 None None] MFA Rules not processed for user `a0721ecc1e5c4953aabac3fdad59b261`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:45.408768 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-442b625b-cd77-40d9-a3a6-becd43f12690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:45.427207 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1042/2044] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:45 2022] POST /identity/v3/users => generated 298 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:45.428188 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6af73a-0e3e-446c-94bf-7490302e85dc admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:45.441103 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6af73a-0e3e-446c-94bf-7490302e85dc admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:45.446026 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24774404-e4dc-433d-b62b-121063e14991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:45.446750 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24774404-e4dc-433d-b62b-121063e14991 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:45.447033 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24774404-e4dc-433d-b62b-121063e14991 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:45.447312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24774404-e4dc-433d-b62b-121063e14991 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:45.448076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24774404-e4dc-433d-b62b-121063e14991 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:45.449688 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24774404-e4dc-433d-b62b-121063e14991 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:45.461651 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1043/2045] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:45.465714 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24774404-e4dc-433d-b62b-121063e14991 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:45.476155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24774404-e4dc-433d-b62b-121063e14991 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:45.480728 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c7115-1a9d-41e7-aed5-ed047da56002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:45.481020 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1003/2046] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:45.483985 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c7115-1a9d-41e7-aed5-ed047da56002 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:45.484401 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c7115-1a9d-41e7-aed5-ed047da56002 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:45.484684 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c7115-1a9d-41e7-aed5-ed047da56002 admin admin] PATH_INFO: `/v3/projects/c338e96613f9470d867eb861ae212f35/users/1a69ece2e605409ca3eabf66ccce7c0d/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:45.499801 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c7115-1a9d-41e7-aed5-ed047da56002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c338e96613f9470d867eb861ae212f35, user_id=1a69ece2e605409ca3eabf66ccce7c0d, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:45.502428 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c7115-1a9d-41e7-aed5-ed047da56002 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:45.521007 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1044/2047] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:45 2022] PUT /identity/v3/projects/c338e96613f9470d867eb861ae212f35/users/1a69ece2e605409ca3eabf66ccce7c0d/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:45.526154 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b625b-cd77-40d9-a3a6-becd43f12690 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:45.538376 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442b625b-cd77-40d9-a3a6-becd43f12690 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:45.605102 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4feaf-1a45-48c8-8d43-9e42aa691617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:45.605769 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4feaf-1a45-48c8-8d43-9e42aa691617 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:45.606048 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4feaf-1a45-48c8-8d43-9e42aa691617 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:45.606316 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4feaf-1a45-48c8-8d43-9e42aa691617 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:45.607116 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4feaf-1a45-48c8-8d43-9e42aa691617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:45.609293 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4feaf-1a45-48c8-8d43-9e42aa691617 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:45.618970 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1004/2048] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:45.623168 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c7115-1a9d-41e7-aed5-ed047da56002 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:45.633934 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c7115-1a9d-41e7-aed5-ed047da56002 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:45.639184 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a5ddf-55b1-4f53-b7c0-34b88a58a7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:45.640606 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a5ddf-55b1-4f53-b7c0-34b88a58a7b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:45.640884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a5ddf-55b1-4f53-b7c0-34b88a58a7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:45.641157 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a5ddf-55b1-4f53-b7c0-34b88a58a7b8 admin admin] PATH_INFO: `/v3/projects/c338e96613f9470d867eb861ae212f35/users/1a69ece2e605409ca3eabf66ccce7c0d/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:45.643119 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a5ddf-55b1-4f53-b7c0-34b88a58a7b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c338e96613f9470d867eb861ae212f35, user_id=1a69ece2e605409ca3eabf66ccce7c0d, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:45.645777 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a5ddf-55b1-4f53-b7c0-34b88a58a7b8 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:45.655930 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1045/2049] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:45 2022] PUT /identity/v3/projects/c338e96613f9470d867eb861ae212f35/users/1a69ece2e605409ca3eabf66ccce7c0d/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:45.666851 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555925d-a2e9-4990-986d-77bc6fbcf052 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:45.667301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555925d-a2e9-4990-986d-77bc6fbcf052 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:45.667727 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555925d-a2e9-4990-986d-77bc6fbcf052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:45.694831 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-0555925d-a2e9-4990-986d-77bc6fbcf052 None None] MFA Rules not processed for user `1a69ece2e605409ca3eabf66ccce7c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:45.696061 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0555925d-a2e9-4990-986d-77bc6fbcf052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:45.760808 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1005/2050] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:45 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:45.772133 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a5ddf-55b1-4f53-b7c0-34b88a58a7b8 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:45.826162 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a5ddf-55b1-4f53-b7c0-34b88a58a7b8 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:45.831158 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ad0f5-2aa0-4869-9d98-da02e77d9a8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:45.831823 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ad0f5-2aa0-4869-9d98-da02e77d9a8d service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:45.832104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ad0f5-2aa0-4869-9d98-da02e77d9a8d service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:45.832380 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ad0f5-2aa0-4869-9d98-da02e77d9a8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:45.842811 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ad0f5-2aa0-4869-9d98-da02e77d9a8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:45.844466 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ad0f5-2aa0-4869-9d98-da02e77d9a8d service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:45.854287 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1046/2051] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:46.002697 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555925d-a2e9-4990-986d-77bc6fbcf052 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:46.011958 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555925d-a2e9-4990-986d-77bc6fbcf052 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:46.015490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e74a03-93ce-4945-86f6-0325f4706169 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:46.016114 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e74a03-93ce-4945-86f6-0325f4706169 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:46.016392 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e74a03-93ce-4945-86f6-0325f4706169 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:46.016666 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e74a03-93ce-4945-86f6-0325f4706169 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:46.069805 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e74a03-93ce-4945-86f6-0325f4706169 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:46.071250 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e74a03-93ce-4945-86f6-0325f4706169 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:46.079813 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1006/2052] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:50.749210 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ad0f5-2aa0-4869-9d98-da02e77d9a8d service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:50.809464 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ad0f5-2aa0-4869-9d98-da02e77d9a8d service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:50.813978 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe3a4a-dc3b-45f0-9179-969503d12488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:50.814868 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe3a4a-dc3b-45f0-9179-969503d12488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:50.815155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe3a4a-dc3b-45f0-9179-969503d12488 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:50.815433 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe3a4a-dc3b-45f0-9179-969503d12488 admin admin] PATH_INFO: `/v3/users/ee7eab7b4e9b4f08898974a4e459c9f3` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:50.816608 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe3a4a-dc3b-45f0-9179-969503d12488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee7eab7b4e9b4f08898974a4e459c9f3)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:50.818545 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fe3a4a-dc3b-45f0-9179-969503d12488 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:50.863999 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-33fe3a4a-dc3b-45f0-9179-969503d12488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee7eab7b4e9b4f08898974a4e459c9f3'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:50.864646 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-33fe3a4a-dc3b-45f0-9179-969503d12488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee7eab7b4e9b4f08898974a4e459c9f3'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:50.871860 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-33fe3a4a-dc3b-45f0-9179-969503d12488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee7eab7b4e9b4f08898974a4e459c9f3'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:50.879741 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-33fe3a4a-dc3b-45f0-9179-969503d12488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee7eab7b4e9b4f08898974a4e459c9f3'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:50.891720 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-33fe3a4a-dc3b-45f0-9179-969503d12488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee7eab7b4e9b4f08898974a4e459c9f3'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:50.898212 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1047/2053] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:50 2022] DELETE /identity/v3/users/ee7eab7b4e9b4f08898974a4e459c9f3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:50.902571 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14eaed-c37b-4ddb-8989-a501be900fe5 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:50.903001 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14eaed-c37b-4ddb-8989-a501be900fe5 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:50.903255 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14eaed-c37b-4ddb-8989-a501be900fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:50.924913 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-0a14eaed-c37b-4ddb-8989-a501be900fe5 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:50.926375 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0a14eaed-c37b-4ddb-8989-a501be900fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:51.005096 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1007/2054] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:51.015395 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe3a4a-dc3b-45f0-9179-969503d12488 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:51.017783 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-33fe3a4a-dc3b-45f0-9179-969503d12488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:51.097228 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fe3a4a-dc3b-45f0-9179-969503d12488 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:51.102935 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbab36-8b7f-4902-a956-67987b1eec4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:51.104312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbab36-8b7f-4902-a956-67987b1eec4b service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:51.104670 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbab36-8b7f-4902-a956-67987b1eec4b service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:51.105014 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbab36-8b7f-4902-a956-67987b1eec4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:51.116670 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbab36-8b7f-4902-a956-67987b1eec4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:51.118105 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbab36-8b7f-4902-a956-67987b1eec4b service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:51.129041 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1048/2055] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:51.419235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14eaed-c37b-4ddb-8989-a501be900fe5 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:51.421296 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0a14eaed-c37b-4ddb-8989-a501be900fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:51.433725 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14eaed-c37b-4ddb-8989-a501be900fe5 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:51.438946 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997e8d3-71d0-4700-bbd4-16bc5b6ed7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:51.439837 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997e8d3-71d0-4700-bbd4-16bc5b6ed7c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:51.440116 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997e8d3-71d0-4700-bbd4-16bc5b6ed7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:51.440388 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9997e8d3-71d0-4700-bbd4-16bc5b6ed7c4 admin admin] PATH_INFO: `/v3/projects/b79bfd7611ff47ab8b45805def42c0ce` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:51.441717 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997e8d3-71d0-4700-bbd4-16bc5b6ed7c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b79bfd7611ff47ab8b45805def42c0ce)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:51.443672 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9997e8d3-71d0-4700-bbd4-16bc5b6ed7c4 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:51.494682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9997e8d3-71d0-4700-bbd4-16bc5b6ed7c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b79bfd7611ff47ab8b45805def42c0ce', 'request_id': 'req-9997e8d3-71d0-4700-bbd4-16bc5b6ed7c4'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.499733 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9997e8d3-71d0-4700-bbd4-16bc5b6ed7c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b79bfd7611ff47ab8b45805def42c0ce', 'request_id': 'req-9997e8d3-71d0-4700-bbd4-16bc5b6ed7c4'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.505596 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9997e8d3-71d0-4700-bbd4-16bc5b6ed7c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b79bfd7611ff47ab8b45805def42c0ce', 'request_id': 'req-9997e8d3-71d0-4700-bbd4-16bc5b6ed7c4'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.518885 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9997e8d3-71d0-4700-bbd4-16bc5b6ed7c4 admin admin] The token cache is being invalidate because project b79bfd7611ff47ab8b45805def42c0ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:51.519169 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9997e8d3-71d0-4700-bbd4-16bc5b6ed7c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.519784 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9997e8d3-71d0-4700-bbd4-16bc5b6ed7c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.521506 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1008/2056] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:51 2022] DELETE /identity/v3/projects/b79bfd7611ff47ab8b45805def42c0ce => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:51.525348 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbab36-8b7f-4902-a956-67987b1eec4b service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:51.535386 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbab36-8b7f-4902-a956-67987b1eec4b service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:51.593190 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5600055a-27c0-4c52-ac71-8ec025d7cfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:51.594098 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600055a-27c0-4c52-ac71-8ec025d7cfe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:51.594378 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600055a-27c0-4c52-ac71-8ec025d7cfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:51.594681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5600055a-27c0-4c52-ac71-8ec025d7cfe2 admin admin] PATH_INFO: `/v3/users/1a69ece2e605409ca3eabf66ccce7c0d` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:51.596087 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600055a-27c0-4c52-ac71-8ec025d7cfe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a69ece2e605409ca3eabf66ccce7c0d)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:51.597939 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5600055a-27c0-4c52-ac71-8ec025d7cfe2 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:51.652704 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5600055a-27c0-4c52-ac71-8ec025d7cfe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a69ece2e605409ca3eabf66ccce7c0d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.653917 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5600055a-27c0-4c52-ac71-8ec025d7cfe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a69ece2e605409ca3eabf66ccce7c0d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.662918 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5600055a-27c0-4c52-ac71-8ec025d7cfe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a69ece2e605409ca3eabf66ccce7c0d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.671927 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5600055a-27c0-4c52-ac71-8ec025d7cfe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a69ece2e605409ca3eabf66ccce7c0d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.689340 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997e8d3-71d0-4700-bbd4-16bc5b6ed7c4 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:51.690985 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9997e8d3-71d0-4700-bbd4-16bc5b6ed7c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:51.695113 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5600055a-27c0-4c52-ac71-8ec025d7cfe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a69ece2e605409ca3eabf66ccce7c0d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.702670 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1049/2057] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:51 2022] DELETE /identity/v3/users/1a69ece2e605409ca3eabf66ccce7c0d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:51.705271 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9997e8d3-71d0-4700-bbd4-16bc5b6ed7c4 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:51.775230 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff86e0-a271-43a8-b29b-20986bce985c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:51.776114 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff86e0-a271-43a8-b29b-20986bce985c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:51.776405 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff86e0-a271-43a8-b29b-20986bce985c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:51.776666 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff86e0-a271-43a8-b29b-20986bce985c admin admin] PATH_INFO: `/v3/users/1c29820c6d754148b0677d9065ec9871` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:51.777911 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff86e0-a271-43a8-b29b-20986bce985c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c29820c6d754148b0677d9065ec9871)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:51.780604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff86e0-a271-43a8-b29b-20986bce985c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:51.828189 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-44ff86e0-a271-43a8-b29b-20986bce985c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c29820c6d754148b0677d9065ec9871'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.835278 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-44ff86e0-a271-43a8-b29b-20986bce985c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c29820c6d754148b0677d9065ec9871'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.835979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-44ff86e0-a271-43a8-b29b-20986bce985c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c29820c6d754148b0677d9065ec9871'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.843510 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-44ff86e0-a271-43a8-b29b-20986bce985c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c29820c6d754148b0677d9065ec9871'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.855461 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-44ff86e0-a271-43a8-b29b-20986bce985c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c29820c6d754148b0677d9065ec9871'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:51.864238 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1009/2058] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:51 2022] DELETE /identity/v3/users/1c29820c6d754148b0677d9065ec9871 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:51.869516 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389609f-65be-45f2-9941-477273ae74d0 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:51.870420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389609f-65be-45f2-9941-477273ae74d0 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:51.875815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389609f-65be-45f2-9941-477273ae74d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:51.894819 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-9389609f-65be-45f2-9941-477273ae74d0 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:51.896050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9389609f-65be-45f2-9941-477273ae74d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:51.959905 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1050/2059] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:51.971230 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff86e0-a271-43a8-b29b-20986bce985c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:51.973550 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-44ff86e0-a271-43a8-b29b-20986bce985c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:51.996248 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389609f-65be-45f2-9941-477273ae74d0 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:51.997350 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9389609f-65be-45f2-9941-477273ae74d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:52.013906 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389609f-65be-45f2-9941-477273ae74d0 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:52.020058 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74807e-ae17-4d5d-9951-48285da84ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:52.021564 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74807e-ae17-4d5d-9951-48285da84ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.022023 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74807e-ae17-4d5d-9951-48285da84ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.022467 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74807e-ae17-4d5d-9951-48285da84ce2 admin admin] PATH_INFO: `/v3/projects/c338e96613f9470d867eb861ae212f35` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.023732 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74807e-ae17-4d5d-9951-48285da84ce2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c338e96613f9470d867eb861ae212f35)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:52.025857 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74807e-ae17-4d5d-9951-48285da84ce2 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:52.043584 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff86e0-a271-43a8-b29b-20986bce985c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:52.047931 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ffcb0e-34cd-477e-abeb-426a8b61894a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:52.048641 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffcb0e-34cd-477e-abeb-426a8b61894a service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.048923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffcb0e-34cd-477e-abeb-426a8b61894a service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.049196 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ffcb0e-34cd-477e-abeb-426a8b61894a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.058486 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffcb0e-34cd-477e-abeb-426a8b61894a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:52.059930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ffcb0e-34cd-477e-abeb-426a8b61894a service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:52.071357 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1010/2060] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:51:52.086382 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-ae74807e-ae17-4d5d-9951-48285da84ce2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c338e96613f9470d867eb861ae212f35', 'request_id': 'req-ae74807e-ae17-4d5d-9951-48285da84ce2'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.092807 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-ae74807e-ae17-4d5d-9951-48285da84ce2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c338e96613f9470d867eb861ae212f35', 'request_id': 'req-ae74807e-ae17-4d5d-9951-48285da84ce2'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.099406 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-ae74807e-ae17-4d5d-9951-48285da84ce2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c338e96613f9470d867eb861ae212f35', 'request_id': 'req-ae74807e-ae17-4d5d-9951-48285da84ce2'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.113438 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-ae74807e-ae17-4d5d-9951-48285da84ce2 admin admin] The token cache is being invalidate because project c338e96613f9470d867eb861ae212f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:52.113755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-ae74807e-ae17-4d5d-9951-48285da84ce2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.114399 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-ae74807e-ae17-4d5d-9951-48285da84ce2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.116099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1051/2061] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:51 2022] DELETE /identity/v3/projects/c338e96613f9470d867eb861ae212f35 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:52.121312 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293af7e-e402-477c-96f8-ad7c19b1ea07 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.121623 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293af7e-e402-477c-96f8-ad7c19b1ea07 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.122066 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293af7e-e402-477c-96f8-ad7c19b1ea07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.142068 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-0293af7e-e402-477c-96f8-ad7c19b1ea07 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:52.144288 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0293af7e-e402-477c-96f8-ad7c19b1ea07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:52.229872 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1011/2062] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:52.238390 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669386f2-ccaa-4747-bef1-f6061a30c686 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.238959 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669386f2-ccaa-4747-bef1-f6061a30c686 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.239423 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669386f2-ccaa-4747-bef1-f6061a30c686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.266986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-669386f2-ccaa-4747-bef1-f6061a30c686 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:52.268656 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-669386f2-ccaa-4747-bef1-f6061a30c686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:52.279543 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1052/2063] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:52.283950 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293af7e-e402-477c-96f8-ad7c19b1ea07 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:52.307622 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293af7e-e402-477c-96f8-ad7c19b1ea07 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:52.318648 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766048b5-8f60-40c1-bd03-7194a5d1ba3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:52.319777 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766048b5-8f60-40c1-bd03-7194a5d1ba3a admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.320162 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766048b5-8f60-40c1-bd03-7194a5d1ba3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.320551 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766048b5-8f60-40c1-bd03-7194a5d1ba3a admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.321464 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766048b5-8f60-40c1-bd03-7194a5d1ba3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:51:52.321867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766048b5-8f60-40c1-bd03-7194a5d1ba3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:52.323666 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766048b5-8f60-40c1-bd03-7194a5d1ba3a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:52.342477 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1012/2064] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:51:52.346844 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669386f2-ccaa-4747-bef1-f6061a30c686 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:52.356571 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669386f2-ccaa-4747-bef1-f6061a30c686 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:52.385683 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bcd81-f0ea-4eb9-a534-cb0f9256b493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:52.386629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bcd81-f0ea-4eb9-a534-cb0f9256b493 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.387005 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bcd81-f0ea-4eb9-a534-cb0f9256b493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.387343 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bcd81-f0ea-4eb9-a534-cb0f9256b493 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.388101 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204bcd81-f0ea-4eb9-a534-cb0f9256b493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:52.390219 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204bcd81-f0ea-4eb9-a534-cb0f9256b493 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:52.428184 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766048b5-8f60-40c1-bd03-7194a5d1ba3a admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:52.432386 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1053/2065] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:52 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:52.432524 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-766048b5-8f60-40c1-bd03-7194a5d1ba3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:52.433380 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bcd81-f0ea-4eb9-a534-cb0f9256b493 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:52.448033 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766048b5-8f60-40c1-bd03-7194a5d1ba3a admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:52.523092 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54800bb-5914-4d9e-8b53-db8abaddac6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:52.524380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54800bb-5914-4d9e-8b53-db8abaddac6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.525127 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54800bb-5914-4d9e-8b53-db8abaddac6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.525631 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54800bb-5914-4d9e-8b53-db8abaddac6f admin admin] PATH_INFO: `/v3/projects/6c96bb56afea479dab18438ecd6db665` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.531531 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54800bb-5914-4d9e-8b53-db8abaddac6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c96bb56afea479dab18438ecd6db665)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:52.533860 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54800bb-5914-4d9e-8b53-db8abaddac6f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:52.538005 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bcd81-f0ea-4eb9-a534-cb0f9256b493 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:52.543749 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e56af9-7681-4ec7-993d-754da427984b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:52.544489 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e56af9-7681-4ec7-993d-754da427984b admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.544847 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e56af9-7681-4ec7-993d-754da427984b admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.545230 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e56af9-7681-4ec7-993d-754da427984b admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.546808 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e56af9-7681-4ec7-993d-754da427984b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:52.549268 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e56af9-7681-4ec7-993d-754da427984b admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:52.576111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1054/2066] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:52 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:52.579971 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e56af9-7681-4ec7-993d-754da427984b admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:52.590382 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e56af9-7681-4ec7-993d-754da427984b admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:52.604263 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b54800bb-5914-4d9e-8b53-db8abaddac6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c96bb56afea479dab18438ecd6db665', 'request_id': 'req-b54800bb-5914-4d9e-8b53-db8abaddac6f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.610028 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b54800bb-5914-4d9e-8b53-db8abaddac6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c96bb56afea479dab18438ecd6db665', 'request_id': 'req-b54800bb-5914-4d9e-8b53-db8abaddac6f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.616807 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b54800bb-5914-4d9e-8b53-db8abaddac6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c96bb56afea479dab18438ecd6db665', 'request_id': 'req-b54800bb-5914-4d9e-8b53-db8abaddac6f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.633613 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b54800bb-5914-4d9e-8b53-db8abaddac6f admin admin] The token cache is being invalidate because project 6c96bb56afea479dab18438ecd6db665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:52.633910 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b54800bb-5914-4d9e-8b53-db8abaddac6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.634660 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b54800bb-5914-4d9e-8b53-db8abaddac6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.641307 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1013/2067] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:52 2022] DELETE /identity/v3/projects/6c96bb56afea479dab18438ecd6db665 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:52.642155 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54800bb-5914-4d9e-8b53-db8abaddac6f admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:52.644188 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b54800bb-5914-4d9e-8b53-db8abaddac6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:52.665729 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be75d57-707f-46d5-909a-af1b1a12dd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:52.666380 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be75d57-707f-46d5-909a-af1b1a12dd28 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.667095 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be75d57-707f-46d5-909a-af1b1a12dd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.667095 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be75d57-707f-46d5-909a-af1b1a12dd28 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.671106 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be75d57-707f-46d5-909a-af1b1a12dd28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:52.673583 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be75d57-707f-46d5-909a-af1b1a12dd28 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:52.683992 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1055/2068] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:52.694645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be75d57-707f-46d5-909a-af1b1a12dd28 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:52.694645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-2be75d57-707f-46d5-909a-af1b1a12dd28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:52.704425 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be75d57-707f-46d5-909a-af1b1a12dd28 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:52.709135 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea634d3-af8b-4335-8b0a-faa8eafa67dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:52.709830 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea634d3-af8b-4335-8b0a-faa8eafa67dc admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.710116 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea634d3-af8b-4335-8b0a-faa8eafa67dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.710390 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea634d3-af8b-4335-8b0a-faa8eafa67dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.711142 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea634d3-af8b-4335-8b0a-faa8eafa67dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:52.712825 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea634d3-af8b-4335-8b0a-faa8eafa67dc admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:52.723520 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1056/2069] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:52.723873 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54800bb-5914-4d9e-8b53-db8abaddac6f admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:52.727646 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea634d3-af8b-4335-8b0a-faa8eafa67dc admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:52.728858 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12533e6a-6c4f-4353-80d7-187c1b79c285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:52.729840 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12533e6a-6c4f-4353-80d7-187c1b79c285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.730190 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12533e6a-6c4f-4353-80d7-187c1b79c285 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.730532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12533e6a-6c4f-4353-80d7-187c1b79c285 admin admin] PATH_INFO: `/v3/users/4b9664f5f2c8420c81cc95e572efb0b2` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.731784 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12533e6a-6c4f-4353-80d7-187c1b79c285 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b9664f5f2c8420c81cc95e572efb0b2)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:52.733726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12533e6a-6c4f-4353-80d7-187c1b79c285 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:52.737350 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea634d3-af8b-4335-8b0a-faa8eafa67dc admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:52.742290 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c75a5-2776-4913-ac7e-479961d75415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:52.743217 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c75a5-2776-4913-ac7e-479961d75415 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.743497 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c75a5-2776-4913-ac7e-479961d75415 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.743768 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c75a5-2776-4913-ac7e-479961d75415 admin admin] PATH_INFO: `/v3/projects/f35bb49a4c9e45e8982fdb9c74259d94/users/b2542fa823634708bf0feb52e6c42163/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.760600 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c75a5-2776-4913-ac7e-479961d75415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35bb49a4c9e45e8982fdb9c74259d94, user_id=b2542fa823634708bf0feb52e6c42163, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:52.763836 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c75a5-2776-4913-ac7e-479961d75415 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:52.778707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1057/2070] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:52 2022] PUT /identity/v3/projects/f35bb49a4c9e45e8982fdb9c74259d94/users/b2542fa823634708bf0feb52e6c42163/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:52.781144 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-12533e6a-6c4f-4353-80d7-187c1b79c285 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b9664f5f2c8420c81cc95e572efb0b2'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.790889 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f15b8-a2d2-4dcf-a163-17534a7c5fc5 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.791261 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f15b8-a2d2-4dcf-a163-17534a7c5fc5 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.791627 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f15b8-a2d2-4dcf-a163-17534a7c5fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.792211 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-12533e6a-6c4f-4353-80d7-187c1b79c285 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b9664f5f2c8420c81cc95e572efb0b2'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.792965 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-12533e6a-6c4f-4353-80d7-187c1b79c285 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b9664f5f2c8420c81cc95e572efb0b2'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.800099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-12533e6a-6c4f-4353-80d7-187c1b79c285 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b9664f5f2c8420c81cc95e572efb0b2'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.812114 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-12533e6a-6c4f-4353-80d7-187c1b79c285 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b9664f5f2c8420c81cc95e572efb0b2'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:52.818121 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-685f15b8-a2d2-4dcf-a163-17534a7c5fc5 None None] MFA Rules not processed for user `b2542fa823634708bf0feb52e6c42163`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:52.818304 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1014/2071] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:52 2022] DELETE /identity/v3/users/4b9664f5f2c8420c81cc95e572efb0b2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:52.820074 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-685f15b8-a2d2-4dcf-a163-17534a7c5fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:52.902495 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1058/2072] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:52.909565 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12533e6a-6c4f-4353-80d7-187c1b79c285 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:52.911166 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-12533e6a-6c4f-4353-80d7-187c1b79c285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:52.985765 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12533e6a-6c4f-4353-80d7-187c1b79c285 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:52.992868 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04256b-6d91-4933-bd5f-a655fe903c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:52.993541 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04256b-6d91-4933-bd5f-a655fe903c11 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:52.993817 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04256b-6d91-4933-bd5f-a655fe903c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:52.994251 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04256b-6d91-4933-bd5f-a655fe903c11 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:52.995135 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04256b-6d91-4933-bd5f-a655fe903c11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:52.997176 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04256b-6d91-4933-bd5f-a655fe903c11 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.026295 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1015/2073] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:52 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:53.027526 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f15b8-a2d2-4dcf-a163-17534a7c5fc5 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.038383 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f15b8-a2d2-4dcf-a163-17534a7c5fc5 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.096844 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a40a6-7d4e-4b7f-971c-c6bd46eaedc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.097673 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a40a6-7d4e-4b7f-971c-c6bd46eaedc9 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.097951 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a40a6-7d4e-4b7f-971c-c6bd46eaedc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.098228 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a40a6-7d4e-4b7f-971c-c6bd46eaedc9 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.098981 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a40a6-7d4e-4b7f-971c-c6bd46eaedc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.100869 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a40a6-7d4e-4b7f-971c-c6bd46eaedc9 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.124418 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1059/2074] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:53 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:51:53.127547 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04256b-6d91-4933-bd5f-a655fe903c11 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.127717 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a40a6-7d4e-4b7f-971c-c6bd46eaedc9 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.129537 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8c04256b-6d91-4933-bd5f-a655fe903c11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:53.138419 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a40a6-7d4e-4b7f-971c-c6bd46eaedc9 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.143747 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bd75f-2133-4fcf-9b12-a638753b54f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.149979 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bd75f-2133-4fcf-9b12-a638753b54f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.150210 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04256b-6d91-4933-bd5f-a655fe903c11 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.150294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bd75f-2133-4fcf-9b12-a638753b54f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.150294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bd75f-2133-4fcf-9b12-a638753b54f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.150294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7bd75f-2133-4fcf-9b12-a638753b54f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.150294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7bd75f-2133-4fcf-9b12-a638753b54f1 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.157084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ead1f0-d173-4519-87d6-9d5f89d83ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.157965 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ead1f0-d173-4519-87d6-9d5f89d83ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.158250 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ead1f0-d173-4519-87d6-9d5f89d83ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.158559 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ead1f0-d173-4519-87d6-9d5f89d83ef0 admin admin] PATH_INFO: `/v3/projects/02653989b37f4e7b9072a938dbd0ab19` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.163111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ead1f0-d173-4519-87d6-9d5f89d83ef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02653989b37f4e7b9072a938dbd0ab19)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.163397 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1060/2075] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:53.163480 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ead1f0-d173-4519-87d6-9d5f89d83ef0 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.163562 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bd75f-2133-4fcf-9b12-a638753b54f1 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.174186 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bd75f-2133-4fcf-9b12-a638753b54f1 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.178940 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a7e2b-0ed3-4b18-9bc9-2629fdc6ec81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.179784 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a7e2b-0ed3-4b18-9bc9-2629fdc6ec81 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.180062 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a7e2b-0ed3-4b18-9bc9-2629fdc6ec81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.180332 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a7e2b-0ed3-4b18-9bc9-2629fdc6ec81 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.181046 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a7e2b-0ed3-4b18-9bc9-2629fdc6ec81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.182638 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a7e2b-0ed3-4b18-9bc9-2629fdc6ec81 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.193278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1061/2076] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:53.197227 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a7e2b-0ed3-4b18-9bc9-2629fdc6ec81 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.206718 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a7e2b-0ed3-4b18-9bc9-2629fdc6ec81 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.210205 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e1ead1f0-d173-4519-87d6-9d5f89d83ef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02653989b37f4e7b9072a938dbd0ab19', 'request_id': 'req-e1ead1f0-d173-4519-87d6-9d5f89d83ef0'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:53.215666 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e1ead1f0-d173-4519-87d6-9d5f89d83ef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02653989b37f4e7b9072a938dbd0ab19', 'request_id': 'req-e1ead1f0-d173-4519-87d6-9d5f89d83ef0'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:53.223969 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e1ead1f0-d173-4519-87d6-9d5f89d83ef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02653989b37f4e7b9072a938dbd0ab19', 'request_id': 'req-e1ead1f0-d173-4519-87d6-9d5f89d83ef0'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:53.239770 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e1ead1f0-d173-4519-87d6-9d5f89d83ef0 admin admin] The token cache is being invalidate because project 02653989b37f4e7b9072a938dbd0ab19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:53.240131 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e1ead1f0-d173-4519-87d6-9d5f89d83ef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:53.240807 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e1ead1f0-d173-4519-87d6-9d5f89d83ef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:53.242391 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1016/2077] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:53 2022] DELETE /identity/v3/projects/02653989b37f4e7b9072a938dbd0ab19 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:53.247143 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015b52e-6daa-4678-8a8b-4ffb7f853929 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.247435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015b52e-6daa-4678-8a8b-4ffb7f853929 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.247712 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015b52e-6daa-4678-8a8b-4ffb7f853929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.265690 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-4015b52e-6daa-4678-8a8b-4ffb7f853929 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:53.267228 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4015b52e-6daa-4678-8a8b-4ffb7f853929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:53.269149 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072b821-4463-44db-af37-cbead4a4ee48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.270044 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072b821-4463-44db-af37-cbead4a4ee48 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.270350 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072b821-4463-44db-af37-cbead4a4ee48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.270690 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072b821-4463-44db-af37-cbead4a4ee48 admin admin] PATH_INFO: `/v3/projects/b8e5e7773689430ba505b5e439e3004b/users/3cccaa5084d748c4b32e5c86c1353f0d/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.275786 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1017/2078] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:53.288178 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf142c-c220-45d1-b548-47a783f86b91 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.288467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf142c-c220-45d1-b548-47a783f86b91 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.288747 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf142c-c220-45d1-b548-47a783f86b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.292721 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072b821-4463-44db-af37-cbead4a4ee48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e5e7773689430ba505b5e439e3004b, user_id=3cccaa5084d748c4b32e5c86c1353f0d, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.298638 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072b821-4463-44db-af37-cbead4a4ee48 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.308655 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-bbaf142c-c220-45d1-b548-47a783f86b91 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:53.309921 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bbaf142c-c220-45d1-b548-47a783f86b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:53.315479 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1062/2079] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:53 2022] PUT /identity/v3/projects/b8e5e7773689430ba505b5e439e3004b/users/3cccaa5084d748c4b32e5c86c1353f0d/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:53.326349 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a86d86-e347-409b-8b75-49ad4ae3c13d None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.327204 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a86d86-e347-409b-8b75-49ad4ae3c13d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.327486 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a86d86-e347-409b-8b75-49ad4ae3c13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.354023 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-b5a86d86-e347-409b-8b75-49ad4ae3c13d None None] MFA Rules not processed for user `3cccaa5084d748c4b32e5c86c1353f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:53.355261 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b5a86d86-e347-409b-8b75-49ad4ae3c13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:53.376029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1018/2080] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:53.380130 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf142c-c220-45d1-b548-47a783f86b91 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.388862 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf142c-c220-45d1-b548-47a783f86b91 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.400237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4752935-b070-4d87-b7d5-e6051407c203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.401286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4752935-b070-4d87-b7d5-e6051407c203 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.401573 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4752935-b070-4d87-b7d5-e6051407c203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.402194 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4752935-b070-4d87-b7d5-e6051407c203 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.405385 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4752935-b070-4d87-b7d5-e6051407c203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:51:53.405385 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4752935-b070-4d87-b7d5-e6051407c203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.407207 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4752935-b070-4d87-b7d5-e6051407c203 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.425381 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1019/2081] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:51:53.427582 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4752935-b070-4d87-b7d5-e6051407c203 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.435444 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1063/2082] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:53.439553 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a86d86-e347-409b-8b75-49ad4ae3c13d None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.441043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b5a86d86-e347-409b-8b75-49ad4ae3c13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:53.445365 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4752935-b070-4d87-b7d5-e6051407c203 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.452937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d83fa-49cb-4548-878e-f036fbb45c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.454021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d83fa-49cb-4548-878e-f036fbb45c26 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.454300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d83fa-49cb-4548-878e-f036fbb45c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.454577 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d83fa-49cb-4548-878e-f036fbb45c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.455295 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d83fa-49cb-4548-878e-f036fbb45c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.455868 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a86d86-e347-409b-8b75-49ad4ae3c13d None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.457327 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d83fa-49cb-4548-878e-f036fbb45c26 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.460434 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17a5b9-3dc4-468e-b945-894c3dcfe426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.461252 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17a5b9-3dc4-468e-b945-894c3dcfe426 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.461530 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17a5b9-3dc4-468e-b945-894c3dcfe426 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.461816 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17a5b9-3dc4-468e-b945-894c3dcfe426 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.462515 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17a5b9-3dc4-468e-b945-894c3dcfe426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.464420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17a5b9-3dc4-468e-b945-894c3dcfe426 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.490368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1020/2083] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:53 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:53.494241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d83fa-49cb-4548-878e-f036fbb45c26 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.501003 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1064/2084] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:53 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:53.505005 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17a5b9-3dc4-468e-b945-894c3dcfe426 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.567495 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d83fa-49cb-4548-878e-f036fbb45c26 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.582709 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17a5b9-3dc4-468e-b945-894c3dcfe426 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.588791 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ffafb-4aa1-49e4-af18-e2b09aae10eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.589699 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ffafb-4aa1-49e4-af18-e2b09aae10eb admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.590144 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ffafb-4aa1-49e4-af18-e2b09aae10eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.590655 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87ffafb-4aa1-49e4-af18-e2b09aae10eb admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.591617 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ffafb-4aa1-49e4-af18-e2b09aae10eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.594449 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87ffafb-4aa1-49e4-af18-e2b09aae10eb admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.615429 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1065/2085] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:53 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:51:53.622178 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ffafb-4aa1-49e4-af18-e2b09aae10eb admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.632312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87ffafb-4aa1-49e4-af18-e2b09aae10eb admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.639778 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e398e57-3646-406d-ac32-02733abf7ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.640543 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e398e57-3646-406d-ac32-02733abf7ffc admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.640978 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e398e57-3646-406d-ac32-02733abf7ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.641263 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e398e57-3646-406d-ac32-02733abf7ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.641563 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c737b27-bf6d-412e-9699-2a502e4d23a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.642287 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e398e57-3646-406d-ac32-02733abf7ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.642410 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c737b27-bf6d-412e-9699-2a502e4d23a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.642638 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c737b27-bf6d-412e-9699-2a502e4d23a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.642911 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c737b27-bf6d-412e-9699-2a502e4d23a7 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.643600 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c737b27-bf6d-412e-9699-2a502e4d23a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.643935 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e398e57-3646-406d-ac32-02733abf7ffc admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.645888 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c737b27-bf6d-412e-9699-2a502e4d23a7 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.658463 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1066/2086] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:53.659639 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e398e57-3646-406d-ac32-02733abf7ffc admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.671580 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e398e57-3646-406d-ac32-02733abf7ffc admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.671783 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1021/2087] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:53 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:51:53.671783 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c737b27-bf6d-412e-9699-2a502e4d23a7 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.677627 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca0eae-0922-4ed1-ba0f-e5d42c293ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.678618 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca0eae-0922-4ed1-ba0f-e5d42c293ac7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.679049 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca0eae-0922-4ed1-ba0f-e5d42c293ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.679420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca0eae-0922-4ed1-ba0f-e5d42c293ac7 admin admin] PATH_INFO: `/v3/projects/412eef641a574ff9a31726d06092b2c9/users/f25c436fccca4571a35c8fde70059540/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.682096 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c737b27-bf6d-412e-9699-2a502e4d23a7 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.688017 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce6387-1475-4c22-a008-2fedee5e4594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.688760 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce6387-1475-4c22-a008-2fedee5e4594 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.689109 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce6387-1475-4c22-a008-2fedee5e4594 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.689447 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce6387-1475-4c22-a008-2fedee5e4594 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.690241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce6387-1475-4c22-a008-2fedee5e4594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.692085 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce6387-1475-4c22-a008-2fedee5e4594 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.703475 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca0eae-0922-4ed1-ba0f-e5d42c293ac7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=412eef641a574ff9a31726d06092b2c9, user_id=f25c436fccca4571a35c8fde70059540, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.706279 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca0eae-0922-4ed1-ba0f-e5d42c293ac7 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.711061 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1022/2088] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:53.715704 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce6387-1475-4c22-a008-2fedee5e4594 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.728101 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce6387-1475-4c22-a008-2fedee5e4594 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.736640 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1067/2089] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:53 2022] PUT /identity/v3/projects/412eef641a574ff9a31726d06092b2c9/users/f25c436fccca4571a35c8fde70059540/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:53.740826 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca0eae-0922-4ed1-ba0f-e5d42c293ac7 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.793409 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781b779-ef0f-4462-99d3-6e42bd574424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.794086 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781b779-ef0f-4462-99d3-6e42bd574424 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.794373 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781b779-ef0f-4462-99d3-6e42bd574424 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.794677 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781b779-ef0f-4462-99d3-6e42bd574424 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.796258 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781b779-ef0f-4462-99d3-6e42bd574424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.797851 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781b779-ef0f-4462-99d3-6e42bd574424 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.810178 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1023/2090] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:53.814872 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781b779-ef0f-4462-99d3-6e42bd574424 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.842945 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781b779-ef0f-4462-99d3-6e42bd574424 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.848733 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd565c-fa42-403c-bf68-ea0c0cca9577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.849984 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd565c-fa42-403c-bf68-ea0c0cca9577 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.850339 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd565c-fa42-403c-bf68-ea0c0cca9577 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.850714 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd565c-fa42-403c-bf68-ea0c0cca9577 admin admin] PATH_INFO: `/v3/projects/d30bdde6339748eb8e98da74ffe39fc1/users/b322cfe2f669484790333279bb98f253/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.852017 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca0eae-0922-4ed1-ba0f-e5d42c293ac7 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.865888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c669c-01b6-4ca3-8ceb-93325f288a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:53.867101 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c669c-01b6-4ca3-8ceb-93325f288a86 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.867101 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c669c-01b6-4ca3-8ceb-93325f288a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.867595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c669c-01b6-4ca3-8ceb-93325f288a86 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.868739 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c669c-01b6-4ca3-8ceb-93325f288a86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.870971 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c669c-01b6-4ca3-8ceb-93325f288a86 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.871175 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd565c-fa42-403c-bf68-ea0c0cca9577 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30bdde6339748eb8e98da74ffe39fc1, user_id=b322cfe2f669484790333279bb98f253, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:53.874839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd565c-fa42-403c-bf68-ea0c0cca9577 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:53.883232 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1068/2091] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:53 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:53.888156 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c669c-01b6-4ca3-8ceb-93325f288a86 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:53.891348 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1024/2092] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:53 2022] PUT /identity/v3/projects/d30bdde6339748eb8e98da74ffe39fc1/users/b322cfe2f669484790333279bb98f253/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:53.899316 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c669c-01b6-4ca3-8ceb-93325f288a86 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:53.908664 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685a3cc-4a45-4e6d-9613-dba1e8c4fae6 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:53.908972 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685a3cc-4a45-4e6d-9613-dba1e8c4fae6 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:53.909274 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685a3cc-4a45-4e6d-9613-dba1e8c4fae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:53.947600 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-7685a3cc-4a45-4e6d-9613-dba1e8c4fae6 None None] MFA Rules not processed for user `b322cfe2f669484790333279bb98f253`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:53.948825 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7685a3cc-4a45-4e6d-9613-dba1e8c4fae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:54.003195 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d41a4-9619-45d2-9a6d-87a4dd70ffc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:54.004647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d41a4-9619-45d2-9a6d-87a4dd70ffc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:54.005132 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d41a4-9619-45d2-9a6d-87a4dd70ffc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:54.005412 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d41a4-9619-45d2-9a6d-87a4dd70ffc8 admin admin] PATH_INFO: `/v3/projects/412eef641a574ff9a31726d06092b2c9/users/f25c436fccca4571a35c8fde70059540/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:54.008058 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d41a4-9619-45d2-9a6d-87a4dd70ffc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=412eef641a574ff9a31726d06092b2c9, user_id=f25c436fccca4571a35c8fde70059540, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:54.015426 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d41a4-9619-45d2-9a6d-87a4dd70ffc8 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:54.032550 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1069/2093] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:53 2022] PUT /identity/v3/projects/412eef641a574ff9a31726d06092b2c9/users/f25c436fccca4571a35c8fde70059540/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:54.043466 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab6911-7106-439c-a75a-6452b9bb7930 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:54.043805 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab6911-7106-439c-a75a-6452b9bb7930 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:54.044288 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab6911-7106-439c-a75a-6452b9bb7930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:54.070660 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1025/2094] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:54.077677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-03ab6911-7106-439c-a75a-6452b9bb7930 None None] MFA Rules not processed for user `f25c436fccca4571a35c8fde70059540`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:54.079216 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-03ab6911-7106-439c-a75a-6452b9bb7930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:54.085538 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685a3cc-4a45-4e6d-9613-dba1e8c4fae6 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:54.090821 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7685a3cc-4a45-4e6d-9613-dba1e8c4fae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:54.195623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1070/2095] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:54.240717 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685a3cc-4a45-4e6d-9613-dba1e8c4fae6 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:54.248942 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab6911-7106-439c-a75a-6452b9bb7930 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:54.250569 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-03ab6911-7106-439c-a75a-6452b9bb7930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:54.304891 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22947cf0-1fce-40f0-82cc-9f11e4196722 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:54.305471 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22947cf0-1fce-40f0-82cc-9f11e4196722 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:54.305772 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22947cf0-1fce-40f0-82cc-9f11e4196722 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:54.306037 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22947cf0-1fce-40f0-82cc-9f11e4196722 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:54.316134 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab6911-7106-439c-a75a-6452b9bb7930 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:54.320150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652927d-1ba5-4efb-a3e9-7e2f7b6a5a61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:54.320796 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652927d-1ba5-4efb-a3e9-7e2f7b6a5a61 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:54.321080 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652927d-1ba5-4efb-a3e9-7e2f7b6a5a61 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:54.321357 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652927d-1ba5-4efb-a3e9-7e2f7b6a5a61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:54.334891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652927d-1ba5-4efb-a3e9-7e2f7b6a5a61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:54.336598 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652927d-1ba5-4efb-a3e9-7e2f7b6a5a61 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:54.347237 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1071/2096] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:51:54.368514 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22947cf0-1fce-40f0-82cc-9f11e4196722 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:54.370403 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22947cf0-1fce-40f0-82cc-9f11e4196722 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:54.382872 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1026/2097] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:54.401178 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652927d-1ba5-4efb-a3e9-7e2f7b6a5a61 service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:54.408679 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22947cf0-1fce-40f0-82cc-9f11e4196722 service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:54.419510 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22947cf0-1fce-40f0-82cc-9f11e4196722 service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:54.425933 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16374996-24e5-4406-9ca4-e1c91ce66080 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:54.426884 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16374996-24e5-4406-9ca4-e1c91ce66080 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:54.427387 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16374996-24e5-4406-9ca4-e1c91ce66080 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:54.427871 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16374996-24e5-4406-9ca4-e1c91ce66080 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:54.430293 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-16374996-24e5-4406-9ca4-e1c91ce66080 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:54.469827 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652927d-1ba5-4efb-a3e9-7e2f7b6a5a61 service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:54.474620 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b049e-eb56-4c4d-a422-8a4986e4666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:54.475492 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b049e-eb56-4c4d-a422-8a4986e4666d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:54.475768 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b049e-eb56-4c4d-a422-8a4986e4666d admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:54.476336 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802b049e-eb56-4c4d-a422-8a4986e4666d admin admin] PATH_INFO: `/v3/users/b322cfe2f669484790333279bb98f253` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:54.477222 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b049e-eb56-4c4d-a422-8a4986e4666d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b322cfe2f669484790333279bb98f253)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:54.480685 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802b049e-eb56-4c4d-a422-8a4986e4666d admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:54.505031 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16374996-24e5-4406-9ca4-e1c91ce66080 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:54.506909 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16374996-24e5-4406-9ca4-e1c91ce66080 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:54.524125 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1027/2098] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:51:54.532608 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-802b049e-eb56-4c4d-a422-8a4986e4666d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b322cfe2f669484790333279bb98f253'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:54.533298 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-802b049e-eb56-4c4d-a422-8a4986e4666d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b322cfe2f669484790333279bb98f253'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:54.542428 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-802b049e-eb56-4c4d-a422-8a4986e4666d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b322cfe2f669484790333279bb98f253'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:54.554856 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-802b049e-eb56-4c4d-a422-8a4986e4666d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b322cfe2f669484790333279bb98f253'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:54.569408 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-802b049e-eb56-4c4d-a422-8a4986e4666d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b322cfe2f669484790333279bb98f253'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:54.577312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1072/2099] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:51:54 2022] DELETE /identity/v3/users/b322cfe2f669484790333279bb98f253 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:54.582035 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59154cb4-1385-4da8-b9f0-ba9868da8af7 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:54.582332 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59154cb4-1385-4da8-b9f0-ba9868da8af7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:54.582651 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59154cb4-1385-4da8-b9f0-ba9868da8af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:54.608298 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-59154cb4-1385-4da8-b9f0-ba9868da8af7 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:54.609711 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-59154cb4-1385-4da8-b9f0-ba9868da8af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:54.720244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1028/2100] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:54.727522 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b049e-eb56-4c4d-a422-8a4986e4666d admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:54.729973 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-802b049e-eb56-4c4d-a422-8a4986e4666d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:54.800152 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802b049e-eb56-4c4d-a422-8a4986e4666d admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:54.804817 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00608bf-8676-4b80-845a-bccdf3a27be6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:54.805561 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00608bf-8676-4b80-845a-bccdf3a27be6 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:54.805762 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00608bf-8676-4b80-845a-bccdf3a27be6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:54.806104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00608bf-8676-4b80-845a-bccdf3a27be6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:54.820073 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00608bf-8676-4b80-845a-bccdf3a27be6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:54.821685 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00608bf-8676-4b80-845a-bccdf3a27be6 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:54.831547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1073/2101] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:51:55.122604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59154cb4-1385-4da8-b9f0-ba9868da8af7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:55.124188 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-59154cb4-1385-4da8-b9f0-ba9868da8af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:55.139327 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59154cb4-1385-4da8-b9f0-ba9868da8af7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:55.151951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e22ffc-9b1e-491d-a4ac-2de00ff9f2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:55.152917 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e22ffc-9b1e-491d-a4ac-2de00ff9f2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:55.153194 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e22ffc-9b1e-491d-a4ac-2de00ff9f2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:55.153777 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e22ffc-9b1e-491d-a4ac-2de00ff9f2a6 admin admin] PATH_INFO: `/v3/projects/d30bdde6339748eb8e98da74ffe39fc1` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:55.155756 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e22ffc-9b1e-491d-a4ac-2de00ff9f2a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30bdde6339748eb8e98da74ffe39fc1)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:55.157818 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e22ffc-9b1e-491d-a4ac-2de00ff9f2a6 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:55.203608 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-33e22ffc-9b1e-491d-a4ac-2de00ff9f2a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30bdde6339748eb8e98da74ffe39fc1', 'request_id': 'req-33e22ffc-9b1e-491d-a4ac-2de00ff9f2a6'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:55.208815 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-33e22ffc-9b1e-491d-a4ac-2de00ff9f2a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30bdde6339748eb8e98da74ffe39fc1', 'request_id': 'req-33e22ffc-9b1e-491d-a4ac-2de00ff9f2a6'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:55.215088 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-33e22ffc-9b1e-491d-a4ac-2de00ff9f2a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30bdde6339748eb8e98da74ffe39fc1', 'request_id': 'req-33e22ffc-9b1e-491d-a4ac-2de00ff9f2a6'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:55.227814 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-33e22ffc-9b1e-491d-a4ac-2de00ff9f2a6 admin admin] The token cache is being invalidate because project d30bdde6339748eb8e98da74ffe39fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:51:55.228099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-33e22ffc-9b1e-491d-a4ac-2de00ff9f2a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:55.228729 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-33e22ffc-9b1e-491d-a4ac-2de00ff9f2a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:51:55.230274 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1029/2102] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:51:55 2022] DELETE /identity/v3/projects/d30bdde6339748eb8e98da74ffe39fc1 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:55.235359 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa1af8-1207-4db1-aeeb-09e41cc5f1db None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:55.235815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa1af8-1207-4db1-aeeb-09e41cc5f1db None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:55.235973 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa1af8-1207-4db1-aeeb-09e41cc5f1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:55.261422 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-4afa1af8-1207-4db1-aeeb-09e41cc5f1db None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:55.262697 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4afa1af8-1207-4db1-aeeb-09e41cc5f1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:55.344234 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1074/2103] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:55.353118 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434cfa4-e85d-47ce-bf49-49975313b8b9 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:55.353299 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434cfa4-e85d-47ce-bf49-49975313b8b9 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:55.353562 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434cfa4-e85d-47ce-bf49-49975313b8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:55.374311 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-8434cfa4-e85d-47ce-bf49-49975313b8b9 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:55.375540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8434cfa4-e85d-47ce-bf49-49975313b8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:55.383951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1030/2104] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:51:55.388634 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa1af8-1207-4db1-aeeb-09e41cc5f1db None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:55.399149 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa1af8-1207-4db1-aeeb-09e41cc5f1db None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:55.406727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de1ca4-861f-4bd9-944a-cbdc64e60276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:55.406727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de1ca4-861f-4bd9-944a-cbdc64e60276 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:55.406727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de1ca4-861f-4bd9-944a-cbdc64e60276 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:55.406727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de1ca4-861f-4bd9-944a-cbdc64e60276 admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:55.407135 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de1ca4-861f-4bd9-944a-cbdc64e60276 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:51:55.407135 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de1ca4-861f-4bd9-944a-cbdc64e60276 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:55.408032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de1ca4-861f-4bd9-944a-cbdc64e60276 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:55.420023 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1075/2105] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:51:55.424212 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434cfa4-e85d-47ce-bf49-49975313b8b9 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:55.433350 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434cfa4-e85d-47ce-bf49-49975313b8b9 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:55.439381 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd47a23-bbca-4af8-becc-36e850e0bdac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:55.440043 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd47a23-bbca-4af8-becc-36e850e0bdac admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:55.440326 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd47a23-bbca-4af8-becc-36e850e0bdac admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:55.440602 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd47a23-bbca-4af8-becc-36e850e0bdac admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:55.441380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd47a23-bbca-4af8-becc-36e850e0bdac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:55.444123 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd47a23-bbca-4af8-becc-36e850e0bdac admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:55.476585 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1031/2106] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:55 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:55.480721 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de1ca4-861f-4bd9-944a-cbdc64e60276 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:55.490984 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de1ca4-861f-4bd9-944a-cbdc64e60276 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:55.548524 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d8086-2b6b-448e-8f1d-f53a08308549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:55.549219 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d8086-2b6b-448e-8f1d-f53a08308549 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:55.549532 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d8086-2b6b-448e-8f1d-f53a08308549 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:55.549809 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d8086-2b6b-448e-8f1d-f53a08308549 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:55.550492 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d8086-2b6b-448e-8f1d-f53a08308549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:55.552438 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d8086-2b6b-448e-8f1d-f53a08308549 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:55.571528 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1076/2107] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:55 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:55.575838 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd47a23-bbca-4af8-becc-36e850e0bdac admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:55.587372 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd47a23-bbca-4af8-becc-36e850e0bdac admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:55.591997 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d60a32-de48-4dc2-9b85-e8d47803a823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:55.592721 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d60a32-de48-4dc2-9b85-e8d47803a823 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:55.593003 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d60a32-de48-4dc2-9b85-e8d47803a823 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:55.593323 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d60a32-de48-4dc2-9b85-e8d47803a823 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:55.594045 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d60a32-de48-4dc2-9b85-e8d47803a823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:55.595705 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d60a32-de48-4dc2-9b85-e8d47803a823 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:55.606182 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1032/2108] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:51:55.610723 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d8086-2b6b-448e-8f1d-f53a08308549 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:55.620348 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d8086-2b6b-448e-8f1d-f53a08308549 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:55.625502 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc37c7-0429-487a-b140-a5513b642775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:55.626154 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc37c7-0429-487a-b140-a5513b642775 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:55.626433 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc37c7-0429-487a-b140-a5513b642775 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:55.626748 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc37c7-0429-487a-b140-a5513b642775 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:55.627469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc37c7-0429-487a-b140-a5513b642775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:55.629049 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc37c7-0429-487a-b140-a5513b642775 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:55.638976 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1077/2109] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:55.642831 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d60a32-de48-4dc2-9b85-e8d47803a823 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:55.652427 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d60a32-de48-4dc2-9b85-e8d47803a823 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:55.656930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab61113-f29d-4096-8260-d9e9dfdeb633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:55.657822 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab61113-f29d-4096-8260-d9e9dfdeb633 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:55.658093 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab61113-f29d-4096-8260-d9e9dfdeb633 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:55.658358 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab61113-f29d-4096-8260-d9e9dfdeb633 admin admin] PATH_INFO: `/v3/projects/08b92eaead9640788b5f3f60bd52aaeb/users/2d7a0b6db9194db5a58832ca9802ef15/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:55.672799 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab61113-f29d-4096-8260-d9e9dfdeb633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b92eaead9640788b5f3f60bd52aaeb, user_id=2d7a0b6db9194db5a58832ca9802ef15, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:55.675621 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab61113-f29d-4096-8260-d9e9dfdeb633 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:55.688610 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1033/2110] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:55 2022] PUT /identity/v3/projects/08b92eaead9640788b5f3f60bd52aaeb/users/2d7a0b6db9194db5a58832ca9802ef15/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:51:55.699589 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c86570-4977-428f-a812-b31ab8b2942a None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:55.699879 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c86570-4977-428f-a812-b31ab8b2942a None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:55.700186 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c86570-4977-428f-a812-b31ab8b2942a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:55.728579 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-14c86570-4977-428f-a812-b31ab8b2942a None None] MFA Rules not processed for user `2d7a0b6db9194db5a58832ca9802ef15`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:55.729799 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-14c86570-4977-428f-a812-b31ab8b2942a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:55.801927 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1078/2111] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:55.806542 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab61113-f29d-4096-8260-d9e9dfdeb633 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:55.872355 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab61113-f29d-4096-8260-d9e9dfdeb633 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:55.880330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14790302-710c-42b0-b77c-daf15bd5ee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:55.880330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14790302-710c-42b0-b77c-daf15bd5ee42 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:55.880330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14790302-710c-42b0-b77c-daf15bd5ee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:55.880747 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14790302-710c-42b0-b77c-daf15bd5ee42 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:55.883486 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14790302-710c-42b0-b77c-daf15bd5ee42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:55.886373 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14790302-710c-42b0-b77c-daf15bd5ee42 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:55.921851 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1034/2112] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:51:55 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:51:55.925995 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c86570-4977-428f-a812-b31ab8b2942a None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:55.937549 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c86570-4977-428f-a812-b31ab8b2942a None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:56.001142 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c64fa-2016-4240-8a5f-1335d684bc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:56.001791 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c64fa-2016-4240-8a5f-1335d684bc7a admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:56.002075 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c64fa-2016-4240-8a5f-1335d684bc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:56.002352 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6c64fa-2016-4240-8a5f-1335d684bc7a admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:56.003091 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c64fa-2016-4240-8a5f-1335d684bc7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:56.007667 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6c64fa-2016-4240-8a5f-1335d684bc7a admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:56.034544 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1079/2113] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:51:55 2022] POST /identity/v3/users => generated 294 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:51:56.038779 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14790302-710c-42b0-b77c-daf15bd5ee42 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:56.052558 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14790302-710c-42b0-b77c-daf15bd5ee42 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:56.057298 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8fef4-05c0-495f-b110-60f09058206b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:56.057965 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8fef4-05c0-495f-b110-60f09058206b admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:56.058249 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8fef4-05c0-495f-b110-60f09058206b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:56.058525 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8fef4-05c0-495f-b110-60f09058206b admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:56.059291 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8fef4-05c0-495f-b110-60f09058206b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:56.060925 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8fef4-05c0-495f-b110-60f09058206b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:56.071959 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1035/2114] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:56.076226 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c64fa-2016-4240-8a5f-1335d684bc7a admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:56.086190 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6c64fa-2016-4240-8a5f-1335d684bc7a admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:56.091579 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54ca6a-75fa-4791-a59d-846ef1a0a573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:56.093532 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54ca6a-75fa-4791-a59d-846ef1a0a573 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:56.094021 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54ca6a-75fa-4791-a59d-846ef1a0a573 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:56.094310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df54ca6a-75fa-4791-a59d-846ef1a0a573 admin admin] PATH_INFO: `/v3/projects/252bd51368f8483eba938cad3409bd31/users/4911ddc544a34e48a76fc616036d793e/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:56.115122 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54ca6a-75fa-4791-a59d-846ef1a0a573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=252bd51368f8483eba938cad3409bd31, user_id=4911ddc544a34e48a76fc616036d793e, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:56.117862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df54ca6a-75fa-4791-a59d-846ef1a0a573 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:56.130802 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1080/2115] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:56 2022] PUT /identity/v3/projects/252bd51368f8483eba938cad3409bd31/users/4911ddc544a34e48a76fc616036d793e/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:56.134927 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8fef4-05c0-495f-b110-60f09058206b admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:56.144971 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8fef4-05c0-495f-b110-60f09058206b admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:56.207687 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a962fef-51e1-4417-ba0e-1b4289f40652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:56.208441 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a962fef-51e1-4417-ba0e-1b4289f40652 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:56.208720 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a962fef-51e1-4417-ba0e-1b4289f40652 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:56.209005 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a962fef-51e1-4417-ba0e-1b4289f40652 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:56.209729 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a962fef-51e1-4417-ba0e-1b4289f40652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:56.211338 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a962fef-51e1-4417-ba0e-1b4289f40652 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:56.222623 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1036/2116] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:51:56.225965 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54ca6a-75fa-4791-a59d-846ef1a0a573 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:56.236523 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df54ca6a-75fa-4791-a59d-846ef1a0a573 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:56.241442 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb178e4-0f34-4ba7-8510-b77cd357f98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:56.242322 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb178e4-0f34-4ba7-8510-b77cd357f98e admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:56.242617 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb178e4-0f34-4ba7-8510-b77cd357f98e admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:56.243117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb178e4-0f34-4ba7-8510-b77cd357f98e admin admin] PATH_INFO: `/v3/projects/252bd51368f8483eba938cad3409bd31/users/4911ddc544a34e48a76fc616036d793e/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:56.248151 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb178e4-0f34-4ba7-8510-b77cd357f98e admin admin] RBAC: Authorizing `identity:create_grant(project_id=252bd51368f8483eba938cad3409bd31, user_id=4911ddc544a34e48a76fc616036d793e, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:56.254411 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb178e4-0f34-4ba7-8510-b77cd357f98e admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:56.268775 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1081/2117] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:51:56 2022] PUT /identity/v3/projects/252bd51368f8483eba938cad3409bd31/users/4911ddc544a34e48a76fc616036d793e/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:51:56.279102 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804d5af-e425-4b50-879b-78daeaeea614 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:56.279890 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804d5af-e425-4b50-879b-78daeaeea614 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:56.280355 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804d5af-e425-4b50-879b-78daeaeea614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:56.306861 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a804d5af-e425-4b50-879b-78daeaeea614 None None] MFA Rules not processed for user `4911ddc544a34e48a76fc616036d793e`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:51:56.308037 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a804d5af-e425-4b50-879b-78daeaeea614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:56.377359 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1037/2118] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:51:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:51:56.388194 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb178e4-0f34-4ba7-8510-b77cd357f98e admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:51:56.390532 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-6eb178e4-0f34-4ba7-8510-b77cd357f98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:51:56.447231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb178e4-0f34-4ba7-8510-b77cd357f98e admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:51:56.451062 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e899377-f270-425c-ada6-de67f76fc2ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:51:56.452227 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e899377-f270-425c-ada6-de67f76fc2ac service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:51:56.452613 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e899377-f270-425c-ada6-de67f76fc2ac service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:51:56.452888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e899377-f270-425c-ada6-de67f76fc2ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:51:56.509588 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e899377-f270-425c-ada6-de67f76fc2ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:51:56.511497 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e899377-f270-425c-ada6-de67f76fc2ac service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:51:56.521057 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1082/2119] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:51:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:00.608976 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804d5af-e425-4b50-879b-78daeaeea614 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:00.610542 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a804d5af-e425-4b50-879b-78daeaeea614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:00.674844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804d5af-e425-4b50-879b-78daeaeea614 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:00.680053 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046a55a-20f2-4079-b3e7-1c3d4b1c3578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:00.680963 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046a55a-20f2-4079-b3e7-1c3d4b1c3578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:00.681246 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046a55a-20f2-4079-b3e7-1c3d4b1c3578 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:00.681519 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046a55a-20f2-4079-b3e7-1c3d4b1c3578 admin admin] PATH_INFO: `/v3/users/b2542fa823634708bf0feb52e6c42163` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:00.682748 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046a55a-20f2-4079-b3e7-1c3d4b1c3578 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2542fa823634708bf0feb52e6c42163)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:00.684651 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046a55a-20f2-4079-b3e7-1c3d4b1c3578 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:00.730582 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9046a55a-20f2-4079-b3e7-1c3d4b1c3578 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2542fa823634708bf0feb52e6c42163'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:00.738811 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9046a55a-20f2-4079-b3e7-1c3d4b1c3578 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2542fa823634708bf0feb52e6c42163'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:00.739590 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9046a55a-20f2-4079-b3e7-1c3d4b1c3578 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2542fa823634708bf0feb52e6c42163'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:00.748163 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9046a55a-20f2-4079-b3e7-1c3d4b1c3578 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2542fa823634708bf0feb52e6c42163'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:00.761487 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9046a55a-20f2-4079-b3e7-1c3d4b1c3578 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2542fa823634708bf0feb52e6c42163'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:00.768623 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1038/2120] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:00 2022] DELETE /identity/v3/users/b2542fa823634708bf0feb52e6c42163 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:00.773120 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d30a3-9ee9-4d0b-a742-f393c62fb5ef None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:00.773566 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d30a3-9ee9-4d0b-a742-f393c62fb5ef None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:00.773682 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d30a3-9ee9-4d0b-a742-f393c62fb5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:00.791485 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-f04d30a3-9ee9-4d0b-a742-f393c62fb5ef None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:00.792681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f04d30a3-9ee9-4d0b-a742-f393c62fb5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:00.848504 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1083/2121] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:00.859201 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046a55a-20f2-4079-b3e7-1c3d4b1c3578 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:00.865768 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9046a55a-20f2-4079-b3e7-1c3d4b1c3578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:00.925826 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046a55a-20f2-4079-b3e7-1c3d4b1c3578 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:00.929522 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29c547-27b4-470c-ac93-e44bf2e50abc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:00.930121 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29c547-27b4-470c-ac93-e44bf2e50abc service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:00.930406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29c547-27b4-470c-ac93-e44bf2e50abc service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:00.931778 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29c547-27b4-470c-ac93-e44bf2e50abc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:00.940830 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29c547-27b4-470c-ac93-e44bf2e50abc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:00.942278 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29c547-27b4-470c-ac93-e44bf2e50abc service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:00.952324 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1039/2122] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:52:01.176758 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d30a3-9ee9-4d0b-a742-f393c62fb5ef None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:01.178504 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f04d30a3-9ee9-4d0b-a742-f393c62fb5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:01.196079 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d30a3-9ee9-4d0b-a742-f393c62fb5ef None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:01.202104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ace7b-71f9-4acf-a402-614593acabf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:01.203189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ace7b-71f9-4acf-a402-614593acabf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:01.203462 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ace7b-71f9-4acf-a402-614593acabf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:01.203904 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ace7b-71f9-4acf-a402-614593acabf1 admin admin] PATH_INFO: `/v3/users/2d7a0b6db9194db5a58832ca9802ef15` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:01.205082 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ace7b-71f9-4acf-a402-614593acabf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7a0b6db9194db5a58832ca9802ef15)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:01.207292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ace7b-71f9-4acf-a402-614593acabf1 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:01.269258 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-1e8ace7b-71f9-4acf-a402-614593acabf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7a0b6db9194db5a58832ca9802ef15'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:01.270124 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-1e8ace7b-71f9-4acf-a402-614593acabf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7a0b6db9194db5a58832ca9802ef15'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:01.282130 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-1e8ace7b-71f9-4acf-a402-614593acabf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7a0b6db9194db5a58832ca9802ef15'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:01.295955 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-1e8ace7b-71f9-4acf-a402-614593acabf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7a0b6db9194db5a58832ca9802ef15'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:01.310096 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-1e8ace7b-71f9-4acf-a402-614593acabf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7a0b6db9194db5a58832ca9802ef15'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:01.322896 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1084/2123] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:01 2022] DELETE /identity/v3/users/2d7a0b6db9194db5a58832ca9802ef15 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:01.327445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19427b-6647-4d1f-b368-4542fd328778 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:01.327735 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19427b-6647-4d1f-b368-4542fd328778 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:01.328013 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd19427b-6647-4d1f-b368-4542fd328778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:01.354154 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-fd19427b-6647-4d1f-b368-4542fd328778 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:01.355390 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-fd19427b-6647-4d1f-b368-4542fd328778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:01.426856 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1040/2124] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:01.436447 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ace7b-71f9-4acf-a402-614593acabf1 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:01.437991 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-1e8ace7b-71f9-4acf-a402-614593acabf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:01.458334 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19427b-6647-4d1f-b368-4542fd328778 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:01.460009 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-fd19427b-6647-4d1f-b368-4542fd328778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:01.475767 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd19427b-6647-4d1f-b368-4542fd328778 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:01.481297 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adcc8d-eda2-4d3b-8c08-4f45f1063d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:01.482320 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adcc8d-eda2-4d3b-8c08-4f45f1063d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:01.482613 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adcc8d-eda2-4d3b-8c08-4f45f1063d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:01.482909 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6adcc8d-eda2-4d3b-8c08-4f45f1063d5b admin admin] PATH_INFO: `/v3/projects/f35bb49a4c9e45e8982fdb9c74259d94` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:01.484512 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adcc8d-eda2-4d3b-8c08-4f45f1063d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f35bb49a4c9e45e8982fdb9c74259d94)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:01.486527 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6adcc8d-eda2-4d3b-8c08-4f45f1063d5b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:01.529221 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ace7b-71f9-4acf-a402-614593acabf1 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:01.544231 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b6adcc8d-eda2-4d3b-8c08-4f45f1063d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f35bb49a4c9e45e8982fdb9c74259d94', 'request_id': 'req-b6adcc8d-eda2-4d3b-8c08-4f45f1063d5b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:01.550389 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b6adcc8d-eda2-4d3b-8c08-4f45f1063d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f35bb49a4c9e45e8982fdb9c74259d94', 'request_id': 'req-b6adcc8d-eda2-4d3b-8c08-4f45f1063d5b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:01.557091 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b6adcc8d-eda2-4d3b-8c08-4f45f1063d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f35bb49a4c9e45e8982fdb9c74259d94', 'request_id': 'req-b6adcc8d-eda2-4d3b-8c08-4f45f1063d5b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:01.570307 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b6adcc8d-eda2-4d3b-8c08-4f45f1063d5b admin admin] The token cache is being invalidate because project f35bb49a4c9e45e8982fdb9c74259d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:01.570727 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b6adcc8d-eda2-4d3b-8c08-4f45f1063d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:01.571457 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-b6adcc8d-eda2-4d3b-8c08-4f45f1063d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:01.573165 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1041/2125] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:01 2022] DELETE /identity/v3/projects/f35bb49a4c9e45e8982fdb9c74259d94 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:52:01.577501 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adcc8d-eda2-4d3b-8c08-4f45f1063d5b admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:01.578933 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b6adcc8d-eda2-4d3b-8c08-4f45f1063d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:01.581068 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fc7c4-e60c-4d64-ba2b-d34828feef97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:01.582365 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fc7c4-e60c-4d64-ba2b-d34828feef97 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:01.583906 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fc7c4-e60c-4d64-ba2b-d34828feef97 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:01.584230 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64fc7c4-e60c-4d64-ba2b-d34828feef97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:01.586369 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b64fc7c4-e60c-4d64-ba2b-d34828feef97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:01.649168 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6adcc8d-eda2-4d3b-8c08-4f45f1063d5b admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:01.653535 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fc7c4-e60c-4d64-ba2b-d34828feef97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:01.655996 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558ad4f-3253-4689-b8a1-ea1026431b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:01.656139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64fc7c4-e60c-4d64-ba2b-d34828feef97 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:01.656771 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558ad4f-3253-4689-b8a1-ea1026431b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:01.657037 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558ad4f-3253-4689-b8a1-ea1026431b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:01.657488 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558ad4f-3253-4689-b8a1-ea1026431b20 admin admin] PATH_INFO: `/v3/users/3cccaa5084d748c4b32e5c86c1353f0d` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:01.660314 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558ad4f-3253-4689-b8a1-ea1026431b20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cccaa5084d748c4b32e5c86c1353f0d)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:01.668937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1085/2126] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:01.677699 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558ad4f-3253-4689-b8a1-ea1026431b20 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:01.741565 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4558ad4f-3253-4689-b8a1-ea1026431b20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cccaa5084d748c4b32e5c86c1353f0d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:01.769649 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4558ad4f-3253-4689-b8a1-ea1026431b20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cccaa5084d748c4b32e5c86c1353f0d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:01.770545 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4558ad4f-3253-4689-b8a1-ea1026431b20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cccaa5084d748c4b32e5c86c1353f0d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:01.780328 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4558ad4f-3253-4689-b8a1-ea1026431b20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cccaa5084d748c4b32e5c86c1353f0d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:01.800145 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4558ad4f-3253-4689-b8a1-ea1026431b20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cccaa5084d748c4b32e5c86c1353f0d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:01.805894 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1042/2127] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:01 2022] DELETE /identity/v3/users/3cccaa5084d748c4b32e5c86c1353f0d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:01.883196 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fc7c4-e60c-4d64-ba2b-d34828feef97 service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:01.885547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b64fc7c4-e60c-4d64-ba2b-d34828feef97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:01.915308 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64fc7c4-e60c-4d64-ba2b-d34828feef97 service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:02.014955 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ed8ca-7141-4f2a-adc6-81180315de03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:02.015874 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ed8ca-7141-4f2a-adc6-81180315de03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:02.016364 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ed8ca-7141-4f2a-adc6-81180315de03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:02.016470 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ed8ca-7141-4f2a-adc6-81180315de03 admin admin] PATH_INFO: `/v3/users/101a86726b0c407996de8858af3cdabb` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:02.020027 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ed8ca-7141-4f2a-adc6-81180315de03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=101a86726b0c407996de8858af3cdabb)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:02.023903 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ed8ca-7141-4f2a-adc6-81180315de03 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:02.107025 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-611ed8ca-7141-4f2a-adc6-81180315de03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '101a86726b0c407996de8858af3cdabb'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.107839 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-611ed8ca-7141-4f2a-adc6-81180315de03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '101a86726b0c407996de8858af3cdabb'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.120943 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-611ed8ca-7141-4f2a-adc6-81180315de03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '101a86726b0c407996de8858af3cdabb'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.130532 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-611ed8ca-7141-4f2a-adc6-81180315de03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '101a86726b0c407996de8858af3cdabb'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.143614 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-611ed8ca-7141-4f2a-adc6-81180315de03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '101a86726b0c407996de8858af3cdabb'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.150289 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1086/2128] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:01 2022] DELETE /identity/v3/users/101a86726b0c407996de8858af3cdabb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:52:02.218855 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558ad4f-3253-4689-b8a1-ea1026431b20 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:02.220354 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4558ad4f-3253-4689-b8a1-ea1026431b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:02.248307 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558ad4f-3253-4689-b8a1-ea1026431b20 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:02.275061 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ed8ca-7141-4f2a-adc6-81180315de03 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:02.276624 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-611ed8ca-7141-4f2a-adc6-81180315de03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:02.351660 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ff26d-c501-48a2-b9e4-0618c711e6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:02.353123 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ff26d-c501-48a2-b9e4-0618c711e6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:02.353407 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ff26d-c501-48a2-b9e4-0618c711e6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:02.353682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ff26d-c501-48a2-b9e4-0618c711e6bc admin admin] PATH_INFO: `/v3/projects/08b92eaead9640788b5f3f60bd52aaeb` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:02.355854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ff26d-c501-48a2-b9e4-0618c711e6bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b92eaead9640788b5f3f60bd52aaeb)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:02.358341 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ff26d-c501-48a2-b9e4-0618c711e6bc admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:02.402425 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ed8ca-7141-4f2a-adc6-81180315de03 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:02.427010 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-065ff26d-c501-48a2-b9e4-0618c711e6bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b92eaead9640788b5f3f60bd52aaeb', 'request_id': 'req-065ff26d-c501-48a2-b9e4-0618c711e6bc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.441891 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-065ff26d-c501-48a2-b9e4-0618c711e6bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b92eaead9640788b5f3f60bd52aaeb', 'request_id': 'req-065ff26d-c501-48a2-b9e4-0618c711e6bc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.448720 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-065ff26d-c501-48a2-b9e4-0618c711e6bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b92eaead9640788b5f3f60bd52aaeb', 'request_id': 'req-065ff26d-c501-48a2-b9e4-0618c711e6bc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.464008 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-065ff26d-c501-48a2-b9e4-0618c711e6bc admin admin] The token cache is being invalidate because project 08b92eaead9640788b5f3f60bd52aaeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:02.464406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-065ff26d-c501-48a2-b9e4-0618c711e6bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.465110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-065ff26d-c501-48a2-b9e4-0618c711e6bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.466922 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1043/2129] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:02 2022] DELETE /identity/v3/projects/08b92eaead9640788b5f3f60bd52aaeb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:02.467770 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ff26d-c501-48a2-b9e4-0618c711e6bc admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:02.469182 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-065ff26d-c501-48a2-b9e4-0618c711e6bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:02.495103 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273506c0-0176-4a5e-a579-bbe666646d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:02.496240 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273506c0-0176-4a5e-a579-bbe666646d50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:02.496525 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273506c0-0176-4a5e-a579-bbe666646d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:02.496945 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273506c0-0176-4a5e-a579-bbe666646d50 admin admin] PATH_INFO: `/v3/projects/b8e5e7773689430ba505b5e439e3004b` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:02.500777 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273506c0-0176-4a5e-a579-bbe666646d50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e5e7773689430ba505b5e439e3004b)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:02.501184 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273506c0-0176-4a5e-a579-bbe666646d50 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:02.553502 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ff26d-c501-48a2-b9e4-0618c711e6bc admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:02.556918 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-273506c0-0176-4a5e-a579-bbe666646d50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e5e7773689430ba505b5e439e3004b', 'request_id': 'req-273506c0-0176-4a5e-a579-bbe666646d50'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.562555 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-273506c0-0176-4a5e-a579-bbe666646d50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e5e7773689430ba505b5e439e3004b', 'request_id': 'req-273506c0-0176-4a5e-a579-bbe666646d50'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.570411 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-273506c0-0176-4a5e-a579-bbe666646d50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e5e7773689430ba505b5e439e3004b', 'request_id': 'req-273506c0-0176-4a5e-a579-bbe666646d50'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.587155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-273506c0-0176-4a5e-a579-bbe666646d50 admin admin] The token cache is being invalidate because project b8e5e7773689430ba505b5e439e3004b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:02.587478 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-273506c0-0176-4a5e-a579-bbe666646d50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.588287 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-273506c0-0176-4a5e-a579-bbe666646d50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.593429 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1087/2130] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:02 2022] DELETE /identity/v3/projects/b8e5e7773689430ba505b5e439e3004b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:52:02.594402 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273506c0-0176-4a5e-a579-bbe666646d50 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:02.596428 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-273506c0-0176-4a5e-a579-bbe666646d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:02.620762 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a3b2d-ca6c-4871-b0ac-621b118ebf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:02.622763 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a3b2d-ca6c-4871-b0ac-621b118ebf36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:02.623343 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a3b2d-ca6c-4871-b0ac-621b118ebf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:02.623848 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a3b2d-ca6c-4871-b0ac-621b118ebf36 admin admin] PATH_INFO: `/v3/projects/d32ccfb9c3574946a051d337dd313f05` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:02.625823 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a3b2d-ca6c-4871-b0ac-621b118ebf36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32ccfb9c3574946a051d337dd313f05)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:02.628522 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a3b2d-ca6c-4871-b0ac-621b118ebf36 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:02.669391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273506c0-0176-4a5e-a579-bbe666646d50 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:02.674792 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb828a88-ff66-478f-93a3-9e88f09ca620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:02.675657 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb828a88-ff66-478f-93a3-9e88f09ca620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:02.675931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb828a88-ff66-478f-93a3-9e88f09ca620 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:02.676201 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb828a88-ff66-478f-93a3-9e88f09ca620 admin admin] PATH_INFO: `/v3/users/4911ddc544a34e48a76fc616036d793e` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:02.677388 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb828a88-ff66-478f-93a3-9e88f09ca620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4911ddc544a34e48a76fc616036d793e)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:02.679355 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb828a88-ff66-478f-93a3-9e88f09ca620 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:02.686884 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-217a3b2d-ca6c-4871-b0ac-621b118ebf36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32ccfb9c3574946a051d337dd313f05', 'request_id': 'req-217a3b2d-ca6c-4871-b0ac-621b118ebf36'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.692794 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-217a3b2d-ca6c-4871-b0ac-621b118ebf36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32ccfb9c3574946a051d337dd313f05', 'request_id': 'req-217a3b2d-ca6c-4871-b0ac-621b118ebf36'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.706923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-217a3b2d-ca6c-4871-b0ac-621b118ebf36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32ccfb9c3574946a051d337dd313f05', 'request_id': 'req-217a3b2d-ca6c-4871-b0ac-621b118ebf36'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.721873 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-217a3b2d-ca6c-4871-b0ac-621b118ebf36 admin admin] The token cache is being invalidate because project d32ccfb9c3574946a051d337dd313f05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:02.722157 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-217a3b2d-ca6c-4871-b0ac-621b118ebf36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.723062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-217a3b2d-ca6c-4871-b0ac-621b118ebf36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.724626 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1044/2131] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:02 2022] DELETE /identity/v3/projects/d32ccfb9c3574946a051d337dd313f05 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:02.725584 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a3b2d-ca6c-4871-b0ac-621b118ebf36 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:02.726909 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-217a3b2d-ca6c-4871-b0ac-621b118ebf36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:02.732937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-cb828a88-ff66-478f-93a3-9e88f09ca620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4911ddc544a34e48a76fc616036d793e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.733660 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-cb828a88-ff66-478f-93a3-9e88f09ca620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4911ddc544a34e48a76fc616036d793e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.741011 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-cb828a88-ff66-478f-93a3-9e88f09ca620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4911ddc544a34e48a76fc616036d793e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.752520 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-cb828a88-ff66-478f-93a3-9e88f09ca620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4911ddc544a34e48a76fc616036d793e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.765206 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-cb828a88-ff66-478f-93a3-9e88f09ca620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4911ddc544a34e48a76fc616036d793e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.771697 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1088/2132] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:02 2022] DELETE /identity/v3/users/4911ddc544a34e48a76fc616036d793e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:02.772992 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3aba90-c817-4297-890a-fcaa322b9485 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:02.773460 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3aba90-c817-4297-890a-fcaa322b9485 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:02.773743 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3aba90-c817-4297-890a-fcaa322b9485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:02.800044 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-be3aba90-c817-4297-890a-fcaa322b9485 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:02.800726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a3b2d-ca6c-4871-b0ac-621b118ebf36 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:02.801572 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-be3aba90-c817-4297-890a-fcaa322b9485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:02.865963 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad34946-7978-4aaa-b94e-3a5e51722c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:02.867098 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad34946-7978-4aaa-b94e-3a5e51722c4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:02.867656 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad34946-7978-4aaa-b94e-3a5e51722c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:02.868151 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1089/2133] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:02.868368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad34946-7978-4aaa-b94e-3a5e51722c4b admin admin] PATH_INFO: `/v3/users/f25c436fccca4571a35c8fde70059540` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:02.869299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3aba90-c817-4297-890a-fcaa322b9485 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:02.870180 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad34946-7978-4aaa-b94e-3a5e51722c4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f25c436fccca4571a35c8fde70059540)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:02.871134 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-be3aba90-c817-4297-890a-fcaa322b9485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:02.876284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad34946-7978-4aaa-b94e-3a5e51722c4b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:02.890730 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3aba90-c817-4297-890a-fcaa322b9485 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:02.910727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d4251-105c-4693-abe0-185e54a5fcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:02.911620 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d4251-105c-4693-abe0-185e54a5fcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:02.911926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d4251-105c-4693-abe0-185e54a5fcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:02.912198 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d4251-105c-4693-abe0-185e54a5fcd6 admin admin] PATH_INFO: `/v3/users/608224a33e7f4e01afb917fb5a6061a2` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:02.913407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d4251-105c-4693-abe0-185e54a5fcd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=608224a33e7f4e01afb917fb5a6061a2)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:02.915354 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d4251-105c-4693-abe0-185e54a5fcd6 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:02.940678 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6ad34946-7978-4aaa-b94e-3a5e51722c4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f25c436fccca4571a35c8fde70059540'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.952519 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6ad34946-7978-4aaa-b94e-3a5e51722c4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f25c436fccca4571a35c8fde70059540'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.953241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6ad34946-7978-4aaa-b94e-3a5e51722c4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f25c436fccca4571a35c8fde70059540'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.961560 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6ad34946-7978-4aaa-b94e-3a5e51722c4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f25c436fccca4571a35c8fde70059540'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.973377 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-601d4251-105c-4693-abe0-185e54a5fcd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '608224a33e7f4e01afb917fb5a6061a2'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.974249 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-601d4251-105c-4693-abe0-185e54a5fcd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '608224a33e7f4e01afb917fb5a6061a2'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.978063 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6ad34946-7978-4aaa-b94e-3a5e51722c4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f25c436fccca4571a35c8fde70059540'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.986569 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1045/2134] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:02 2022] DELETE /identity/v3/users/f25c436fccca4571a35c8fde70059540 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:02.989766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-601d4251-105c-4693-abe0-185e54a5fcd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '608224a33e7f4e01afb917fb5a6061a2'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:02.989866 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2a49c-baf8-45ef-a1d9-8f63d14cf185 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:02.989866 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2a49c-baf8-45ef-a1d9-8f63d14cf185 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:02.989866 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2a49c-baf8-45ef-a1d9-8f63d14cf185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.013068 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-bed2a49c-baf8-45ef-a1d9-8f63d14cf185 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:03.014861 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bed2a49c-baf8-45ef-a1d9-8f63d14cf185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:03.021695 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-601d4251-105c-4693-abe0-185e54a5fcd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '608224a33e7f4e01afb917fb5a6061a2'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:03.051368 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-601d4251-105c-4693-abe0-185e54a5fcd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '608224a33e7f4e01afb917fb5a6061a2'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:03.061854 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1090/2135] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:02 2022] DELETE /identity/v3/users/608224a33e7f4e01afb917fb5a6061a2 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:03.066406 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6db6c8-8637-4413-8b52-976d3fe44799 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.066995 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6db6c8-8637-4413-8b52-976d3fe44799 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.067427 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6db6c8-8637-4413-8b52-976d3fe44799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.085096 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1046/2136] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:03.089738 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2a49c-baf8-45ef-a1d9-8f63d14cf185 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:03.099291 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2a49c-baf8-45ef-a1d9-8f63d14cf185 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:03.104336 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-3d6db6c8-8637-4413-8b52-976d3fe44799 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:03.108487 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3d6db6c8-8637-4413-8b52-976d3fe44799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:03.193936 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8a8d1-1119-4b06-a622-1a9943e05f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:03.196177 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8a8d1-1119-4b06-a622-1a9943e05f5f admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.196613 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8a8d1-1119-4b06-a622-1a9943e05f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.197657 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f8a8d1-1119-4b06-a622-1a9943e05f5f admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.198628 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8a8d1-1119-4b06-a622-1a9943e05f5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:52:03.198850 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8a8d1-1119-4b06-a622-1a9943e05f5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:03.200459 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f8a8d1-1119-4b06-a622-1a9943e05f5f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:03.208011 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1091/2137] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:52:03.209243 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6db6c8-8637-4413-8b52-976d3fe44799 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:03.213687 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1047/2138] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:52:03.214705 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3d6db6c8-8637-4413-8b52-976d3fe44799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:03.218179 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8a8d1-1119-4b06-a622-1a9943e05f5f admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:03.226349 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6db6c8-8637-4413-8b52-976d3fe44799 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:03.236246 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99284677-7eb5-40d1-8af5-7f92278a9b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:03.237149 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99284677-7eb5-40d1-8af5-7f92278a9b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.237404 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99284677-7eb5-40d1-8af5-7f92278a9b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.237711 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99284677-7eb5-40d1-8af5-7f92278a9b13 admin admin] PATH_INFO: `/v3/projects/252bd51368f8483eba938cad3409bd31` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.239320 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99284677-7eb5-40d1-8af5-7f92278a9b13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=252bd51368f8483eba938cad3409bd31)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:03.241015 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f8a8d1-1119-4b06-a622-1a9943e05f5f admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:03.241803 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99284677-7eb5-40d1-8af5-7f92278a9b13 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:03.246874 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b36672-b09f-4915-826c-0a2a5d029d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:03.247533 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b36672-b09f-4915-826c-0a2a5d029d7e admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.247810 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b36672-b09f-4915-826c-0a2a5d029d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.248838 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b36672-b09f-4915-826c-0a2a5d029d7e admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.249529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b36672-b09f-4915-826c-0a2a5d029d7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:03.251716 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b36672-b09f-4915-826c-0a2a5d029d7e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:03.286772 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1048/2139] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:03 2022] POST /identity/v3/projects => generated 389 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:03.287742 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b36672-b09f-4915-826c-0a2a5d029d7e admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:03.289412 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-32b36672-b09f-4915-826c-0a2a5d029d7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:03.294438 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-99284677-7eb5-40d1-8af5-7f92278a9b13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '252bd51368f8483eba938cad3409bd31', 'request_id': 'req-99284677-7eb5-40d1-8af5-7f92278a9b13'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:03.300695 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-99284677-7eb5-40d1-8af5-7f92278a9b13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '252bd51368f8483eba938cad3409bd31', 'request_id': 'req-99284677-7eb5-40d1-8af5-7f92278a9b13'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:03.308129 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-99284677-7eb5-40d1-8af5-7f92278a9b13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '252bd51368f8483eba938cad3409bd31', 'request_id': 'req-99284677-7eb5-40d1-8af5-7f92278a9b13'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:03.333375 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-99284677-7eb5-40d1-8af5-7f92278a9b13 admin admin] The token cache is being invalidate because project 252bd51368f8483eba938cad3409bd31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:03.333880 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-99284677-7eb5-40d1-8af5-7f92278a9b13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:03.334736 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-99284677-7eb5-40d1-8af5-7f92278a9b13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:03.336446 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1092/2140] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:03 2022] DELETE /identity/v3/projects/252bd51368f8483eba938cad3409bd31 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:03.337330 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99284677-7eb5-40d1-8af5-7f92278a9b13 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:03.338619 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-99284677-7eb5-40d1-8af5-7f92278a9b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:03.370213 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b36672-b09f-4915-826c-0a2a5d029d7e admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:03.380285 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8e2074-80dd-4f6f-b3bd-f8460c729369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:03.381047 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e2074-80dd-4f6f-b3bd-f8460c729369 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.381398 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e2074-80dd-4f6f-b3bd-f8460c729369 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.381741 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8e2074-80dd-4f6f-b3bd-f8460c729369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.384005 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4b8e2074-80dd-4f6f-b3bd-f8460c729369 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:03.406568 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99284677-7eb5-40d1-8af5-7f92278a9b13 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:03.466195 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e2074-80dd-4f6f-b3bd-f8460c729369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:03.468202 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8e2074-80dd-4f6f-b3bd-f8460c729369 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:03.475351 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d29a4-8e0a-4a8a-acda-c61bd98f53f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:03.476191 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d29a4-8e0a-4a8a-acda-c61bd98f53f4 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.476501 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d29a4-8e0a-4a8a-acda-c61bd98f53f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.477522 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d29a4-8e0a-4a8a-acda-c61bd98f53f4 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.478243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1049/2141] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:03.478580 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d29a4-8e0a-4a8a-acda-c61bd98f53f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:03.480673 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24675a-67c7-4215-b93a-82909ce998cf None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.480933 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d29a4-8e0a-4a8a-acda-c61bd98f53f4 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:03.481235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24675a-67c7-4215-b93a-82909ce998cf None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.481594 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24675a-67c7-4215-b93a-82909ce998cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.510476 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1093/2142] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:03 2022] POST /identity/v3/users => generated 295 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:03.510476 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d29a4-8e0a-4a8a-acda-c61bd98f53f4 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:03.510476 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4a1d29a4-8e0a-4a8a-acda-c61bd98f53f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:03.511567 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-de24675a-67c7-4215-b93a-82909ce998cf None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:03.512680 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-de24675a-67c7-4215-b93a-82909ce998cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:03.522499 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1050/2143] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:03.523588 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24675a-67c7-4215-b93a-82909ce998cf None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:03.530063 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d29a4-8e0a-4a8a-acda-c61bd98f53f4 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:03.535553 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706ff27-79ae-41be-a111-ab2bfa8124c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:03.536474 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706ff27-79ae-41be-a111-ab2bfa8124c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.536748 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706ff27-79ae-41be-a111-ab2bfa8124c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.537021 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706ff27-79ae-41be-a111-ab2bfa8124c0 admin admin] PATH_INFO: `/v3/projects/412eef641a574ff9a31726d06092b2c9` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.538204 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706ff27-79ae-41be-a111-ab2bfa8124c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=412eef641a574ff9a31726d06092b2c9)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:03.539457 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24675a-67c7-4215-b93a-82909ce998cf None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:03.540170 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706ff27-79ae-41be-a111-ab2bfa8124c0 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:03.544146 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62edc5-4daf-4ffe-be57-fc91ff1566da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:03.544810 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62edc5-4daf-4ffe-be57-fc91ff1566da admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.545837 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62edc5-4daf-4ffe-be57-fc91ff1566da admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.546119 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62edc5-4daf-4ffe-be57-fc91ff1566da admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.547000 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62edc5-4daf-4ffe-be57-fc91ff1566da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:03.548590 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62edc5-4daf-4ffe-be57-fc91ff1566da admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:03.561726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1051/2144] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:03.561726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8643da-8230-46d3-9bc0-6748bc8967bc None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.561726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8643da-8230-46d3-9bc0-6748bc8967bc None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.561726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8643da-8230-46d3-9bc0-6748bc8967bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.580344 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-4b8643da-8230-46d3-9bc0-6748bc8967bc None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:03.582004 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4b8643da-8230-46d3-9bc0-6748bc8967bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:03.592787 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-9706ff27-79ae-41be-a111-ab2bfa8124c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '412eef641a574ff9a31726d06092b2c9', 'request_id': 'req-9706ff27-79ae-41be-a111-ab2bfa8124c0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:03.598686 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-9706ff27-79ae-41be-a111-ab2bfa8124c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '412eef641a574ff9a31726d06092b2c9', 'request_id': 'req-9706ff27-79ae-41be-a111-ab2bfa8124c0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:03.606721 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-9706ff27-79ae-41be-a111-ab2bfa8124c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '412eef641a574ff9a31726d06092b2c9', 'request_id': 'req-9706ff27-79ae-41be-a111-ab2bfa8124c0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:03.627366 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-9706ff27-79ae-41be-a111-ab2bfa8124c0 admin admin] The token cache is being invalidate because project 412eef641a574ff9a31726d06092b2c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:03.627940 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-9706ff27-79ae-41be-a111-ab2bfa8124c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:03.628767 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-9706ff27-79ae-41be-a111-ab2bfa8124c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:03.630916 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1094/2145] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:03 2022] DELETE /identity/v3/projects/412eef641a574ff9a31726d06092b2c9 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:03.631284 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706ff27-79ae-41be-a111-ab2bfa8124c0 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:03.632594 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9706ff27-79ae-41be-a111-ab2bfa8124c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:03.667399 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1052/2146] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:03.669294 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d0243-b8e3-40db-9171-dc4ed3ef07af None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.669748 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d0243-b8e3-40db-9171-dc4ed3ef07af None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.670425 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d0243-b8e3-40db-9171-dc4ed3ef07af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.690236 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-936d0243-b8e3-40db-9171-dc4ed3ef07af None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:03.691702 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-936d0243-b8e3-40db-9171-dc4ed3ef07af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:03.700035 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1053/2147] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:03.701025 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d0243-b8e3-40db-9171-dc4ed3ef07af None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:03.718702 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706ff27-79ae-41be-a111-ab2bfa8124c0 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:03.719319 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d0243-b8e3-40db-9171-dc4ed3ef07af None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:03.723327 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3ba89-11cb-496b-9371-15d555d0bdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:03.723989 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3ba89-11cb-496b-9371-15d555d0bdce admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.724268 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3ba89-11cb-496b-9371-15d555d0bdce admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.724538 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3ba89-11cb-496b-9371-15d555d0bdce admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.725255 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3ba89-11cb-496b-9371-15d555d0bdce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:03.725865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d22f59-6a71-4b1e-be20-dabe0f02d639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:03.726782 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d22f59-6a71-4b1e-be20-dabe0f02d639 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.726915 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3ba89-11cb-496b-9371-15d555d0bdce admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:03.727423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d22f59-6a71-4b1e-be20-dabe0f02d639 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.727709 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d22f59-6a71-4b1e-be20-dabe0f02d639 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.728439 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d22f59-6a71-4b1e-be20-dabe0f02d639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:52:03.728748 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d22f59-6a71-4b1e-be20-dabe0f02d639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:03.730378 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d22f59-6a71-4b1e-be20-dabe0f02d639 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:03.740163 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1095/2148] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:03.740163 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb5edd-da47-4570-ad88-c9acd2f9dfaa None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.740163 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb5edd-da47-4570-ad88-c9acd2f9dfaa None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.740163 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fb5edd-da47-4570-ad88-c9acd2f9dfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.750444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1054/2149] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:52:03.751652 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d22f59-6a71-4b1e-be20-dabe0f02d639 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:03.757782 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-c5fb5edd-da47-4570-ad88-c9acd2f9dfaa None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:03.759113 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-c5fb5edd-da47-4570-ad88-c9acd2f9dfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:03.762915 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d22f59-6a71-4b1e-be20-dabe0f02d639 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:03.770829 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1096/2150] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:03.770829 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb5edd-da47-4570-ad88-c9acd2f9dfaa None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:03.772396 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b3838-a976-4de5-9eb0-4a558aa1225b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:03.773396 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b3838-a976-4de5-9eb0-4a558aa1225b admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.773868 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b3838-a976-4de5-9eb0-4a558aa1225b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.774234 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b3838-a976-4de5-9eb0-4a558aa1225b admin admin] PATH_INFO: `/v3/projects/8dd57077e3604d8c8fb3ca58dbb64a1c/users/49a2fa85335f47a9adc74656ee1609ba/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.778245 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fb5edd-da47-4570-ad88-c9acd2f9dfaa None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:03.783527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02210c-6fa0-4200-a0b9-2dd2e235dd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:03.784248 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02210c-6fa0-4200-a0b9-2dd2e235dd04 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.784596 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02210c-6fa0-4200-a0b9-2dd2e235dd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.784933 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02210c-6fa0-4200-a0b9-2dd2e235dd04 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.785680 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02210c-6fa0-4200-a0b9-2dd2e235dd04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:03.787688 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02210c-6fa0-4200-a0b9-2dd2e235dd04 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:03.799921 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b3838-a976-4de5-9eb0-4a558aa1225b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd57077e3604d8c8fb3ca58dbb64a1c, user_id=49a2fa85335f47a9adc74656ee1609ba, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:03.803445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b3838-a976-4de5-9eb0-4a558aa1225b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:03.818619 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1097/2151] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:03 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:03.822580 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02210c-6fa0-4200-a0b9-2dd2e235dd04 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:03.828867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1055/2152] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:03 2022] PUT /identity/v3/projects/8dd57077e3604d8c8fb3ca58dbb64a1c/users/49a2fa85335f47a9adc74656ee1609ba/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:03.828867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b3838-a976-4de5-9eb0-4a558aa1225b admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:03.830381 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0d0b3838-a976-4de5-9eb0-4a558aa1225b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:03.902948 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b3838-a976-4de5-9eb0-4a558aa1225b admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:03.904770 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02210c-6fa0-4200-a0b9-2dd2e235dd04 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:03.910314 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5ed5a-18e7-4fcf-bdb1-f0212208ea66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:03.911079 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5ed5a-18e7-4fcf-bdb1-f0212208ea66 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.911237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e7631-6e40-4792-877c-0d56daa73782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:03.911474 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5ed5a-18e7-4fcf-bdb1-f0212208ea66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.911818 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5ed5a-18e7-4fcf-bdb1-f0212208ea66 admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.912100 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e7631-6e40-4792-877c-0d56daa73782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.912400 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e7631-6e40-4792-877c-0d56daa73782 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.912699 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e7631-6e40-4792-877c-0d56daa73782 admin admin] PATH_INFO: `/v3/projects/578841aa960c43698576e1656b942435` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.912803 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5ed5a-18e7-4fcf-bdb1-f0212208ea66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:52:03.914700 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5ed5a-18e7-4fcf-bdb1-f0212208ea66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:03.915093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5ed5a-18e7-4fcf-bdb1-f0212208ea66 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:03.918429 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e7631-6e40-4792-877c-0d56daa73782 admin admin] RBAC: Authorizing `identity:delete_project(project_id=578841aa960c43698576e1656b942435)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:03.918429 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e7631-6e40-4792-877c-0d56daa73782 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:03.930292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1098/2153] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:52:03.931307 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5ed5a-18e7-4fcf-bdb1-f0212208ea66 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:03.942655 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5ed5a-18e7-4fcf-bdb1-f0212208ea66 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:03.950520 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7023ad-bc43-4212-a2f2-70f4c87fef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:03.951951 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7023ad-bc43-4212-a2f2-70f4c87fef30 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.952327 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7023ad-bc43-4212-a2f2-70f4c87fef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.952718 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7023ad-bc43-4212-a2f2-70f4c87fef30 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.953506 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7023ad-bc43-4212-a2f2-70f4c87fef30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:03.955561 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7023ad-bc43-4212-a2f2-70f4c87fef30 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:03.986087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d26e7631-6e40-4792-877c-0d56daa73782 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578841aa960c43698576e1656b942435', 'request_id': 'req-d26e7631-6e40-4792-877c-0d56daa73782'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:03.989711 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1099/2154] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:03 2022] POST /identity/v3/users => generated 300 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:03.989711 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f841f-eb83-49c1-b752-78cc949bf720 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:03.989711 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f841f-eb83-49c1-b752-78cc949bf720 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:03.989711 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f841f-eb83-49c1-b752-78cc949bf720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:03.992407 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d26e7631-6e40-4792-877c-0d56daa73782 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578841aa960c43698576e1656b942435', 'request_id': 'req-d26e7631-6e40-4792-877c-0d56daa73782'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:04.000719 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d26e7631-6e40-4792-877c-0d56daa73782 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578841aa960c43698576e1656b942435', 'request_id': 'req-d26e7631-6e40-4792-877c-0d56daa73782'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:04.013355 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d26e7631-6e40-4792-877c-0d56daa73782 admin admin] The token cache is being invalidate because project 578841aa960c43698576e1656b942435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:04.014146 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d26e7631-6e40-4792-877c-0d56daa73782 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:04.014809 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d26e7631-6e40-4792-877c-0d56daa73782 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:04.015546 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-9c5f841f-eb83-49c1-b752-78cc949bf720 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:04.016364 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1056/2155] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:03 2022] DELETE /identity/v3/projects/578841aa960c43698576e1656b942435 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:04.016748 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9c5f841f-eb83-49c1-b752-78cc949bf720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:04.017097 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e7631-6e40-4792-877c-0d56daa73782 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:04.018340 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d26e7631-6e40-4792-877c-0d56daa73782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:04.074654 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1100/2156] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:04.075427 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f841f-eb83-49c1-b752-78cc949bf720 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:04.077240 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9c5f841f-eb83-49c1-b752-78cc949bf720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:04.087170 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e7631-6e40-4792-877c-0d56daa73782 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:04.088902 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f841f-eb83-49c1-b752-78cc949bf720 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:04.091870 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75232ba4-729b-475f-a6f8-1f18daf224b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:04.093025 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75232ba4-729b-475f-a6f8-1f18daf224b2 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:04.093331 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75232ba4-729b-475f-a6f8-1f18daf224b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:04.093602 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75232ba4-729b-475f-a6f8-1f18daf224b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:04.094067 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b86c2c-df69-4623-8947-4ba19abf8f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:04.094287 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75232ba4-729b-475f-a6f8-1f18daf224b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:04.094762 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b86c2c-df69-4623-8947-4ba19abf8f78 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:04.095033 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b86c2c-df69-4623-8947-4ba19abf8f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:04.095310 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b86c2c-df69-4623-8947-4ba19abf8f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:04.096120 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b86c2c-df69-4623-8947-4ba19abf8f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:04.096543 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75232ba4-729b-475f-a6f8-1f18daf224b2 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:04.097755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b86c2c-df69-4623-8947-4ba19abf8f78 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:04.108298 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1101/2157] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:04.109161 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b86c2c-df69-4623-8947-4ba19abf8f78 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:04.111011 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-62b86c2c-df69-4623-8947-4ba19abf8f78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:04.124477 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b86c2c-df69-4623-8947-4ba19abf8f78 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:04.124643 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1057/2158] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:04 2022] POST /identity/v3/projects => generated 377 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:04.125288 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75232ba4-729b-475f-a6f8-1f18daf224b2 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:04.128863 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-75232ba4-729b-475f-a6f8-1f18daf224b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:04.179991 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a27a8e-67dc-4913-a4b7-667eea01c05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:04.180862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a27a8e-67dc-4913-a4b7-667eea01c05e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:04.181139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a27a8e-67dc-4913-a4b7-667eea01c05e admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:04.181412 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a27a8e-67dc-4913-a4b7-667eea01c05e admin admin] PATH_INFO: `/v3/users/8524531cf15f47a2953ad5a007e9c45e` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:04.182613 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a27a8e-67dc-4913-a4b7-667eea01c05e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8524531cf15f47a2953ad5a007e9c45e)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:04.182827 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75232ba4-729b-475f-a6f8-1f18daf224b2 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:04.184567 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a27a8e-67dc-4913-a4b7-667eea01c05e admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:04.186943 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1c20d-4aca-45df-a0a3-88e464a11d25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:04.187585 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1c20d-4aca-45df-a0a3-88e464a11d25 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:04.187865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1c20d-4aca-45df-a0a3-88e464a11d25 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:04.188144 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1c20d-4aca-45df-a0a3-88e464a11d25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:04.200473 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1c20d-4aca-45df-a0a3-88e464a11d25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:04.203968 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1c20d-4aca-45df-a0a3-88e464a11d25 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:04.213088 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1058/2159] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:04.214052 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1c20d-4aca-45df-a0a3-88e464a11d25 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:04.227931 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1c20d-4aca-45df-a0a3-88e464a11d25 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:04.234284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11e6d1-0560-4ee3-b28b-c0729dcc1335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:04.243460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11e6d1-0560-4ee3-b28b-c0729dcc1335 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:04.243460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11e6d1-0560-4ee3-b28b-c0729dcc1335 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:04.243460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca11e6d1-0560-4ee3-b28b-c0729dcc1335 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:04.243460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11e6d1-0560-4ee3-b28b-c0729dcc1335 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:04.243460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca11e6d1-0560-4ee3-b28b-c0729dcc1335 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:04.250084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1059/2160] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:04.250804 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11e6d1-0560-4ee3-b28b-c0729dcc1335 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:04.252991 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a6a27a8e-67dc-4913-a4b7-667eea01c05e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8524531cf15f47a2953ad5a007e9c45e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:04.254213 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a6a27a8e-67dc-4913-a4b7-667eea01c05e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8524531cf15f47a2953ad5a007e9c45e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:04.261315 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca11e6d1-0560-4ee3-b28b-c0729dcc1335 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:04.262472 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a6a27a8e-67dc-4913-a4b7-667eea01c05e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8524531cf15f47a2953ad5a007e9c45e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:04.267543 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06b453-9e5a-44e2-a34f-d421f850fed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:04.268201 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06b453-9e5a-44e2-a34f-d421f850fed3 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:04.268485 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06b453-9e5a-44e2-a34f-d421f850fed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:04.269026 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06b453-9e5a-44e2-a34f-d421f850fed3 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:04.269755 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06b453-9e5a-44e2-a34f-d421f850fed3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:04.271825 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06b453-9e5a-44e2-a34f-d421f850fed3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:04.272163 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a6a27a8e-67dc-4913-a4b7-667eea01c05e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8524531cf15f47a2953ad5a007e9c45e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:04.286825 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a6a27a8e-67dc-4913-a4b7-667eea01c05e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8524531cf15f47a2953ad5a007e9c45e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:04.293437 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1060/2161] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:04 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:04.297402 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06b453-9e5a-44e2-a34f-d421f850fed3 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:04.302859 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ba06b453-9e5a-44e2-a34f-d421f850fed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:04.303053 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1102/2162] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:04 2022] DELETE /identity/v3/users/8524531cf15f47a2953ad5a007e9c45e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:04.303053 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a27a8e-67dc-4913-a4b7-667eea01c05e admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:04.305923 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a6a27a8e-67dc-4913-a4b7-667eea01c05e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:04.316304 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06b453-9e5a-44e2-a34f-d421f850fed3 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:04.387435 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a27a8e-67dc-4913-a4b7-667eea01c05e admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:04.394341 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54950ec-71cf-41e2-8c96-f7d311e3c2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:04.395172 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54950ec-71cf-41e2-8c96-f7d311e3c2bc admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:04.395454 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54950ec-71cf-41e2-8c96-f7d311e3c2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:04.395782 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54950ec-71cf-41e2-8c96-f7d311e3c2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:04.396739 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54950ec-71cf-41e2-8c96-f7d311e3c2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:04.399149 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54950ec-71cf-41e2-8c96-f7d311e3c2bc admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:04.400037 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acc94e-7edc-4e5d-9a00-bcd6c22d8d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:04.403286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acc94e-7edc-4e5d-9a00-bcd6c22d8d85 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:04.403650 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acc94e-7edc-4e5d-9a00-bcd6c22d8d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:04.404934 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acc94e-7edc-4e5d-9a00-bcd6c22d8d85 admin admin] PATH_INFO: `/v3/projects/5237d7452c09429b829e9763a555449c/users/faae6d82c677495c94fa217d0ae5af2e/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:04.414701 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1103/2163] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:04.419669 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54950ec-71cf-41e2-8c96-f7d311e3c2bc admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:04.431724 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acc94e-7edc-4e5d-9a00-bcd6c22d8d85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5237d7452c09429b829e9763a555449c, user_id=faae6d82c677495c94fa217d0ae5af2e, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:04.434508 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acc94e-7edc-4e5d-9a00-bcd6c22d8d85 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:04.439228 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54950ec-71cf-41e2-8c96-f7d311e3c2bc admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:04.447177 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e50f2-eefa-4c33-97c0-22c492da6401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:04.449459 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e50f2-eefa-4c33-97c0-22c492da6401 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:04.449994 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e50f2-eefa-4c33-97c0-22c492da6401 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:04.450643 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e50f2-eefa-4c33-97c0-22c492da6401 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:04.452256 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1061/2164] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:04 2022] PUT /identity/v3/projects/5237d7452c09429b829e9763a555449c/users/faae6d82c677495c94fa217d0ae5af2e/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:04.453690 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e50f2-eefa-4c33-97c0-22c492da6401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:04.456327 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e50f2-eefa-4c33-97c0-22c492da6401 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:04.469091 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365aeedd-3219-4487-a21f-59ff86bf6c29 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:04.469419 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365aeedd-3219-4487-a21f-59ff86bf6c29 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:04.469714 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365aeedd-3219-4487-a21f-59ff86bf6c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:04.470646 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1104/2165] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:52:04.475361 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e50f2-eefa-4c33-97c0-22c492da6401 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:04.486360 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e50f2-eefa-4c33-97c0-22c492da6401 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:04.517104 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-365aeedd-3219-4487-a21f-59ff86bf6c29 None None] MFA Rules not processed for user `faae6d82c677495c94fa217d0ae5af2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:04.518878 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-365aeedd-3219-4487-a21f-59ff86bf6c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:04.574481 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f331e08-9442-4677-8369-e7d77807c690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:04.575602 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f331e08-9442-4677-8369-e7d77807c690 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:04.575953 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f331e08-9442-4677-8369-e7d77807c690 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:04.576901 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f331e08-9442-4677-8369-e7d77807c690 admin admin] PATH_INFO: `/v3/projects/6341e5f3b2e3429a94049772414121d6/users/acbfeb624831415c816938d09e0393be/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:04.596585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f331e08-9442-4677-8369-e7d77807c690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6341e5f3b2e3429a94049772414121d6, user_id=acbfeb624831415c816938d09e0393be, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:04.600274 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f331e08-9442-4677-8369-e7d77807c690 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:04.609397 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1062/2166] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:52:04.621543 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365aeedd-3219-4487-a21f-59ff86bf6c29 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:04.628656 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-365aeedd-3219-4487-a21f-59ff86bf6c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:04.629124 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1105/2167] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:04 2022] PUT /identity/v3/projects/6341e5f3b2e3429a94049772414121d6/users/acbfeb624831415c816938d09e0393be/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:52:04.642490 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46c4d7-a372-4afe-a1fe-3b77e7ec18a4 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:04.643891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46c4d7-a372-4afe-a1fe-3b77e7ec18a4 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:04.644702 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46c4d7-a372-4afe-a1fe-3b77e7ec18a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:04.693475 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-0b46c4d7-a372-4afe-a1fe-3b77e7ec18a4 None None] MFA Rules not processed for user `acbfeb624831415c816938d09e0393be`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:04.698185 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-0b46c4d7-a372-4afe-a1fe-3b77e7ec18a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:04.745596 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365aeedd-3219-4487-a21f-59ff86bf6c29 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:04.816117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1106/2168] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:52:04.817025 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46c4d7-a372-4afe-a1fe-3b77e7ec18a4 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:04.819634 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-0b46c4d7-a372-4afe-a1fe-3b77e7ec18a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:04.820874 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45cf25-bc26-4b62-890c-36231036257f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:04.821520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45cf25-bc26-4b62-890c-36231036257f service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:04.821794 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45cf25-bc26-4b62-890c-36231036257f service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:04.822825 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45cf25-bc26-4b62-890c-36231036257f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:04.912938 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45cf25-bc26-4b62-890c-36231036257f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:04.913154 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b46c4d7-a372-4afe-a1fe-3b77e7ec18a4 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:04.921139 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e45cf25-bc26-4b62-890c-36231036257f service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:04.928373 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2855308-cf17-4eb0-9003-23480b1cd7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:04.929932 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2855308-cf17-4eb0-9003-23480b1cd7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:04.930341 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2855308-cf17-4eb0-9003-23480b1cd7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:04.930815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2855308-cf17-4eb0-9003-23480b1cd7e0 admin admin] PATH_INFO: `/v3/projects/1423696b9fd942a896ab82308d8d64e2` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:04.932942 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2855308-cf17-4eb0-9003-23480b1cd7e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1423696b9fd942a896ab82308d8d64e2)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:04.938624 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2855308-cf17-4eb0-9003-23480b1cd7e0 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:04.940498 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1063/2169] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:04.942880 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45cf25-bc26-4b62-890c-36231036257f service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:04.948983 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4e45cf25-bc26-4b62-890c-36231036257f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:04.965868 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45cf25-bc26-4b62-890c-36231036257f service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:04.981625 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d3840-8d47-4fec-9d69-c348899e0188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:04.982336 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d3840-8d47-4fec-9d69-c348899e0188 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:04.983501 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d3840-8d47-4fec-9d69-c348899e0188 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:04.983913 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d3840-8d47-4fec-9d69-c348899e0188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:05.003826 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d3840-8d47-4fec-9d69-c348899e0188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:05.006084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d3840-8d47-4fec-9d69-c348899e0188 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:05.022886 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a2855308-cf17-4eb0-9003-23480b1cd7e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1423696b9fd942a896ab82308d8d64e2', 'request_id': 'req-a2855308-cf17-4eb0-9003-23480b1cd7e0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:05.031905 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1064/2170] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:05.047923 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a2855308-cf17-4eb0-9003-23480b1cd7e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1423696b9fd942a896ab82308d8d64e2', 'request_id': 'req-a2855308-cf17-4eb0-9003-23480b1cd7e0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:05.063600 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a2855308-cf17-4eb0-9003-23480b1cd7e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1423696b9fd942a896ab82308d8d64e2', 'request_id': 'req-a2855308-cf17-4eb0-9003-23480b1cd7e0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:05.079005 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a2855308-cf17-4eb0-9003-23480b1cd7e0 admin admin] The token cache is being invalidate because project 1423696b9fd942a896ab82308d8d64e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:05.079579 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a2855308-cf17-4eb0-9003-23480b1cd7e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:05.080708 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a2855308-cf17-4eb0-9003-23480b1cd7e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:05.087084 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1107/2171] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:04 2022] DELETE /identity/v3/projects/1423696b9fd942a896ab82308d8d64e2 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:05.097624 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d3cb8-9c6e-4ab1-97dd-a6e930a05163 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:05.098000 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d3cb8-9c6e-4ab1-97dd-a6e930a05163 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:05.098288 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d3cb8-9c6e-4ab1-97dd-a6e930a05163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:05.122025 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-d37d3cb8-9c6e-4ab1-97dd-a6e930a05163 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:05.123365 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d37d3cb8-9c6e-4ab1-97dd-a6e930a05163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:05.266874 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1065/2172] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:05.275334 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d6a68-1fb3-4e35-a8b7-6a2865d83df1 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:05.275673 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d6a68-1fb3-4e35-a8b7-6a2865d83df1 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:05.275958 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d6a68-1fb3-4e35-a8b7-6a2865d83df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:05.322095 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-ab7d6a68-1fb3-4e35-a8b7-6a2865d83df1 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:05.323594 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-ab7d6a68-1fb3-4e35-a8b7-6a2865d83df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:05.347054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1108/2173] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:05.351522 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d3cb8-9c6e-4ab1-97dd-a6e930a05163 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:05.376838 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d3cb8-9c6e-4ab1-97dd-a6e930a05163 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:05.384346 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e3384-bb10-40fc-855f-a997c15c5b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:05.385307 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e3384-bb10-40fc-855f-a997c15c5b72 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:05.386130 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e3384-bb10-40fc-855f-a997c15c5b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:05.386130 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e3384-bb10-40fc-855f-a997c15c5b72 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:05.390577 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e3384-bb10-40fc-855f-a997c15c5b72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:52:05.390577 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e3384-bb10-40fc-855f-a997c15c5b72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:05.390577 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e3384-bb10-40fc-855f-a997c15c5b72 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:05.403818 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1066/2174] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:52:05.407839 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d6a68-1fb3-4e35-a8b7-6a2865d83df1 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:05.422307 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d6a68-1fb3-4e35-a8b7-6a2865d83df1 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:05.431096 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbdb8d-3999-4896-b380-63b836d87cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:05.434144 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbdb8d-3999-4896-b380-63b836d87cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:05.434498 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbdb8d-3999-4896-b380-63b836d87cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:05.434864 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbdb8d-3999-4896-b380-63b836d87cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:05.438857 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbdb8d-3999-4896-b380-63b836d87cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:05.441153 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbdb8d-3999-4896-b380-63b836d87cf1 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:05.514828 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1109/2175] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:05 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:05.519103 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e3384-bb10-40fc-855f-a997c15c5b72 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:05.539738 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e3384-bb10-40fc-855f-a997c15c5b72 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:05.800084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b64ba-75e4-4c42-997c-f61b1731b6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:05.800902 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b64ba-75e4-4c42-997c-f61b1731b6c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:05.801074 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b64ba-75e4-4c42-997c-f61b1731b6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:05.801423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6b64ba-75e4-4c42-997c-f61b1731b6c6 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:05.802245 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b64ba-75e4-4c42-997c-f61b1731b6c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:05.805450 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6b64ba-75e4-4c42-997c-f61b1731b6c6 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:05.829267 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1067/2176] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:05 2022] POST /identity/v3/users => generated 283 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:05.833270 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbdb8d-3999-4896-b380-63b836d87cf1 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:05.844111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbdb8d-3999-4896-b380-63b836d87cf1 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:05.849284 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30575e1-aec7-4997-9f25-f683af12fc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:05.849727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30575e1-aec7-4997-9f25-f683af12fc04 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:05.850010 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30575e1-aec7-4997-9f25-f683af12fc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:05.850288 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30575e1-aec7-4997-9f25-f683af12fc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:05.851454 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30575e1-aec7-4997-9f25-f683af12fc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:05.852812 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30575e1-aec7-4997-9f25-f683af12fc04 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:05.871666 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1110/2177] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:52:05.875666 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b64ba-75e4-4c42-997c-f61b1731b6c6 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:05.889674 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6b64ba-75e4-4c42-997c-f61b1731b6c6 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:05.894623 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d59c4-1236-41ad-862b-735059dee72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:05.895616 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d59c4-1236-41ad-862b-735059dee72d admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:05.895975 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d59c4-1236-41ad-862b-735059dee72d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:05.896305 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d59c4-1236-41ad-862b-735059dee72d admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:05.898614 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d59c4-1236-41ad-862b-735059dee72d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:05.898781 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d59c4-1236-41ad-862b-735059dee72d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:05.912906 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1068/2178] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:05.914096 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30575e1-aec7-4997-9f25-f683af12fc04 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:05.928216 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30575e1-aec7-4997-9f25-f683af12fc04 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:05.935317 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770598f-a051-43fd-ace2-17489c1e80a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:05.936893 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770598f-a051-43fd-ace2-17489c1e80a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:05.937182 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770598f-a051-43fd-ace2-17489c1e80a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:05.937509 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770598f-a051-43fd-ace2-17489c1e80a3 admin admin] PATH_INFO: `/v3/projects/b31f2a14a51649eca15f333fdeabd020/users/d16d3fbf45a748d3b476cfabdb660b6b/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:05.956095 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770598f-a051-43fd-ace2-17489c1e80a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b31f2a14a51649eca15f333fdeabd020, user_id=d16d3fbf45a748d3b476cfabdb660b6b, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:05.958782 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1770598f-a051-43fd-ace2-17489c1e80a3 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:05.977420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1111/2179] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:05 2022] PUT /identity/v3/projects/b31f2a14a51649eca15f333fdeabd020/users/d16d3fbf45a748d3b476cfabdb660b6b/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:05.990556 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a76640-a8ed-4c34-b9ac-10c5ee57b5c1 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:05.990940 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a76640-a8ed-4c34-b9ac-10c5ee57b5c1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:05.991392 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a76640-a8ed-4c34-b9ac-10c5ee57b5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:06.024190 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f5a76640-a8ed-4c34-b9ac-10c5ee57b5c1 None None] MFA Rules not processed for user `d16d3fbf45a748d3b476cfabdb660b6b`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:06.025426 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f5a76640-a8ed-4c34-b9ac-10c5ee57b5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:06.098635 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1069/2180] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:05 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:06.102571 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770598f-a051-43fd-ace2-17489c1e80a3 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:06.189008 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770598f-a051-43fd-ace2-17489c1e80a3 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:06.194882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61535333-722b-49ea-a12a-9e43f9c09d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:06.195568 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61535333-722b-49ea-a12a-9e43f9c09d7b admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:06.195859 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61535333-722b-49ea-a12a-9e43f9c09d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:06.196255 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61535333-722b-49ea-a12a-9e43f9c09d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:06.196975 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61535333-722b-49ea-a12a-9e43f9c09d7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:06.199060 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61535333-722b-49ea-a12a-9e43f9c09d7b admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:06.230202 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1112/2181] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:06 2022] POST /identity/v3/projects => generated 363 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:06.231857 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a76640-a8ed-4c34-b9ac-10c5ee57b5c1 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:06.243688 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a76640-a8ed-4c34-b9ac-10c5ee57b5c1 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:06.312663 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b7ded-c172-4e3e-b591-eb96b4319ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:06.313377 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b7ded-c172-4e3e-b591-eb96b4319ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:06.313660 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b7ded-c172-4e3e-b591-eb96b4319ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:06.313943 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b7ded-c172-4e3e-b591-eb96b4319ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:06.314675 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b7ded-c172-4e3e-b591-eb96b4319ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:06.316674 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b7ded-c172-4e3e-b591-eb96b4319ab4 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:06.356398 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1070/2182] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:06 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:06.362345 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61535333-722b-49ea-a12a-9e43f9c09d7b admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:06.386265 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61535333-722b-49ea-a12a-9e43f9c09d7b admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:06.391998 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db69a78-4591-4749-b607-9e8c0fa85bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:06.392835 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db69a78-4591-4749-b607-9e8c0fa85bbb admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:06.393128 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db69a78-4591-4749-b607-9e8c0fa85bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:06.393406 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db69a78-4591-4749-b607-9e8c0fa85bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:06.394150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db69a78-4591-4749-b607-9e8c0fa85bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:06.395903 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db69a78-4591-4749-b607-9e8c0fa85bbb admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:06.412643 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1113/2183] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:06.416922 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b7ded-c172-4e3e-b591-eb96b4319ab4 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:06.430426 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b7ded-c172-4e3e-b591-eb96b4319ab4 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:06.436594 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9129ce-a821-4887-baa3-e69a18207aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:06.437869 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9129ce-a821-4887-baa3-e69a18207aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:06.438157 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9129ce-a821-4887-baa3-e69a18207aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:06.438433 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9129ce-a821-4887-baa3-e69a18207aeb admin admin] PATH_INFO: `/v3/projects/c6039f2337404746a3cdb58ba04dd7dd/users/dff082b088aa485c8983fd8b9815d3b4/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:06.456344 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9129ce-a821-4887-baa3-e69a18207aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6039f2337404746a3cdb58ba04dd7dd, user_id=dff082b088aa485c8983fd8b9815d3b4, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:06.459200 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9129ce-a821-4887-baa3-e69a18207aeb admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:06.474631 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1071/2184] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:06 2022] PUT /identity/v3/projects/c6039f2337404746a3cdb58ba04dd7dd/users/dff082b088aa485c8983fd8b9815d3b4/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:06.478526 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db69a78-4591-4749-b607-9e8c0fa85bbb admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:06.490952 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db69a78-4591-4749-b607-9e8c0fa85bbb admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:06.579252 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f552d8-0bc8-4eaf-b436-9c59f1a27f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:06.583105 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f552d8-0bc8-4eaf-b436-9c59f1a27f96 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:06.583105 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f552d8-0bc8-4eaf-b436-9c59f1a27f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:06.583105 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f552d8-0bc8-4eaf-b436-9c59f1a27f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:06.583105 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f552d8-0bc8-4eaf-b436-9c59f1a27f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:06.583478 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f552d8-0bc8-4eaf-b436-9c59f1a27f96 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:06.596509 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1114/2185] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:52:06.600759 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9129ce-a821-4887-baa3-e69a18207aeb admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:06.613691 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9129ce-a821-4887-baa3-e69a18207aeb admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:06.618812 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af0d9a-c844-4cb9-9563-30f8919d5571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:06.619827 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af0d9a-c844-4cb9-9563-30f8919d5571 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:06.620183 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af0d9a-c844-4cb9-9563-30f8919d5571 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:06.620528 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87af0d9a-c844-4cb9-9563-30f8919d5571 admin admin] PATH_INFO: `/v3/projects/c6039f2337404746a3cdb58ba04dd7dd/users/dff082b088aa485c8983fd8b9815d3b4/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:06.623733 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af0d9a-c844-4cb9-9563-30f8919d5571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6039f2337404746a3cdb58ba04dd7dd, user_id=dff082b088aa485c8983fd8b9815d3b4, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:06.626446 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87af0d9a-c844-4cb9-9563-30f8919d5571 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:06.662711 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1072/2186] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:06 2022] PUT /identity/v3/projects/c6039f2337404746a3cdb58ba04dd7dd/users/dff082b088aa485c8983fd8b9815d3b4/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:06.663225 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec06b3f-5ce4-465c-8b9b-a774d1dd169d None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:06.663658 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec06b3f-5ce4-465c-8b9b-a774d1dd169d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:06.664076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec06b3f-5ce4-465c-8b9b-a774d1dd169d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:06.709267 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-3ec06b3f-5ce4-465c-8b9b-a774d1dd169d None None] MFA Rules not processed for user `dff082b088aa485c8983fd8b9815d3b4`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:06.710741 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3ec06b3f-5ce4-465c-8b9b-a774d1dd169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:06.821268 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1115/2187] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:06 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:52:06.916791 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af0d9a-c844-4cb9-9563-30f8919d5571 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:06.923259 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-87af0d9a-c844-4cb9-9563-30f8919d5571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:07.063482 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87af0d9a-c844-4cb9-9563-30f8919d5571 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:07.075231 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b198e1d-1ccf-457d-abdd-7be8e8fd2919 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:07.076800 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b198e1d-1ccf-457d-abdd-7be8e8fd2919 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:07.077220 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b198e1d-1ccf-457d-abdd-7be8e8fd2919 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:07.077769 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b198e1d-1ccf-457d-abdd-7be8e8fd2919 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:07.090137 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b198e1d-1ccf-457d-abdd-7be8e8fd2919 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:07.094064 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b198e1d-1ccf-457d-abdd-7be8e8fd2919 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:07.110690 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1073/2188] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:06 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:07.219253 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec06b3f-5ce4-465c-8b9b-a774d1dd169d None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:07.220734 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3ec06b3f-5ce4-465c-8b9b-a774d1dd169d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:07.237639 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec06b3f-5ce4-465c-8b9b-a774d1dd169d None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:07.242549 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5590da-6b0d-4539-8e75-191a30607be1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:07.243511 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5590da-6b0d-4539-8e75-191a30607be1 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:07.243889 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5590da-6b0d-4539-8e75-191a30607be1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:07.244237 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5590da-6b0d-4539-8e75-191a30607be1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:07.336203 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5590da-6b0d-4539-8e75-191a30607be1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:07.337671 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5590da-6b0d-4539-8e75-191a30607be1 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:07.351655 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1116/2189] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:09.208937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f056f31-8757-4996-a138-8573fffb232b None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:09.210079 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f056f31-8757-4996-a138-8573fffb232b None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:09.210574 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f056f31-8757-4996-a138-8573fffb232b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:09.241251 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3f056f31-8757-4996-a138-8573fffb232b None None] MFA Rules not processed for user `49a2fa85335f47a9adc74656ee1609ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:09.242476 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3f056f31-8757-4996-a138-8573fffb232b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:09.315778 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1074/2190] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:09.329100 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5590da-6b0d-4539-8e75-191a30607be1 service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:09.330676 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-7c5590da-6b0d-4539-8e75-191a30607be1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:09.405598 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5590da-6b0d-4539-8e75-191a30607be1 service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:09.411073 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd25cc8-b08e-4bba-835c-440c845a9f31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:09.411726 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd25cc8-b08e-4bba-835c-440c845a9f31 service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:09.412005 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd25cc8-b08e-4bba-835c-440c845a9f31 service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:09.412275 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd25cc8-b08e-4bba-835c-440c845a9f31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:09.420598 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd25cc8-b08e-4bba-835c-440c845a9f31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:09.422182 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd25cc8-b08e-4bba-835c-440c845a9f31 service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:09.436569 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1117/2191] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:10.948246 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09e64e-219f-43c4-8553-ab032f0c9f7c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:10.948684 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09e64e-219f-43c4-8553-ab032f0c9f7c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:10.948972 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09e64e-219f-43c4-8553-ab032f0c9f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:10.982689 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-aa09e64e-219f-43c4-8553-ab032f0c9f7c None None] MFA Rules not processed for user `49a2fa85335f47a9adc74656ee1609ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:10.984777 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-aa09e64e-219f-43c4-8553-ab032f0c9f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:10.996222 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1075/2192] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:11.258260 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd25cc8-b08e-4bba-835c-440c845a9f31 service nova] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:11.334832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd25cc8-b08e-4bba-835c-440c845a9f31 service nova] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:11.339153 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3064d8-1b2a-4fd8-a1e9-965e5f66e9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:11.340014 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3064d8-1b2a-4fd8-a1e9-965e5f66e9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:11.340293 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3064d8-1b2a-4fd8-a1e9-965e5f66e9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:11.340568 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3064d8-1b2a-4fd8-a1e9-965e5f66e9b3 admin admin] PATH_INFO: `/v3/users/d16d3fbf45a748d3b476cfabdb660b6b` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:11.341811 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3064d8-1b2a-4fd8-a1e9-965e5f66e9b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d16d3fbf45a748d3b476cfabdb660b6b)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:11.343792 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3064d8-1b2a-4fd8-a1e9-965e5f66e9b3 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:11.410537 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-0b3064d8-1b2a-4fd8-a1e9-965e5f66e9b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd16d3fbf45a748d3b476cfabdb660b6b'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:11.411222 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-0b3064d8-1b2a-4fd8-a1e9-965e5f66e9b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd16d3fbf45a748d3b476cfabdb660b6b'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:11.420349 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-0b3064d8-1b2a-4fd8-a1e9-965e5f66e9b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd16d3fbf45a748d3b476cfabdb660b6b'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:11.429247 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-0b3064d8-1b2a-4fd8-a1e9-965e5f66e9b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd16d3fbf45a748d3b476cfabdb660b6b'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:11.442036 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-0b3064d8-1b2a-4fd8-a1e9-965e5f66e9b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd16d3fbf45a748d3b476cfabdb660b6b'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:11.450680 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1118/2193] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:11 2022] DELETE /identity/v3/users/d16d3fbf45a748d3b476cfabdb660b6b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:11.453424 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6da44b-6d48-4692-8b5d-26774771659b None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:11.453713 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6da44b-6d48-4692-8b5d-26774771659b None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:11.454009 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6da44b-6d48-4692-8b5d-26774771659b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:11.472520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3c6da44b-6d48-4692-8b5d-26774771659b None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:11.473806 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3c6da44b-6d48-4692-8b5d-26774771659b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:11.536455 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1076/2194] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:11.545727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3064d8-1b2a-4fd8-a1e9-965e5f66e9b3 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:11.547375 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-0b3064d8-1b2a-4fd8-a1e9-965e5f66e9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:11.609124 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3064d8-1b2a-4fd8-a1e9-965e5f66e9b3 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:11.613539 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af72b6-bf3d-4b88-b341-096f6e2b5409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:11.614361 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af72b6-bf3d-4b88-b341-096f6e2b5409 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:11.614666 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af72b6-bf3d-4b88-b341-096f6e2b5409 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:11.614940 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53af72b6-bf3d-4b88-b341-096f6e2b5409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:11.626766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af72b6-bf3d-4b88-b341-096f6e2b5409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:11.628455 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53af72b6-bf3d-4b88-b341-096f6e2b5409 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:11.639787 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1119/2195] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:11.961737 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6da44b-6d48-4692-8b5d-26774771659b None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:11.963283 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3c6da44b-6d48-4692-8b5d-26774771659b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:11.992632 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6da44b-6d48-4692-8b5d-26774771659b None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:11.998435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d0cc0-ec83-4333-8b40-703f042e13c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:11.999444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d0cc0-ec83-4333-8b40-703f042e13c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:12.000155 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d0cc0-ec83-4333-8b40-703f042e13c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:12.000299 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d0cc0-ec83-4333-8b40-703f042e13c3 admin admin] PATH_INFO: `/v3/projects/b31f2a14a51649eca15f333fdeabd020` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:12.001727 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d0cc0-ec83-4333-8b40-703f042e13c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b31f2a14a51649eca15f333fdeabd020)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:12.005151 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d0cc0-ec83-4333-8b40-703f042e13c3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:12.076729 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-de3d0cc0-ec83-4333-8b40-703f042e13c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b31f2a14a51649eca15f333fdeabd020', 'request_id': 'req-de3d0cc0-ec83-4333-8b40-703f042e13c3'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:12.084058 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-de3d0cc0-ec83-4333-8b40-703f042e13c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b31f2a14a51649eca15f333fdeabd020', 'request_id': 'req-de3d0cc0-ec83-4333-8b40-703f042e13c3'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:12.102089 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-de3d0cc0-ec83-4333-8b40-703f042e13c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b31f2a14a51649eca15f333fdeabd020', 'request_id': 'req-de3d0cc0-ec83-4333-8b40-703f042e13c3'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:12.120089 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-de3d0cc0-ec83-4333-8b40-703f042e13c3 admin admin] The token cache is being invalidate because project b31f2a14a51649eca15f333fdeabd020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:12.120659 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-de3d0cc0-ec83-4333-8b40-703f042e13c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:12.121544 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-de3d0cc0-ec83-4333-8b40-703f042e13c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:12.125207 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1077/2196] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:11 2022] DELETE /identity/v3/projects/b31f2a14a51649eca15f333fdeabd020 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:12.128983 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af72b6-bf3d-4b88-b341-096f6e2b5409 service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:12.144647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53af72b6-bf3d-4b88-b341-096f6e2b5409 service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:12.219469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c56db8-db2e-441f-9fcc-4a489c8c7ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:12.220523 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c56db8-db2e-441f-9fcc-4a489c8c7ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:12.220840 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c56db8-db2e-441f-9fcc-4a489c8c7ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:12.221115 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c56db8-db2e-441f-9fcc-4a489c8c7ecd admin admin] PATH_INFO: `/v3/users/dff082b088aa485c8983fd8b9815d3b4` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:12.222316 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c56db8-db2e-441f-9fcc-4a489c8c7ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff082b088aa485c8983fd8b9815d3b4)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:12.224674 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c56db8-db2e-441f-9fcc-4a489c8c7ecd admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:12.306210 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-15c56db8-db2e-441f-9fcc-4a489c8c7ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff082b088aa485c8983fd8b9815d3b4'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:12.307786 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-15c56db8-db2e-441f-9fcc-4a489c8c7ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff082b088aa485c8983fd8b9815d3b4'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:12.324805 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-15c56db8-db2e-441f-9fcc-4a489c8c7ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff082b088aa485c8983fd8b9815d3b4'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:12.343226 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-15c56db8-db2e-441f-9fcc-4a489c8c7ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff082b088aa485c8983fd8b9815d3b4'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:12.358858 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-15c56db8-db2e-441f-9fcc-4a489c8c7ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff082b088aa485c8983fd8b9815d3b4'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:12.365757 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1120/2197] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:12 2022] DELETE /identity/v3/users/dff082b088aa485c8983fd8b9815d3b4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:12.687057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d0cc0-ec83-4333-8b40-703f042e13c3 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:12.698960 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-de3d0cc0-ec83-4333-8b40-703f042e13c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:12.731205 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d0cc0-ec83-4333-8b40-703f042e13c3 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:12.822074 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff8ce4-c7fe-4ed3-899a-db81e9b14d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:12.823068 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff8ce4-c7fe-4ed3-899a-db81e9b14d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:12.823430 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff8ce4-c7fe-4ed3-899a-db81e9b14d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:12.823783 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff8ce4-c7fe-4ed3-899a-db81e9b14d0a admin admin] PATH_INFO: `/v3/projects/c6039f2337404746a3cdb58ba04dd7dd` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:12.825075 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff8ce4-c7fe-4ed3-899a-db81e9b14d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6039f2337404746a3cdb58ba04dd7dd)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:12.828934 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff8ce4-c7fe-4ed3-899a-db81e9b14d0a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:12.901607 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-98ff8ce4-c7fe-4ed3-899a-db81e9b14d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6039f2337404746a3cdb58ba04dd7dd', 'request_id': 'req-98ff8ce4-c7fe-4ed3-899a-db81e9b14d0a'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:12.916689 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-98ff8ce4-c7fe-4ed3-899a-db81e9b14d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6039f2337404746a3cdb58ba04dd7dd', 'request_id': 'req-98ff8ce4-c7fe-4ed3-899a-db81e9b14d0a'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:12.925740 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-98ff8ce4-c7fe-4ed3-899a-db81e9b14d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6039f2337404746a3cdb58ba04dd7dd', 'request_id': 'req-98ff8ce4-c7fe-4ed3-899a-db81e9b14d0a'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:12.945465 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-98ff8ce4-c7fe-4ed3-899a-db81e9b14d0a admin admin] The token cache is being invalidate because project c6039f2337404746a3cdb58ba04dd7dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:12.945858 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-98ff8ce4-c7fe-4ed3-899a-db81e9b14d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:12.946611 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-98ff8ce4-c7fe-4ed3-899a-db81e9b14d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:12.948318 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1078/2198] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:12 2022] DELETE /identity/v3/projects/c6039f2337404746a3cdb58ba04dd7dd => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:12.959807 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2f5c8-ec80-4b26-8663-fe60ec4b3a03 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:12.960098 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2f5c8-ec80-4b26-8663-fe60ec4b3a03 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:12.960378 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2f5c8-ec80-4b26-8663-fe60ec4b3a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:12.988086 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-bab2f5c8-ec80-4b26-8663-fe60ec4b3a03 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:12.989392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-bab2f5c8-ec80-4b26-8663-fe60ec4b3a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:13.095860 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1121/2199] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:13.104379 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e6ead-b2b8-4087-8911-363bc475c67f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:13.104898 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e6ead-b2b8-4087-8911-363bc475c67f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:13.105281 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e6ead-b2b8-4087-8911-363bc475c67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:13.131746 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-867e6ead-b2b8-4087-8911-363bc475c67f None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:13.133375 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-867e6ead-b2b8-4087-8911-363bc475c67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:13.145872 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1079/2200] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:13.149952 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2f5c8-ec80-4b26-8663-fe60ec4b3a03 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:13.161151 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab2f5c8-ec80-4b26-8663-fe60ec4b3a03 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:13.167611 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bab09-635a-42b4-bcdd-7a7065c340ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:13.168511 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bab09-635a-42b4-bcdd-7a7065c340ff admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:13.168947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bab09-635a-42b4-bcdd-7a7065c340ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:13.169909 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069bab09-635a-42b4-bcdd-7a7065c340ff admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:13.170691 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bab09-635a-42b4-bcdd-7a7065c340ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:52:13.171271 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bab09-635a-42b4-bcdd-7a7065c340ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:13.173546 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069bab09-635a-42b4-bcdd-7a7065c340ff admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:13.191276 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1122/2201] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:52:13.192114 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e6ead-b2b8-4087-8911-363bc475c67f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:13.201855 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e6ead-b2b8-4087-8911-363bc475c67f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:13.214620 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3394c-576a-418e-ae7c-7a468579002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:13.215353 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3394c-576a-418e-ae7c-7a468579002c admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:13.215640 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3394c-576a-418e-ae7c-7a468579002c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:13.215920 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c3394c-576a-418e-ae7c-7a468579002c admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:13.218951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3394c-576a-418e-ae7c-7a468579002c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:13.222801 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c3394c-576a-418e-ae7c-7a468579002c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:13.275915 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1080/2202] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:13 2022] POST /identity/v3/projects => generated 381 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:13.281052 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bab09-635a-42b4-bcdd-7a7065c340ff admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:13.294437 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069bab09-635a-42b4-bcdd-7a7065c340ff admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:13.378330 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabac5e1-1f4e-4dab-8bbf-6942a052f574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:13.379728 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabac5e1-1f4e-4dab-8bbf-6942a052f574 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:13.380160 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabac5e1-1f4e-4dab-8bbf-6942a052f574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:13.380609 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabac5e1-1f4e-4dab-8bbf-6942a052f574 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:13.381928 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabac5e1-1f4e-4dab-8bbf-6942a052f574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:13.384245 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabac5e1-1f4e-4dab-8bbf-6942a052f574 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:13.411821 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1123/2203] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:13 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:13.415660 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3394c-576a-418e-ae7c-7a468579002c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:13.433431 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c3394c-576a-418e-ae7c-7a468579002c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:13.441611 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3904b-ec2c-492b-ac5c-201dbf2fc5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:13.442388 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3904b-ec2c-492b-ac5c-201dbf2fc5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:13.442791 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3904b-ec2c-492b-ac5c-201dbf2fc5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:13.443137 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe3904b-ec2c-492b-ac5c-201dbf2fc5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:13.443943 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3904b-ec2c-492b-ac5c-201dbf2fc5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:13.445623 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe3904b-ec2c-492b-ac5c-201dbf2fc5c8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:13.469491 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1081/2204] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:13.470545 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabac5e1-1f4e-4dab-8bbf-6942a052f574 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:13.485378 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabac5e1-1f4e-4dab-8bbf-6942a052f574 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:13.491416 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0c9b1-34bf-4857-bd53-28b062989429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:13.492353 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0c9b1-34bf-4857-bd53-28b062989429 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:13.492841 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0c9b1-34bf-4857-bd53-28b062989429 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:13.493298 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0c9b1-34bf-4857-bd53-28b062989429 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:13.494512 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0c9b1-34bf-4857-bd53-28b062989429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:13.496602 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0c9b1-34bf-4857-bd53-28b062989429 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:13.512919 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1124/2205] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:13.517113 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3904b-ec2c-492b-ac5c-201dbf2fc5c8 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:13.531278 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe3904b-ec2c-492b-ac5c-201dbf2fc5c8 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:13.543725 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1165cd-d265-4dce-af0d-1380b310d274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:13.545293 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1165cd-d265-4dce-af0d-1380b310d274 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:13.545681 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1165cd-d265-4dce-af0d-1380b310d274 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:13.546047 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1165cd-d265-4dce-af0d-1380b310d274 admin admin] PATH_INFO: `/v3/projects/454f6ecfbfe44c308b1d8b2d70124295/users/f363089d161044e4999cf8cb1c38c01d/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:13.565769 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1165cd-d265-4dce-af0d-1380b310d274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=454f6ecfbfe44c308b1d8b2d70124295, user_id=f363089d161044e4999cf8cb1c38c01d, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:13.579348 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1165cd-d265-4dce-af0d-1380b310d274 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:13.595724 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1082/2206] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:13 2022] PUT /identity/v3/projects/454f6ecfbfe44c308b1d8b2d70124295/users/f363089d161044e4999cf8cb1c38c01d/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:13.607878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30a4e3-70c8-4067-ba9b-c64252581f62 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:13.608388 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30a4e3-70c8-4067-ba9b-c64252581f62 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:13.608753 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30a4e3-70c8-4067-ba9b-c64252581f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:13.639880 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-5a30a4e3-70c8-4067-ba9b-c64252581f62 None None] MFA Rules not processed for user `f363089d161044e4999cf8cb1c38c01d`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:13.641132 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-5a30a4e3-70c8-4067-ba9b-c64252581f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:13.715230 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1125/2207] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:52:13.720403 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1165cd-d265-4dce-af0d-1380b310d274 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:13.808567 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1165cd-d265-4dce-af0d-1380b310d274 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:13.814481 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468367f9-1a99-490b-987d-215a5bc4997d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:13.815257 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468367f9-1a99-490b-987d-215a5bc4997d admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:13.815602 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468367f9-1a99-490b-987d-215a5bc4997d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:13.815945 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468367f9-1a99-490b-987d-215a5bc4997d admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:13.816744 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468367f9-1a99-490b-987d-215a5bc4997d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:13.819096 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468367f9-1a99-490b-987d-215a5bc4997d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:13.845515 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1083/2208] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:13 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:13.849479 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30a4e3-70c8-4067-ba9b-c64252581f62 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:13.862022 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30a4e3-70c8-4067-ba9b-c64252581f62 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:13.923045 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cc67a-6b1e-480f-a521-b31b909c0a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:13.923722 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cc67a-6b1e-480f-a521-b31b909c0a60 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:13.924018 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cc67a-6b1e-480f-a521-b31b909c0a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:13.924278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cc67a-6b1e-480f-a521-b31b909c0a60 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:13.924978 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cc67a-6b1e-480f-a521-b31b909c0a60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:13.926943 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cc67a-6b1e-480f-a521-b31b909c0a60 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:13.952744 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1126/2209] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:13 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:13.956810 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468367f9-1a99-490b-987d-215a5bc4997d admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:13.970496 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468367f9-1a99-490b-987d-215a5bc4997d admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:13.990265 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ed8db-299f-45a6-a67a-a97f3aba413c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:13.991102 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ed8db-299f-45a6-a67a-a97f3aba413c admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:13.991454 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ed8db-299f-45a6-a67a-a97f3aba413c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:13.991889 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ed8db-299f-45a6-a67a-a97f3aba413c admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:13.992703 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ed8db-299f-45a6-a67a-a97f3aba413c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:13.994340 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ed8db-299f-45a6-a67a-a97f3aba413c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:14.005368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1084/2210] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:14.010017 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cc67a-6b1e-480f-a521-b31b909c0a60 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:14.025877 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cc67a-6b1e-480f-a521-b31b909c0a60 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:14.031096 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e54e8-ca51-4b94-841e-87c25036cf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:14.031973 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e54e8-ca51-4b94-841e-87c25036cf02 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:14.032257 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e54e8-ca51-4b94-841e-87c25036cf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:14.032532 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e54e8-ca51-4b94-841e-87c25036cf02 admin admin] PATH_INFO: `/v3/projects/5dc2d9a1b7534f8384a20d61bfefa08e/users/43f5ccf49b36409d93bfaa6538699d92/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:14.047215 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e54e8-ca51-4b94-841e-87c25036cf02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc2d9a1b7534f8384a20d61bfefa08e, user_id=43f5ccf49b36409d93bfaa6538699d92, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:14.049970 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e54e8-ca51-4b94-841e-87c25036cf02 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:14.064307 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1127/2211] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:14 2022] PUT /identity/v3/projects/5dc2d9a1b7534f8384a20d61bfefa08e/users/43f5ccf49b36409d93bfaa6538699d92/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:14.068270 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ed8db-299f-45a6-a67a-a97f3aba413c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:14.078419 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ed8db-299f-45a6-a67a-a97f3aba413c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:14.134619 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced30ac-38b0-45e8-b4bc-e0332796d1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:14.135411 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced30ac-38b0-45e8-b4bc-e0332796d1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:14.135887 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced30ac-38b0-45e8-b4bc-e0332796d1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:14.136161 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced30ac-38b0-45e8-b4bc-e0332796d1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:14.136885 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced30ac-38b0-45e8-b4bc-e0332796d1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:14.138520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced30ac-38b0-45e8-b4bc-e0332796d1e3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:14.148775 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1085/2212] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:14.152849 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e54e8-ca51-4b94-841e-87c25036cf02 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:14.163423 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e54e8-ca51-4b94-841e-87c25036cf02 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:14.167974 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0292594-b033-46c5-a46d-5c01a8983c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:14.168839 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0292594-b033-46c5-a46d-5c01a8983c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:14.169120 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0292594-b033-46c5-a46d-5c01a8983c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:14.170141 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0292594-b033-46c5-a46d-5c01a8983c74 admin admin] PATH_INFO: `/v3/projects/5dc2d9a1b7534f8384a20d61bfefa08e/users/43f5ccf49b36409d93bfaa6538699d92/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:14.171997 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0292594-b033-46c5-a46d-5c01a8983c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc2d9a1b7534f8384a20d61bfefa08e, user_id=43f5ccf49b36409d93bfaa6538699d92, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:14.174631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0292594-b033-46c5-a46d-5c01a8983c74 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:14.184420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1128/2213] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:14 2022] PUT /identity/v3/projects/5dc2d9a1b7534f8384a20d61bfefa08e/users/43f5ccf49b36409d93bfaa6538699d92/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:14.194885 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47372fe2-9a8b-4be9-910c-c237e0c59f9c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:14.195178 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47372fe2-9a8b-4be9-910c-c237e0c59f9c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:14.195459 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47372fe2-9a8b-4be9-910c-c237e0c59f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:14.223606 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-47372fe2-9a8b-4be9-910c-c237e0c59f9c None None] MFA Rules not processed for user `43f5ccf49b36409d93bfaa6538699d92`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:14.224891 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-47372fe2-9a8b-4be9-910c-c237e0c59f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:14.292119 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1086/2214] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:14.305193 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0292594-b033-46c5-a46d-5c01a8983c74 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:14.306923 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b0292594-b033-46c5-a46d-5c01a8983c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:14.363565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0292594-b033-46c5-a46d-5c01a8983c74 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:14.368542 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a3c04-3404-4700-8c42-ffe94803aea2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:14.370517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a3c04-3404-4700-8c42-ffe94803aea2 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:14.370517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a3c04-3404-4700-8c42-ffe94803aea2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:14.370517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a3c04-3404-4700-8c42-ffe94803aea2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:14.386537 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a3c04-3404-4700-8c42-ffe94803aea2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:14.388663 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a3c04-3404-4700-8c42-ffe94803aea2 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:14.400880 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1129/2215] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:14.490373 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47372fe2-9a8b-4be9-910c-c237e0c59f9c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:14.499728 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47372fe2-9a8b-4be9-910c-c237e0c59f9c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:14.503687 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aacf5b-1e5b-4447-830f-f285166ef6f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:14.504489 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aacf5b-1e5b-4447-830f-f285166ef6f3 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:14.504853 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aacf5b-1e5b-4447-830f-f285166ef6f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:14.505261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aacf5b-1e5b-4447-830f-f285166ef6f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:14.559732 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aacf5b-1e5b-4447-830f-f285166ef6f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:14.561183 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aacf5b-1e5b-4447-830f-f285166ef6f3 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:14.569586 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1087/2216] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:14.815789 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a3c04-3404-4700-8c42-ffe94803aea2 service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:14.897750 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a3c04-3404-4700-8c42-ffe94803aea2 service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:14.902427 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9bb3c-9171-4808-ad39-d6fb0c7c0c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:14.903393 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9bb3c-9171-4808-ad39-d6fb0c7c0c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:14.903743 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9bb3c-9171-4808-ad39-d6fb0c7c0c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:14.904031 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9bb3c-9171-4808-ad39-d6fb0c7c0c69 admin admin] PATH_INFO: `/v3/users/f363089d161044e4999cf8cb1c38c01d` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:14.905228 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9bb3c-9171-4808-ad39-d6fb0c7c0c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f363089d161044e4999cf8cb1c38c01d)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:14.907186 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9bb3c-9171-4808-ad39-d6fb0c7c0c69 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:14.959270 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-dbb9bb3c-9171-4808-ad39-d6fb0c7c0c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f363089d161044e4999cf8cb1c38c01d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:14.959952 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-dbb9bb3c-9171-4808-ad39-d6fb0c7c0c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f363089d161044e4999cf8cb1c38c01d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:14.968641 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-dbb9bb3c-9171-4808-ad39-d6fb0c7c0c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f363089d161044e4999cf8cb1c38c01d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:14.975592 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-dbb9bb3c-9171-4808-ad39-d6fb0c7c0c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f363089d161044e4999cf8cb1c38c01d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:14.986705 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-dbb9bb3c-9171-4808-ad39-d6fb0c7c0c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f363089d161044e4999cf8cb1c38c01d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:14.992920 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1130/2217] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:14 2022] DELETE /identity/v3/users/f363089d161044e4999cf8cb1c38c01d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:14.997983 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa39692-01b3-4809-b97b-16fd736733e5 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:14.998363 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa39692-01b3-4809-b97b-16fd736733e5 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:14.998756 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa39692-01b3-4809-b97b-16fd736733e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:15.017246 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-5fa39692-01b3-4809-b97b-16fd736733e5 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:15.018496 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5fa39692-01b3-4809-b97b-16fd736733e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:15.082208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1088/2218] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:15.091721 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9bb3c-9171-4808-ad39-d6fb0c7c0c69 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:15.093087 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-dbb9bb3c-9171-4808-ad39-d6fb0c7c0c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:15.147528 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9bb3c-9171-4808-ad39-d6fb0c7c0c69 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:15.151067 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dc5f9-bd87-4fa0-afd7-627516e1b0d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:15.151695 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dc5f9-bd87-4fa0-afd7-627516e1b0d7 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:15.151971 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dc5f9-bd87-4fa0-afd7-627516e1b0d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:15.152241 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343dc5f9-bd87-4fa0-afd7-627516e1b0d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:15.160936 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dc5f9-bd87-4fa0-afd7-627516e1b0d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:15.162292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343dc5f9-bd87-4fa0-afd7-627516e1b0d7 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:15.171826 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1131/2219] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:15.422166 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa39692-01b3-4809-b97b-16fd736733e5 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:15.425038 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5fa39692-01b3-4809-b97b-16fd736733e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:15.438063 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa39692-01b3-4809-b97b-16fd736733e5 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:15.444510 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dfdef-bfa4-43f7-8e75-edede1564014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:15.445760 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dfdef-bfa4-43f7-8e75-edede1564014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:15.446207 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dfdef-bfa4-43f7-8e75-edede1564014 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:15.446542 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0dfdef-bfa4-43f7-8e75-edede1564014 admin admin] PATH_INFO: `/v3/projects/454f6ecfbfe44c308b1d8b2d70124295` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:15.452050 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dfdef-bfa4-43f7-8e75-edede1564014 admin admin] RBAC: Authorizing `identity:delete_project(project_id=454f6ecfbfe44c308b1d8b2d70124295)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:15.454052 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0dfdef-bfa4-43f7-8e75-edede1564014 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:15.501049 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9b0dfdef-bfa4-43f7-8e75-edede1564014 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '454f6ecfbfe44c308b1d8b2d70124295', 'request_id': 'req-9b0dfdef-bfa4-43f7-8e75-edede1564014'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:15.506344 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9b0dfdef-bfa4-43f7-8e75-edede1564014 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '454f6ecfbfe44c308b1d8b2d70124295', 'request_id': 'req-9b0dfdef-bfa4-43f7-8e75-edede1564014'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:15.512742 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9b0dfdef-bfa4-43f7-8e75-edede1564014 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '454f6ecfbfe44c308b1d8b2d70124295', 'request_id': 'req-9b0dfdef-bfa4-43f7-8e75-edede1564014'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:15.524183 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9b0dfdef-bfa4-43f7-8e75-edede1564014 admin admin] The token cache is being invalidate because project 454f6ecfbfe44c308b1d8b2d70124295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:15.524465 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9b0dfdef-bfa4-43f7-8e75-edede1564014 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:15.525079 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9b0dfdef-bfa4-43f7-8e75-edede1564014 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:15.526828 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1089/2220] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:15 2022] DELETE /identity/v3/projects/454f6ecfbfe44c308b1d8b2d70124295 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:15.531132 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dc5f9-bd87-4fa0-afd7-627516e1b0d7 service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:15.540579 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343dc5f9-bd87-4fa0-afd7-627516e1b0d7 service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:15.594890 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fbacf-49a5-414c-946f-79b58a75368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:15.595752 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fbacf-49a5-414c-946f-79b58a75368a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:15.596034 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fbacf-49a5-414c-946f-79b58a75368a admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:15.596308 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fbacf-49a5-414c-946f-79b58a75368a admin admin] PATH_INFO: `/v3/users/43f5ccf49b36409d93bfaa6538699d92` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:15.597462 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fbacf-49a5-414c-946f-79b58a75368a admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f5ccf49b36409d93bfaa6538699d92)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:15.599428 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fbacf-49a5-414c-946f-79b58a75368a admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:15.647393 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-866fbacf-49a5-414c-946f-79b58a75368a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f5ccf49b36409d93bfaa6538699d92'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:15.648038 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-866fbacf-49a5-414c-946f-79b58a75368a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f5ccf49b36409d93bfaa6538699d92'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:15.655832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-866fbacf-49a5-414c-946f-79b58a75368a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f5ccf49b36409d93bfaa6538699d92'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:15.666616 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-866fbacf-49a5-414c-946f-79b58a75368a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f5ccf49b36409d93bfaa6538699d92'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:15.678444 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-866fbacf-49a5-414c-946f-79b58a75368a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f5ccf49b36409d93bfaa6538699d92'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:15.684281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1132/2221] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:15 2022] DELETE /identity/v3/users/43f5ccf49b36409d93bfaa6538699d92 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:15.946160 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dfdef-bfa4-43f7-8e75-edede1564014 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:15.947997 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9b0dfdef-bfa4-43f7-8e75-edede1564014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:15.961437 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0dfdef-bfa4-43f7-8e75-edede1564014 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:16.019992 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7fd59-47b8-44d6-8eee-9fbc3f7e8bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:16.020940 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7fd59-47b8-44d6-8eee-9fbc3f7e8bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:16.021217 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7fd59-47b8-44d6-8eee-9fbc3f7e8bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:16.021490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7fd59-47b8-44d6-8eee-9fbc3f7e8bf1 admin admin] PATH_INFO: `/v3/projects/5dc2d9a1b7534f8384a20d61bfefa08e` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:16.024732 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7fd59-47b8-44d6-8eee-9fbc3f7e8bf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc2d9a1b7534f8384a20d61bfefa08e)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:16.026711 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7fd59-47b8-44d6-8eee-9fbc3f7e8bf1 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:16.071835 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0ac7fd59-47b8-44d6-8eee-9fbc3f7e8bf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc2d9a1b7534f8384a20d61bfefa08e', 'request_id': 'req-0ac7fd59-47b8-44d6-8eee-9fbc3f7e8bf1'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:16.077513 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0ac7fd59-47b8-44d6-8eee-9fbc3f7e8bf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc2d9a1b7534f8384a20d61bfefa08e', 'request_id': 'req-0ac7fd59-47b8-44d6-8eee-9fbc3f7e8bf1'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:16.083766 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0ac7fd59-47b8-44d6-8eee-9fbc3f7e8bf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc2d9a1b7534f8384a20d61bfefa08e', 'request_id': 'req-0ac7fd59-47b8-44d6-8eee-9fbc3f7e8bf1'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:16.097926 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0ac7fd59-47b8-44d6-8eee-9fbc3f7e8bf1 admin admin] The token cache is being invalidate because project 5dc2d9a1b7534f8384a20d61bfefa08e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:16.098456 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0ac7fd59-47b8-44d6-8eee-9fbc3f7e8bf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:16.099125 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0ac7fd59-47b8-44d6-8eee-9fbc3f7e8bf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:16.105235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1090/2222] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:15 2022] DELETE /identity/v3/projects/5dc2d9a1b7534f8384a20d61bfefa08e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:16.106919 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605ad88-c193-40cc-aefd-0aa230c1946c None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:16.107293 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605ad88-c193-40cc-aefd-0aa230c1946c None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:16.107640 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605ad88-c193-40cc-aefd-0aa230c1946c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:16.133911 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-4605ad88-c193-40cc-aefd-0aa230c1946c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:16.133911 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4605ad88-c193-40cc-aefd-0aa230c1946c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:16.198236 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1133/2223] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:16.206802 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f838383-d71e-49bd-822d-f2726b790454 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:16.207087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f838383-d71e-49bd-822d-f2726b790454 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:16.207390 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f838383-d71e-49bd-822d-f2726b790454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:16.225161 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9f838383-d71e-49bd-822d-f2726b790454 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:16.226340 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9f838383-d71e-49bd-822d-f2726b790454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:16.235172 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1091/2224] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:16.239398 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605ad88-c193-40cc-aefd-0aa230c1946c None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:16.249109 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605ad88-c193-40cc-aefd-0aa230c1946c None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:16.253523 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27abb3-c2c6-4e5c-8ff0-ba42963e9987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:16.254162 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27abb3-c2c6-4e5c-8ff0-ba42963e9987 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:16.254437 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27abb3-c2c6-4e5c-8ff0-ba42963e9987 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:16.254843 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27abb3-c2c6-4e5c-8ff0-ba42963e9987 admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:16.255648 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27abb3-c2c6-4e5c-8ff0-ba42963e9987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:52:16.255953 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27abb3-c2c6-4e5c-8ff0-ba42963e9987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:16.257543 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27abb3-c2c6-4e5c-8ff0-ba42963e9987 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:16.269369 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1134/2225] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:52:16.273474 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f838383-d71e-49bd-822d-f2726b790454 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:16.282372 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f838383-d71e-49bd-822d-f2726b790454 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:16.286944 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0df9d-7e33-4323-abb0-741deb0a07e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:16.287583 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0df9d-7e33-4323-abb0-741deb0a07e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:16.287863 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0df9d-7e33-4323-abb0-741deb0a07e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:16.288143 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0df9d-7e33-4323-abb0-741deb0a07e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:16.288830 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0df9d-7e33-4323-abb0-741deb0a07e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:16.290722 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0df9d-7e33-4323-abb0-741deb0a07e9 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:16.315261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1092/2226] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:16 2022] POST /identity/v3/projects => generated 369 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:52:16.319407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27abb3-c2c6-4e5c-8ff0-ba42963e9987 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:16.329601 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27abb3-c2c6-4e5c-8ff0-ba42963e9987 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:16.383295 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23a286-6164-4609-89ae-147d815c82cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:16.383982 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23a286-6164-4609-89ae-147d815c82cd admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:16.384262 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23a286-6164-4609-89ae-147d815c82cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:16.384534 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23a286-6164-4609-89ae-147d815c82cd admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:16.385204 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23a286-6164-4609-89ae-147d815c82cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:16.387423 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23a286-6164-4609-89ae-147d815c82cd admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:16.407735 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1135/2227] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:16 2022] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:16.411868 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0df9d-7e33-4323-abb0-741deb0a07e9 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:16.421709 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0df9d-7e33-4323-abb0-741deb0a07e9 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:16.426250 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca96dc-e580-4a59-b6d8-3e66c60fc16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:16.426935 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca96dc-e580-4a59-b6d8-3e66c60fc16f admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:16.427214 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca96dc-e580-4a59-b6d8-3e66c60fc16f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:16.427483 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca96dc-e580-4a59-b6d8-3e66c60fc16f admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:16.428198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca96dc-e580-4a59-b6d8-3e66c60fc16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:16.429761 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca96dc-e580-4a59-b6d8-3e66c60fc16f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:16.440095 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1093/2228] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:16.443872 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23a286-6164-4609-89ae-147d815c82cd admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:16.454245 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23a286-6164-4609-89ae-147d815c82cd admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:16.458878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b32138-4ce9-46f9-a820-e7584e656427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:16.459526 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b32138-4ce9-46f9-a820-e7584e656427 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:16.459804 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b32138-4ce9-46f9-a820-e7584e656427 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:16.460104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b32138-4ce9-46f9-a820-e7584e656427 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:16.460815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b32138-4ce9-46f9-a820-e7584e656427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:16.462390 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b32138-4ce9-46f9-a820-e7584e656427 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:16.472806 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1136/2229] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:16.476847 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca96dc-e580-4a59-b6d8-3e66c60fc16f admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:16.487381 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca96dc-e580-4a59-b6d8-3e66c60fc16f admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:16.496111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291139b6-728b-49c9-be6b-4c1c202dffed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:16.496985 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291139b6-728b-49c9-be6b-4c1c202dffed admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:16.497268 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291139b6-728b-49c9-be6b-4c1c202dffed admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:16.498118 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291139b6-728b-49c9-be6b-4c1c202dffed admin admin] PATH_INFO: `/v3/projects/e5d907f670c84a2c9549fbffc2e72c25/users/615a6e246cdc4b11af2035bbab9fc138/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:16.512429 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291139b6-728b-49c9-be6b-4c1c202dffed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d907f670c84a2c9549fbffc2e72c25, user_id=615a6e246cdc4b11af2035bbab9fc138, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:16.515730 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291139b6-728b-49c9-be6b-4c1c202dffed admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:16.527913 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1094/2230] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:16 2022] PUT /identity/v3/projects/e5d907f670c84a2c9549fbffc2e72c25/users/615a6e246cdc4b11af2035bbab9fc138/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:16.538930 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4f8a0-cb07-4265-ab06-0e06973f3f2d None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:16.539404 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4f8a0-cb07-4265-ab06-0e06973f3f2d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:16.539508 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4f8a0-cb07-4265-ab06-0e06973f3f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:16.565588 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-f5e4f8a0-cb07-4265-ab06-0e06973f3f2d None None] MFA Rules not processed for user `615a6e246cdc4b11af2035bbab9fc138`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:16.566822 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f5e4f8a0-cb07-4265-ab06-0e06973f3f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:16.629554 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1137/2231] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:16 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:16.641407 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291139b6-728b-49c9-be6b-4c1c202dffed admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:16.643176 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-291139b6-728b-49c9-be6b-4c1c202dffed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:16.698022 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291139b6-728b-49c9-be6b-4c1c202dffed admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:16.701865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd7435e-d4a4-45ee-8162-9468d5afbd03 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92dc1464c4b24c6c8ea5dfcc796f0279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:16.702483 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7435e-d4a4-45ee-8162-9468d5afbd03 service glance] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:16.702789 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7435e-d4a4-45ee-8162-9468d5afbd03 service glance] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:16.703177 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd7435e-d4a4-45ee-8162-9468d5afbd03 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:16.711348 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7435e-d4a4-45ee-8162-9468d5afbd03 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:16.712752 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd7435e-d4a4-45ee-8162-9468d5afbd03 service glance] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:16.721348 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1095/2232] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:16 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:18.647296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4f8a0-cb07-4265-ab06-0e06973f3f2d None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:18.648997 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f5e4f8a0-cb07-4265-ab06-0e06973f3f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:18.724623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4f8a0-cb07-4265-ab06-0e06973f3f2d None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:18.729420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929db27-137f-41bf-a84c-324687b3de58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:18.730304 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929db27-137f-41bf-a84c-324687b3de58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:18.730599 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929db27-137f-41bf-a84c-324687b3de58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:18.730889 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929db27-137f-41bf-a84c-324687b3de58 admin admin] PATH_INFO: `/v3/users/faae6d82c677495c94fa217d0ae5af2e` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:18.732154 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929db27-137f-41bf-a84c-324687b3de58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faae6d82c677495c94fa217d0ae5af2e)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:18.734141 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929db27-137f-41bf-a84c-324687b3de58 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:18.785029 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6929db27-137f-41bf-a84c-324687b3de58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faae6d82c677495c94fa217d0ae5af2e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:18.785687 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6929db27-137f-41bf-a84c-324687b3de58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faae6d82c677495c94fa217d0ae5af2e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:18.793980 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6929db27-137f-41bf-a84c-324687b3de58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faae6d82c677495c94fa217d0ae5af2e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:18.802321 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6929db27-137f-41bf-a84c-324687b3de58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faae6d82c677495c94fa217d0ae5af2e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:18.819677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6929db27-137f-41bf-a84c-324687b3de58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faae6d82c677495c94fa217d0ae5af2e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:18.827106 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1138/2233] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:18 2022] DELETE /identity/v3/users/faae6d82c677495c94fa217d0ae5af2e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:18.840877 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac9e9f-627b-4de4-aa7b-482b50e24f5c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:18.841826 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac9e9f-627b-4de4-aa7b-482b50e24f5c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:18.842272 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac9e9f-627b-4de4-aa7b-482b50e24f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:18.863338 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b2ac9e9f-627b-4de4-aa7b-482b50e24f5c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:18.864929 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b2ac9e9f-627b-4de4-aa7b-482b50e24f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:18.926356 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1096/2234] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:18.936258 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929db27-137f-41bf-a84c-324687b3de58 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:18.937659 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-6929db27-137f-41bf-a84c-324687b3de58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:19.007348 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929db27-137f-41bf-a84c-324687b3de58 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:19.011401 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf94e4b-817b-4b79-a76a-d13be86a316f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:19.012040 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf94e4b-817b-4b79-a76a-d13be86a316f service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:19.012370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf94e4b-817b-4b79-a76a-d13be86a316f service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:19.012789 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf94e4b-817b-4b79-a76a-d13be86a316f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:19.022211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf94e4b-817b-4b79-a76a-d13be86a316f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:19.023885 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf94e4b-817b-4b79-a76a-d13be86a316f service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:19.033595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1139/2235] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:19.323734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac9e9f-627b-4de4-aa7b-482b50e24f5c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:19.325406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b2ac9e9f-627b-4de4-aa7b-482b50e24f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:19.337647 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac9e9f-627b-4de4-aa7b-482b50e24f5c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:19.343644 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe262b3-dd5a-4eb2-975a-bff5e684ffe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:19.344877 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe262b3-dd5a-4eb2-975a-bff5e684ffe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:19.345337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe262b3-dd5a-4eb2-975a-bff5e684ffe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:19.345776 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe262b3-dd5a-4eb2-975a-bff5e684ffe7 admin admin] PATH_INFO: `/v3/projects/5237d7452c09429b829e9763a555449c` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:19.347205 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe262b3-dd5a-4eb2-975a-bff5e684ffe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5237d7452c09429b829e9763a555449c)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:19.349315 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe262b3-dd5a-4eb2-975a-bff5e684ffe7 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:19.397183 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-abe262b3-dd5a-4eb2-975a-bff5e684ffe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5237d7452c09429b829e9763a555449c', 'request_id': 'req-abe262b3-dd5a-4eb2-975a-bff5e684ffe7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:19.409909 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-abe262b3-dd5a-4eb2-975a-bff5e684ffe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5237d7452c09429b829e9763a555449c', 'request_id': 'req-abe262b3-dd5a-4eb2-975a-bff5e684ffe7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:19.418409 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-abe262b3-dd5a-4eb2-975a-bff5e684ffe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5237d7452c09429b829e9763a555449c', 'request_id': 'req-abe262b3-dd5a-4eb2-975a-bff5e684ffe7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:19.443983 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-abe262b3-dd5a-4eb2-975a-bff5e684ffe7 admin admin] The token cache is being invalidate because project 5237d7452c09429b829e9763a555449c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:19.444341 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-abe262b3-dd5a-4eb2-975a-bff5e684ffe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:19.445175 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-abe262b3-dd5a-4eb2-975a-bff5e684ffe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:19.454659 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1097/2236] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:19 2022] DELETE /identity/v3/projects/5237d7452c09429b829e9763a555449c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:27.016238 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf94e4b-817b-4b79-a76a-d13be86a316f service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:27.017681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-2cf94e4b-817b-4b79-a76a-d13be86a316f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:27.030904 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf94e4b-817b-4b79-a76a-d13be86a316f service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:27.087015 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3917d-21a0-44c7-a51b-583a0dba5d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:27.087898 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3917d-21a0-44c7-a51b-583a0dba5d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:27.088182 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3917d-21a0-44c7-a51b-583a0dba5d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:27.088457 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca3917d-21a0-44c7-a51b-583a0dba5d2c admin admin] PATH_INFO: `/v3/users/7e40df13156f45f7bbe2177533ba3472` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:27.089637 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3917d-21a0-44c7-a51b-583a0dba5d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e40df13156f45f7bbe2177533ba3472)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:27.091624 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca3917d-21a0-44c7-a51b-583a0dba5d2c admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:27.138503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-2ca3917d-21a0-44c7-a51b-583a0dba5d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e40df13156f45f7bbe2177533ba3472'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:27.139174 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-2ca3917d-21a0-44c7-a51b-583a0dba5d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e40df13156f45f7bbe2177533ba3472'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:27.147351 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-2ca3917d-21a0-44c7-a51b-583a0dba5d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e40df13156f45f7bbe2177533ba3472'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:27.154833 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-2ca3917d-21a0-44c7-a51b-583a0dba5d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e40df13156f45f7bbe2177533ba3472'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:27.166604 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-2ca3917d-21a0-44c7-a51b-583a0dba5d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e40df13156f45f7bbe2177533ba3472'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:27.174256 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1140/2237] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:27 2022] DELETE /identity/v3/users/7e40df13156f45f7bbe2177533ba3472 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:27.179311 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e56c6-2253-4881-a383-751c6562ae19 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:27.179883 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e56c6-2253-4881-a383-751c6562ae19 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:27.179883 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8e56c6-2253-4881-a383-751c6562ae19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:27.197292 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-7c8e56c6-2253-4881-a383-751c6562ae19 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:27.198483 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7c8e56c6-2253-4881-a383-751c6562ae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:27.259274 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1098/2238] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:27.270539 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3917d-21a0-44c7-a51b-583a0dba5d2c admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:27.272032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-2ca3917d-21a0-44c7-a51b-583a0dba5d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:27.327606 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca3917d-21a0-44c7-a51b-583a0dba5d2c admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:27.331265 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f21c821-95a5-4ea4-9381-656d850d67eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:27.332058 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21c821-95a5-4ea4-9381-656d850d67eb service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:27.332380 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21c821-95a5-4ea4-9381-656d850d67eb service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:27.332606 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f21c821-95a5-4ea4-9381-656d850d67eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:27.342391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21c821-95a5-4ea4-9381-656d850d67eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:27.343797 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f21c821-95a5-4ea4-9381-656d850d67eb service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:27.352967 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1141/2239] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:27.626884 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e56c6-2253-4881-a383-751c6562ae19 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:27.628835 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7c8e56c6-2253-4881-a383-751c6562ae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:27.644094 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8e56c6-2253-4881-a383-751c6562ae19 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:27.649249 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff2e915-ccb9-411f-9283-dd0c82e30fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:27.650191 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2e915-ccb9-411f-9283-dd0c82e30fbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:27.650477 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2e915-ccb9-411f-9283-dd0c82e30fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:27.650785 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff2e915-ccb9-411f-9283-dd0c82e30fbb admin admin] PATH_INFO: `/v3/projects/6bd700b997704c278a54c7063d071819` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:27.652630 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2e915-ccb9-411f-9283-dd0c82e30fbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd700b997704c278a54c7063d071819)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:27.656793 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff2e915-ccb9-411f-9283-dd0c82e30fbb admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:27.714062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0ff2e915-ccb9-411f-9283-dd0c82e30fbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd700b997704c278a54c7063d071819', 'request_id': 'req-0ff2e915-ccb9-411f-9283-dd0c82e30fbb'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:27.722444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0ff2e915-ccb9-411f-9283-dd0c82e30fbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd700b997704c278a54c7063d071819', 'request_id': 'req-0ff2e915-ccb9-411f-9283-dd0c82e30fbb'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:27.729553 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0ff2e915-ccb9-411f-9283-dd0c82e30fbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd700b997704c278a54c7063d071819', 'request_id': 'req-0ff2e915-ccb9-411f-9283-dd0c82e30fbb'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:27.742536 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0ff2e915-ccb9-411f-9283-dd0c82e30fbb admin admin] The token cache is being invalidate because project 6bd700b997704c278a54c7063d071819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:27.742846 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0ff2e915-ccb9-411f-9283-dd0c82e30fbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:27.743467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0ff2e915-ccb9-411f-9283-dd0c82e30fbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:27.745004 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1099/2240] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:27 2022] DELETE /identity/v3/projects/6bd700b997704c278a54c7063d071819 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:27.750480 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca31ba0-2cd6-429b-abc8-68d4f74ea06c None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:27.750897 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca31ba0-2cd6-429b-abc8-68d4f74ea06c None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:27.751180 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca31ba0-2cd6-429b-abc8-68d4f74ea06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:27.769704 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-8ca31ba0-2cd6-429b-abc8-68d4f74ea06c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:27.770926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-8ca31ba0-2cd6-429b-abc8-68d4f74ea06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:27.834682 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1142/2241] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:27.842091 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd579f-8b6f-4551-8590-65c3d6b53731 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:27.842385 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd579f-8b6f-4551-8590-65c3d6b53731 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:27.842709 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd579f-8b6f-4551-8590-65c3d6b53731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:27.861445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-75cd579f-8b6f-4551-8590-65c3d6b53731 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:27.862656 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-75cd579f-8b6f-4551-8590-65c3d6b53731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:27.870518 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1100/2242] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:27.875215 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca31ba0-2cd6-429b-abc8-68d4f74ea06c None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:27.884828 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca31ba0-2cd6-429b-abc8-68d4f74ea06c None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:27.889881 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300f0a2-dda3-40c9-a8a4-04bfd8077f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:27.890549 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300f0a2-dda3-40c9-a8a4-04bfd8077f68 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:27.890864 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300f0a2-dda3-40c9-a8a4-04bfd8077f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:27.891140 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300f0a2-dda3-40c9-a8a4-04bfd8077f68 admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:27.891868 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300f0a2-dda3-40c9-a8a4-04bfd8077f68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:52:27.892177 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300f0a2-dda3-40c9-a8a4-04bfd8077f68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:27.893791 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300f0a2-dda3-40c9-a8a4-04bfd8077f68 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:27.907189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1143/2243] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:52:27.910162 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd579f-8b6f-4551-8590-65c3d6b53731 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:27.919957 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd579f-8b6f-4551-8590-65c3d6b53731 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:27.924532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4b2e7-8506-494d-81c0-1fe41595ec53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:27.925170 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4b2e7-8506-494d-81c0-1fe41595ec53 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:27.925451 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4b2e7-8506-494d-81c0-1fe41595ec53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:27.925724 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4b2e7-8506-494d-81c0-1fe41595ec53 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:27.926413 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4b2e7-8506-494d-81c0-1fe41595ec53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:27.928316 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f4b2e7-8506-494d-81c0-1fe41595ec53 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:27.952817 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1101/2244] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:27 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:52:27.957189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300f0a2-dda3-40c9-a8a4-04bfd8077f68 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:27.969261 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300f0a2-dda3-40c9-a8a4-04bfd8077f68 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:28.036016 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e5e11-58c0-4c62-b623-08742461d256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:28.036647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e5e11-58c0-4c62-b623-08742461d256 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:28.036887 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e5e11-58c0-4c62-b623-08742461d256 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:28.037161 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86e5e11-58c0-4c62-b623-08742461d256 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:28.037881 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e5e11-58c0-4c62-b623-08742461d256 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:28.039891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86e5e11-58c0-4c62-b623-08742461d256 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:28.062383 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1144/2245] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:27 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:28.063838 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4b2e7-8506-494d-81c0-1fe41595ec53 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:28.076157 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4b2e7-8506-494d-81c0-1fe41595ec53 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:28.081451 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f94a8c-b9ce-4498-8497-f456afc72707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:28.082202 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f94a8c-b9ce-4498-8497-f456afc72707 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:28.082557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f94a8c-b9ce-4498-8497-f456afc72707 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:28.082933 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f94a8c-b9ce-4498-8497-f456afc72707 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:28.083729 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f94a8c-b9ce-4498-8497-f456afc72707 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:28.085392 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f94a8c-b9ce-4498-8497-f456afc72707 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:28.096085 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1102/2246] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:28.100078 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e5e11-58c0-4c62-b623-08742461d256 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:28.110990 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86e5e11-58c0-4c62-b623-08742461d256 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:28.116495 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1c54fd-1acb-4e1a-b252-1a3abc8451e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:28.117158 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c54fd-1acb-4e1a-b252-1a3abc8451e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:28.117475 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c54fd-1acb-4e1a-b252-1a3abc8451e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:28.117752 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1c54fd-1acb-4e1a-b252-1a3abc8451e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:28.118481 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c54fd-1acb-4e1a-b252-1a3abc8451e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:28.120136 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1c54fd-1acb-4e1a-b252-1a3abc8451e5 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:28.134631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1145/2247] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:28.138977 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f94a8c-b9ce-4498-8497-f456afc72707 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:28.148716 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f94a8c-b9ce-4498-8497-f456afc72707 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:28.153505 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593911f9-5bc4-450c-ba1e-443be47dc849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:28.154378 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593911f9-5bc4-450c-ba1e-443be47dc849 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:28.154698 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593911f9-5bc4-450c-ba1e-443be47dc849 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:28.154978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593911f9-5bc4-450c-ba1e-443be47dc849 admin admin] PATH_INFO: `/v3/projects/7ba734de4f4043c192b16468cd6af441/users/d830a55c182642e19fd1c5cbff46735b/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:28.172441 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593911f9-5bc4-450c-ba1e-443be47dc849 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba734de4f4043c192b16468cd6af441, user_id=d830a55c182642e19fd1c5cbff46735b, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:28.175271 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593911f9-5bc4-450c-ba1e-443be47dc849 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:28.188905 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1103/2248] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:28 2022] PUT /identity/v3/projects/7ba734de4f4043c192b16468cd6af441/users/d830a55c182642e19fd1c5cbff46735b/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:28.200189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd62ecb-421b-4682-8ca6-b9b1582d1246 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:28.200485 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd62ecb-421b-4682-8ca6-b9b1582d1246 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:28.200764 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd62ecb-421b-4682-8ca6-b9b1582d1246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:28.356768 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-0fd62ecb-421b-4682-8ca6-b9b1582d1246 None None] MFA Rules not processed for user `d830a55c182642e19fd1c5cbff46735b`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:28.357971 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-0fd62ecb-421b-4682-8ca6-b9b1582d1246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:28.422117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1146/2249] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:28.426920 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593911f9-5bc4-450c-ba1e-443be47dc849 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:28.485951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593911f9-5bc4-450c-ba1e-443be47dc849 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:28.490639 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c2068-02a0-4f3e-bf02-8950d59384ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:28.491292 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c2068-02a0-4f3e-bf02-8950d59384ec admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:28.491574 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c2068-02a0-4f3e-bf02-8950d59384ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:28.491850 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c2068-02a0-4f3e-bf02-8950d59384ec admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:28.492544 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c2068-02a0-4f3e-bf02-8950d59384ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:28.494659 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c2068-02a0-4f3e-bf02-8950d59384ec admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:28.521032 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1104/2250] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:28 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:52:28.524555 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd62ecb-421b-4682-8ca6-b9b1582d1246 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:28.536704 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd62ecb-421b-4682-8ca6-b9b1582d1246 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:28.591804 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97731e99-aa50-4b4a-b315-63161deb0a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:28.592456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97731e99-aa50-4b4a-b315-63161deb0a56 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:28.592750 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97731e99-aa50-4b4a-b315-63161deb0a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:28.593018 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97731e99-aa50-4b4a-b315-63161deb0a56 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:28.593691 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97731e99-aa50-4b4a-b315-63161deb0a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:28.595623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97731e99-aa50-4b4a-b315-63161deb0a56 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:28.614567 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1147/2251] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:28 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:52:28.618478 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c2068-02a0-4f3e-bf02-8950d59384ec admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:28.629364 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c2068-02a0-4f3e-bf02-8950d59384ec admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:28.633875 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e535bf4-019a-44eb-b067-8b81c9991810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:28.634550 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e535bf4-019a-44eb-b067-8b81c9991810 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:28.634864 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e535bf4-019a-44eb-b067-8b81c9991810 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:28.635162 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e535bf4-019a-44eb-b067-8b81c9991810 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:28.636435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e535bf4-019a-44eb-b067-8b81c9991810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:28.638180 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e535bf4-019a-44eb-b067-8b81c9991810 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:28.650910 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1105/2252] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:28.652372 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97731e99-aa50-4b4a-b315-63161deb0a56 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:28.662272 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97731e99-aa50-4b4a-b315-63161deb0a56 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:28.666963 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c53a9ec-855d-4b89-ba2e-8211342777e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:28.667787 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53a9ec-855d-4b89-ba2e-8211342777e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:28.667953 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53a9ec-855d-4b89-ba2e-8211342777e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:28.668162 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c53a9ec-855d-4b89-ba2e-8211342777e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:28.669878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53a9ec-855d-4b89-ba2e-8211342777e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:28.671757 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c53a9ec-855d-4b89-ba2e-8211342777e3 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:28.682322 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1148/2253] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:28.687186 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e535bf4-019a-44eb-b067-8b81c9991810 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:28.696942 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e535bf4-019a-44eb-b067-8b81c9991810 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:28.701615 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39387eb-aa0f-4be6-bc0e-94daa2c06e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:28.702481 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39387eb-aa0f-4be6-bc0e-94daa2c06e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:28.702795 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39387eb-aa0f-4be6-bc0e-94daa2c06e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:28.703073 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39387eb-aa0f-4be6-bc0e-94daa2c06e50 admin admin] PATH_INFO: `/v3/projects/aa687a5e933445919d9fce0cf5629088/users/bce5fc2b2f63436f951d6267ce93b8dd/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:28.717802 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39387eb-aa0f-4be6-bc0e-94daa2c06e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa687a5e933445919d9fce0cf5629088, user_id=bce5fc2b2f63436f951d6267ce93b8dd, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:28.720445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39387eb-aa0f-4be6-bc0e-94daa2c06e50 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:28.733254 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1106/2254] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:28 2022] PUT /identity/v3/projects/aa687a5e933445919d9fce0cf5629088/users/bce5fc2b2f63436f951d6267ce93b8dd/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:52:28.743345 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e0702-0f83-4d40-80a7-6c4c7c2346de None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:28.743655 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e0702-0f83-4d40-80a7-6c4c7c2346de None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:28.743932 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e0702-0f83-4d40-80a7-6c4c7c2346de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:28.771003 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-ea7e0702-0f83-4d40-80a7-6c4c7c2346de None None] MFA Rules not processed for user `bce5fc2b2f63436f951d6267ce93b8dd`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:28.772200 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-ea7e0702-0f83-4d40-80a7-6c4c7c2346de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:28.835019 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1149/2255] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:28.839499 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39387eb-aa0f-4be6-bc0e-94daa2c06e50 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:28.911963 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39387eb-aa0f-4be6-bc0e-94daa2c06e50 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:28.916612 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9ab3e-dd82-4d7c-9930-9897fc586865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:28.917281 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9ab3e-dd82-4d7c-9930-9897fc586865 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:28.917557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9ab3e-dd82-4d7c-9930-9897fc586865 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:28.917831 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9ab3e-dd82-4d7c-9930-9897fc586865 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:28.918526 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9ab3e-dd82-4d7c-9930-9897fc586865 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:28.920976 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee9ab3e-dd82-4d7c-9930-9897fc586865 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:28.950156 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1107/2256] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:28 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:28.954451 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e0702-0f83-4d40-80a7-6c4c7c2346de None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:28.964916 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e0702-0f83-4d40-80a7-6c4c7c2346de None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:29.022757 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc396388-bee1-40a8-914a-594d4c414d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:29.023421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc396388-bee1-40a8-914a-594d4c414d67 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:29.023704 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc396388-bee1-40a8-914a-594d4c414d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:29.023979 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc396388-bee1-40a8-914a-594d4c414d67 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:29.024657 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc396388-bee1-40a8-914a-594d4c414d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:29.026563 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc396388-bee1-40a8-914a-594d4c414d67 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:29.046175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1150/2257] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:28 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:29.050352 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9ab3e-dd82-4d7c-9930-9897fc586865 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:29.060624 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee9ab3e-dd82-4d7c-9930-9897fc586865 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:29.065198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c8c1c-6525-45d8-83ee-529f5141030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:29.065846 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c8c1c-6525-45d8-83ee-529f5141030b admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:29.066126 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c8c1c-6525-45d8-83ee-529f5141030b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:29.066396 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c8c1c-6525-45d8-83ee-529f5141030b admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:29.067179 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c8c1c-6525-45d8-83ee-529f5141030b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:29.068750 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c8c1c-6525-45d8-83ee-529f5141030b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:29.078977 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1108/2258] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:52:29.083111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc396388-bee1-40a8-914a-594d4c414d67 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:29.093450 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc396388-bee1-40a8-914a-594d4c414d67 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:29.098220 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadc1c5-a54b-4bcc-b541-5b54d8a73fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:29.099123 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadc1c5-a54b-4bcc-b541-5b54d8a73fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:29.099399 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadc1c5-a54b-4bcc-b541-5b54d8a73fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:29.099669 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadc1c5-a54b-4bcc-b541-5b54d8a73fcf admin admin] PATH_INFO: `/v3/projects/01cb644158ae4c28844d1cce42b053c6/users/5d9cba8c8f0d41b58b1ecb7848559389/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:29.114470 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadc1c5-a54b-4bcc-b541-5b54d8a73fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=01cb644158ae4c28844d1cce42b053c6, user_id=5d9cba8c8f0d41b58b1ecb7848559389, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:29.117108 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadc1c5-a54b-4bcc-b541-5b54d8a73fcf admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:29.128361 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1151/2259] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:29 2022] PUT /identity/v3/projects/01cb644158ae4c28844d1cce42b053c6/users/5d9cba8c8f0d41b58b1ecb7848559389/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:29.132214 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c8c1c-6525-45d8-83ee-529f5141030b admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:29.142264 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c8c1c-6525-45d8-83ee-529f5141030b admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:29.200748 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1923021b-618a-4a51-ae7e-509bfbbc4b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:29.201607 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923021b-618a-4a51-ae7e-509bfbbc4b7a admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:29.201984 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923021b-618a-4a51-ae7e-509bfbbc4b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:29.202264 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1923021b-618a-4a51-ae7e-509bfbbc4b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:29.203045 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923021b-618a-4a51-ae7e-509bfbbc4b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:29.205062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1923021b-618a-4a51-ae7e-509bfbbc4b7a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:29.215219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1109/2260] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:29.220166 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadc1c5-a54b-4bcc-b541-5b54d8a73fcf admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:29.230494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadc1c5-a54b-4bcc-b541-5b54d8a73fcf admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:29.239367 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807418b-5ab4-4362-83f4-4d742d3c7ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:29.240321 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807418b-5ab4-4362-83f4-4d742d3c7ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:29.240656 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807418b-5ab4-4362-83f4-4d742d3c7ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:29.240988 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807418b-5ab4-4362-83f4-4d742d3c7ab7 admin admin] PATH_INFO: `/v3/projects/01cb644158ae4c28844d1cce42b053c6/users/5d9cba8c8f0d41b58b1ecb7848559389/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:29.242948 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807418b-5ab4-4362-83f4-4d742d3c7ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01cb644158ae4c28844d1cce42b053c6, user_id=5d9cba8c8f0d41b58b1ecb7848559389, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:29.245546 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807418b-5ab4-4362-83f4-4d742d3c7ab7 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:29.256757 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1152/2261] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:29 2022] PUT /identity/v3/projects/01cb644158ae4c28844d1cce42b053c6/users/5d9cba8c8f0d41b58b1ecb7848559389/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:29.267173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceeacec-2ac1-4113-9468-51a8e90905cf None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:29.267173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceeacec-2ac1-4113-9468-51a8e90905cf None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:29.267415 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceeacec-2ac1-4113-9468-51a8e90905cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:29.299081 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9ceeacec-2ac1-4113-9468-51a8e90905cf None None] MFA Rules not processed for user `5d9cba8c8f0d41b58b1ecb7848559389`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:29.299245 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807418b-5ab4-4362-83f4-4d742d3c7ab7 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:29.301258 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9ceeacec-2ac1-4113-9468-51a8e90905cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:29.301396 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-e807418b-5ab4-4362-83f4-4d742d3c7ab7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:29.368568 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807418b-5ab4-4362-83f4-4d742d3c7ab7 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:29.374463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1110/2262] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:29.374693 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde78b7a-4b21-438d-a210-fc1dc1a9c5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:29.375347 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde78b7a-4b21-438d-a210-fc1dc1a9c5ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:29.375705 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde78b7a-4b21-438d-a210-fc1dc1a9c5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:29.376054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde78b7a-4b21-438d-a210-fc1dc1a9c5ac admin admin] PATH_INFO: `/v3/users/acbfeb624831415c816938d09e0393be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:29.377752 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde78b7a-4b21-438d-a210-fc1dc1a9c5ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=acbfeb624831415c816938d09e0393be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:29.379784 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde78b7a-4b21-438d-a210-fc1dc1a9c5ac admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:29.386299 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceeacec-2ac1-4113-9468-51a8e90905cf None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:29.388703 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9ceeacec-2ac1-4113-9468-51a8e90905cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:29.438781 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-cde78b7a-4b21-438d-a210-fc1dc1a9c5ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acbfeb624831415c816938d09e0393be'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:29.439513 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-cde78b7a-4b21-438d-a210-fc1dc1a9c5ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acbfeb624831415c816938d09e0393be'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:29.448189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-cde78b7a-4b21-438d-a210-fc1dc1a9c5ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acbfeb624831415c816938d09e0393be'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:29.449543 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceeacec-2ac1-4113-9468-51a8e90905cf None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:29.454341 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b01024-0d45-4a06-83a9-8bf972585db8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:29.455023 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b01024-0d45-4a06-83a9-8bf972585db8 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:29.455312 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b01024-0d45-4a06-83a9-8bf972585db8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:29.456033 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-cde78b7a-4b21-438d-a210-fc1dc1a9c5ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acbfeb624831415c816938d09e0393be'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:29.456156 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b01024-0d45-4a06-83a9-8bf972585db8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:29.468431 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-cde78b7a-4b21-438d-a210-fc1dc1a9c5ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acbfeb624831415c816938d09e0393be'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:29.476286 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1153/2263] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:29 2022] DELETE /identity/v3/users/acbfeb624831415c816938d09e0393be => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:52:29.483051 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bd777-30de-4a43-b831-f7c8983a1594 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:29.483368 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bd777-30de-4a43-b831-f7c8983a1594 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:29.483883 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bd777-30de-4a43-b831-f7c8983a1594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:29.501908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-533bd777-30de-4a43-b831-f7c8983a1594 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:29.503173 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-533bd777-30de-4a43-b831-f7c8983a1594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:29.530313 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b01024-0d45-4a06-83a9-8bf972585db8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:29.531942 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b01024-0d45-4a06-83a9-8bf972585db8 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:29.543171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1111/2264] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:29.566665 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1154/2265] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:29.574307 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b01024-0d45-4a06-83a9-8bf972585db8 service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:29.576233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-52b01024-0d45-4a06-83a9-8bf972585db8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:29.635701 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b01024-0d45-4a06-83a9-8bf972585db8 service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:29.696981 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af7e4d-d7f9-4ceb-b27d-d8b7e92dff21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:29.698061 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af7e4d-d7f9-4ceb-b27d-d8b7e92dff21 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:29.698497 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af7e4d-d7f9-4ceb-b27d-d8b7e92dff21 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:29.698894 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af7e4d-d7f9-4ceb-b27d-d8b7e92dff21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:29.712879 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af7e4d-d7f9-4ceb-b27d-d8b7e92dff21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:29.714354 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af7e4d-d7f9-4ceb-b27d-d8b7e92dff21 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:29.725404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1112/2266] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:52:30.038694 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bd777-30de-4a43-b831-f7c8983a1594 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:30.040373 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-533bd777-30de-4a43-b831-f7c8983a1594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:30.060209 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bd777-30de-4a43-b831-f7c8983a1594 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:30.065109 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9913d32-e182-44ed-934f-1040daa0a8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:30.065961 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9913d32-e182-44ed-934f-1040daa0a8a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:30.066362 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9913d32-e182-44ed-934f-1040daa0a8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:30.066665 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9913d32-e182-44ed-934f-1040daa0a8a9 admin admin] PATH_INFO: `/v3/projects/6341e5f3b2e3429a94049772414121d6` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:30.067991 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9913d32-e182-44ed-934f-1040daa0a8a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6341e5f3b2e3429a94049772414121d6)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:30.069871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9913d32-e182-44ed-934f-1040daa0a8a9 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:30.117053 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c9913d32-e182-44ed-934f-1040daa0a8a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6341e5f3b2e3429a94049772414121d6', 'request_id': 'req-c9913d32-e182-44ed-934f-1040daa0a8a9'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:30.122820 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c9913d32-e182-44ed-934f-1040daa0a8a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6341e5f3b2e3429a94049772414121d6', 'request_id': 'req-c9913d32-e182-44ed-934f-1040daa0a8a9'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:30.128841 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c9913d32-e182-44ed-934f-1040daa0a8a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6341e5f3b2e3429a94049772414121d6', 'request_id': 'req-c9913d32-e182-44ed-934f-1040daa0a8a9'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:30.141437 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c9913d32-e182-44ed-934f-1040daa0a8a9 admin admin] The token cache is being invalidate because project 6341e5f3b2e3429a94049772414121d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:30.141712 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c9913d32-e182-44ed-934f-1040daa0a8a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:30.142327 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c9913d32-e182-44ed-934f-1040daa0a8a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:30.143864 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1155/2267] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:30 2022] DELETE /identity/v3/projects/6341e5f3b2e3429a94049772414121d6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:30.148719 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56846260-6304-4638-8a51-96b66b981602 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:30.149010 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56846260-6304-4638-8a51-96b66b981602 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:30.149286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56846260-6304-4638-8a51-96b66b981602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:30.166771 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-56846260-6304-4638-8a51-96b66b981602 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:30.167918 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-56846260-6304-4638-8a51-96b66b981602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:30.225285 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1113/2268] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:30.234282 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c8b16-d5d5-4651-8cd5-c094412f6fcb None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:30.234840 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c8b16-d5d5-4651-8cd5-c094412f6fcb None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:30.235311 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c8b16-d5d5-4651-8cd5-c094412f6fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:30.254507 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-7a4c8b16-d5d5-4651-8cd5-c094412f6fcb None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:30.255807 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-7a4c8b16-d5d5-4651-8cd5-c094412f6fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:30.263903 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1156/2269] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:30.268473 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56846260-6304-4638-8a51-96b66b981602 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:30.277609 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56846260-6304-4638-8a51-96b66b981602 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:30.282257 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463937a6-a005-4bc6-b37f-f70f7486acfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:30.282936 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463937a6-a005-4bc6-b37f-f70f7486acfc admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:30.283214 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463937a6-a005-4bc6-b37f-f70f7486acfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:30.283489 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463937a6-a005-4bc6-b37f-f70f7486acfc admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:30.284211 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463937a6-a005-4bc6-b37f-f70f7486acfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:52:30.284692 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463937a6-a005-4bc6-b37f-f70f7486acfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:30.286561 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463937a6-a005-4bc6-b37f-f70f7486acfc admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:30.300997 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1114/2270] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:52:30.305270 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c8b16-d5d5-4651-8cd5-c094412f6fcb None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:30.315122 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c8b16-d5d5-4651-8cd5-c094412f6fcb None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:30.319733 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d402c-ee8e-443d-8131-dd2a1c786985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:30.320386 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d402c-ee8e-443d-8131-dd2a1c786985 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:30.320657 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d402c-ee8e-443d-8131-dd2a1c786985 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:30.320950 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d402c-ee8e-443d-8131-dd2a1c786985 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:30.321629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d402c-ee8e-443d-8131-dd2a1c786985 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:30.323573 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d402c-ee8e-443d-8131-dd2a1c786985 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:30.352762 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1157/2271] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:30 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:30.357469 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463937a6-a005-4bc6-b37f-f70f7486acfc admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:30.368142 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463937a6-a005-4bc6-b37f-f70f7486acfc admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:30.423139 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5d3c7-bc11-463b-ac05-e53e19fa110b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:30.423794 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5d3c7-bc11-463b-ac05-e53e19fa110b admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:30.424073 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5d3c7-bc11-463b-ac05-e53e19fa110b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:30.424342 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a5d3c7-bc11-463b-ac05-e53e19fa110b admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:30.425114 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5d3c7-bc11-463b-ac05-e53e19fa110b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:30.426930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a5d3c7-bc11-463b-ac05-e53e19fa110b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:30.445181 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1115/2272] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:30 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:52:30.449282 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d402c-ee8e-443d-8131-dd2a1c786985 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:30.459260 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d402c-ee8e-443d-8131-dd2a1c786985 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:30.463752 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641224c-e1ec-4320-9e21-9dac35684661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:30.464401 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641224c-e1ec-4320-9e21-9dac35684661 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:30.464679 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641224c-e1ec-4320-9e21-9dac35684661 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:30.464949 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4641224c-e1ec-4320-9e21-9dac35684661 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:30.466194 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641224c-e1ec-4320-9e21-9dac35684661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:30.467842 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4641224c-e1ec-4320-9e21-9dac35684661 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:30.477931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1158/2273] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:30.482353 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5d3c7-bc11-463b-ac05-e53e19fa110b admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:30.492702 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a5d3c7-bc11-463b-ac05-e53e19fa110b admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:30.497494 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4c516-0d5a-4b4e-80e3-cc021adf046d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:30.498143 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4c516-0d5a-4b4e-80e3-cc021adf046d admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:30.498423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4c516-0d5a-4b4e-80e3-cc021adf046d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:30.500017 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4c516-0d5a-4b4e-80e3-cc021adf046d admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:30.500744 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4c516-0d5a-4b4e-80e3-cc021adf046d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:30.502324 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd4c516-0d5a-4b4e-80e3-cc021adf046d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:30.515714 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1116/2274] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:30.517702 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641224c-e1ec-4320-9e21-9dac35684661 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:30.528411 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4641224c-e1ec-4320-9e21-9dac35684661 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:30.533134 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e47edf-12ff-4b21-b14e-438d5e4a6c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:30.534190 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e47edf-12ff-4b21-b14e-438d5e4a6c46 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:30.534464 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e47edf-12ff-4b21-b14e-438d5e4a6c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:30.534777 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e47edf-12ff-4b21-b14e-438d5e4a6c46 admin admin] PATH_INFO: `/v3/projects/b267058a86c7488e8a394ef6599be5ff/users/6af32ebd9bcf4dd28a09c606c81f447f/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:30.552184 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e47edf-12ff-4b21-b14e-438d5e4a6c46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b267058a86c7488e8a394ef6599be5ff, user_id=6af32ebd9bcf4dd28a09c606c81f447f, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:30.554931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e47edf-12ff-4b21-b14e-438d5e4a6c46 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:30.569625 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1159/2275] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:30 2022] PUT /identity/v3/projects/b267058a86c7488e8a394ef6599be5ff/users/6af32ebd9bcf4dd28a09c606c81f447f/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:30.580727 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ef005-41b8-4da2-9335-d27019f21427 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:30.581012 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ef005-41b8-4da2-9335-d27019f21427 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:30.581288 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ef005-41b8-4da2-9335-d27019f21427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:30.607268 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-1d2ef005-41b8-4da2-9335-d27019f21427 None None] MFA Rules not processed for user `6af32ebd9bcf4dd28a09c606c81f447f`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:30.608458 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1d2ef005-41b8-4da2-9335-d27019f21427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:30.674405 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1117/2276] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:30.679029 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e47edf-12ff-4b21-b14e-438d5e4a6c46 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:30.740578 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e47edf-12ff-4b21-b14e-438d5e4a6c46 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:30.745172 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bd1ba-2c5f-4178-bb90-6ec154c3ee1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:30.745819 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bd1ba-2c5f-4178-bb90-6ec154c3ee1c admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:30.746097 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bd1ba-2c5f-4178-bb90-6ec154c3ee1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:30.746368 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bd1ba-2c5f-4178-bb90-6ec154c3ee1c admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:30.747651 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bd1ba-2c5f-4178-bb90-6ec154c3ee1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:30.749526 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bd1ba-2c5f-4178-bb90-6ec154c3ee1c admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:30.774418 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1160/2277] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:30 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:30.778680 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ef005-41b8-4da2-9335-d27019f21427 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:30.789244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ef005-41b8-4da2-9335-d27019f21427 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:30.844902 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98af828-d804-4a6c-84bf-5517c7372282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:30.845567 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98af828-d804-4a6c-84bf-5517c7372282 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:30.845849 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98af828-d804-4a6c-84bf-5517c7372282 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:30.846125 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98af828-d804-4a6c-84bf-5517c7372282 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:30.846842 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98af828-d804-4a6c-84bf-5517c7372282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:30.848734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98af828-d804-4a6c-84bf-5517c7372282 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:30.867680 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1118/2278] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:30 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:30.871918 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bd1ba-2c5f-4178-bb90-6ec154c3ee1c admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:30.889158 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bd1ba-2c5f-4178-bb90-6ec154c3ee1c admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:30.894008 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d078f89-17ee-44bd-b53e-a7619aec9e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:30.894710 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d078f89-17ee-44bd-b53e-a7619aec9e10 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:30.894986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d078f89-17ee-44bd-b53e-a7619aec9e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:30.895260 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d078f89-17ee-44bd-b53e-a7619aec9e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:30.895982 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d078f89-17ee-44bd-b53e-a7619aec9e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:30.897575 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d078f89-17ee-44bd-b53e-a7619aec9e10 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:30.909266 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1161/2279] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:30.913398 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98af828-d804-4a6c-84bf-5517c7372282 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:30.923287 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98af828-d804-4a6c-84bf-5517c7372282 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:30.928180 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c02f1-ecbe-40b7-81bf-fc46456ae3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:30.928838 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c02f1-ecbe-40b7-81bf-fc46456ae3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:30.929123 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c02f1-ecbe-40b7-81bf-fc46456ae3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:30.929400 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c02f1-ecbe-40b7-81bf-fc46456ae3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:30.930118 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c02f1-ecbe-40b7-81bf-fc46456ae3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:30.931730 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c02f1-ecbe-40b7-81bf-fc46456ae3d5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:30.947034 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1119/2280] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:30.951747 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d078f89-17ee-44bd-b53e-a7619aec9e10 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:30.962118 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d078f89-17ee-44bd-b53e-a7619aec9e10 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:30.967426 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee822f2f-ff1d-495c-a7d5-240c43f384d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:30.968305 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee822f2f-ff1d-495c-a7d5-240c43f384d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:30.968569 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee822f2f-ff1d-495c-a7d5-240c43f384d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:30.968839 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee822f2f-ff1d-495c-a7d5-240c43f384d0 admin admin] PATH_INFO: `/v3/projects/de86012b50734e02acac550e0c2cc57e/users/cb5f185afd714c22b8dfa9caecfdc337/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:30.984173 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee822f2f-ff1d-495c-a7d5-240c43f384d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de86012b50734e02acac550e0c2cc57e, user_id=cb5f185afd714c22b8dfa9caecfdc337, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:30.987240 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee822f2f-ff1d-495c-a7d5-240c43f384d0 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:31.000146 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1162/2281] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:30 2022] PUT /identity/v3/projects/de86012b50734e02acac550e0c2cc57e/users/cb5f185afd714c22b8dfa9caecfdc337/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:31.010652 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a09c00-5c30-40a3-a0ae-5dfac888a4af None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:31.016093 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a09c00-5c30-40a3-a0ae-5dfac888a4af None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:31.016093 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a09c00-5c30-40a3-a0ae-5dfac888a4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:31.042716 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a6a09c00-5c30-40a3-a0ae-5dfac888a4af None None] MFA Rules not processed for user `cb5f185afd714c22b8dfa9caecfdc337`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:31.043939 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a6a09c00-5c30-40a3-a0ae-5dfac888a4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:31.092327 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee822f2f-ff1d-495c-a7d5-240c43f384d0 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:31.094999 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-ee822f2f-ff1d-495c-a7d5-240c43f384d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:31.109488 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1120/2282] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:52:31.114125 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a09c00-5c30-40a3-a0ae-5dfac888a4af None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:31.150154 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee822f2f-ff1d-495c-a7d5-240c43f384d0 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:31.153812 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a87758-4a93-4ff5-ba27-5571c15bba6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:31.154451 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87758-4a93-4ff5-ba27-5571c15bba6b service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:31.154764 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87758-4a93-4ff5-ba27-5571c15bba6b service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:31.155040 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a87758-4a93-4ff5-ba27-5571c15bba6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:31.156801 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-c0a87758-4a93-4ff5-ba27-5571c15bba6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:31.172742 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a09c00-5c30-40a3-a0ae-5dfac888a4af None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:31.177300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3a056-9466-4df3-8da1-804a18421dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:31.177946 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3a056-9466-4df3-8da1-804a18421dcf admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:31.178228 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3a056-9466-4df3-8da1-804a18421dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:31.178501 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3a056-9466-4df3-8da1-804a18421dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:31.179302 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3a056-9466-4df3-8da1-804a18421dcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:31.181192 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3a056-9466-4df3-8da1-804a18421dcf admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:31.209814 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1121/2283] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:31 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:52:31.213754 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3a056-9466-4df3-8da1-804a18421dcf admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:31.221051 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a87758-4a93-4ff5-ba27-5571c15bba6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:31.222774 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a87758-4a93-4ff5-ba27-5571c15bba6b service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:31.231906 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1163/2284] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:31.286752 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3a056-9466-4df3-8da1-804a18421dcf admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:31.292685 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092ffad-c1b2-477b-9f9f-4f0e2b068030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:31.295117 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092ffad-c1b2-477b-9f9f-4f0e2b068030 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:31.295410 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092ffad-c1b2-477b-9f9f-4f0e2b068030 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:31.295693 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092ffad-c1b2-477b-9f9f-4f0e2b068030 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:31.296393 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092ffad-c1b2-477b-9f9f-4f0e2b068030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:31.298366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092ffad-c1b2-477b-9f9f-4f0e2b068030 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:31.324166 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1122/2285] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:31 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:52:31.328716 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a87758-4a93-4ff5-ba27-5571c15bba6b service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:31.340554 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a87758-4a93-4ff5-ba27-5571c15bba6b service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:31.346068 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501c666-97b6-4b45-8fa7-8c6f0439061b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:31.346769 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501c666-97b6-4b45-8fa7-8c6f0439061b admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:31.347055 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501c666-97b6-4b45-8fa7-8c6f0439061b admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:31.347328 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501c666-97b6-4b45-8fa7-8c6f0439061b admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:31.348049 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501c666-97b6-4b45-8fa7-8c6f0439061b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:31.349755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501c666-97b6-4b45-8fa7-8c6f0439061b admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:31.366693 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1164/2286] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:31.379319 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092ffad-c1b2-477b-9f9f-4f0e2b068030 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:31.391420 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092ffad-c1b2-477b-9f9f-4f0e2b068030 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:31.396436 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc87081-49b1-4fb6-926f-455516289791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:31.397492 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc87081-49b1-4fb6-926f-455516289791 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:31.397833 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc87081-49b1-4fb6-926f-455516289791 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:31.398126 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc87081-49b1-4fb6-926f-455516289791 admin admin] PATH_INFO: `/v3/projects/ca0a96114a644db19cab28c0ed2a0269/users/e9b89e077af04dc28cba5a09652ae818/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:31.413416 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc87081-49b1-4fb6-926f-455516289791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0a96114a644db19cab28c0ed2a0269, user_id=e9b89e077af04dc28cba5a09652ae818, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:31.416136 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc87081-49b1-4fb6-926f-455516289791 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:31.430694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1123/2287] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:31 2022] PUT /identity/v3/projects/ca0a96114a644db19cab28c0ed2a0269/users/e9b89e077af04dc28cba5a09652ae818/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:31.443019 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501c666-97b6-4b45-8fa7-8c6f0439061b admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:31.453233 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501c666-97b6-4b45-8fa7-8c6f0439061b admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:31.507862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8b916a-f194-459c-912b-59917b402960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:31.508520 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b916a-f194-459c-912b-59917b402960 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:31.508795 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b916a-f194-459c-912b-59917b402960 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:31.509067 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8b916a-f194-459c-912b-59917b402960 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:31.509773 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b916a-f194-459c-912b-59917b402960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:31.511698 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8b916a-f194-459c-912b-59917b402960 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:31.522319 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1165/2288] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:31.526743 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc87081-49b1-4fb6-926f-455516289791 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:31.541279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc87081-49b1-4fb6-926f-455516289791 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:31.546695 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576b2e4-4fb4-46ed-88fc-5dea7dadc3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:31.547701 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576b2e4-4fb4-46ed-88fc-5dea7dadc3be admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:31.548443 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576b2e4-4fb4-46ed-88fc-5dea7dadc3be admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:31.548443 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8576b2e4-4fb4-46ed-88fc-5dea7dadc3be admin admin] PATH_INFO: `/v3/projects/ca0a96114a644db19cab28c0ed2a0269/users/e9b89e077af04dc28cba5a09652ae818/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:31.550533 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576b2e4-4fb4-46ed-88fc-5dea7dadc3be admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca0a96114a644db19cab28c0ed2a0269, user_id=e9b89e077af04dc28cba5a09652ae818, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:31.553269 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8576b2e4-4fb4-46ed-88fc-5dea7dadc3be admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:31.564926 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1124/2289] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:31 2022] PUT /identity/v3/projects/ca0a96114a644db19cab28c0ed2a0269/users/e9b89e077af04dc28cba5a09652ae818/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:52:31.576235 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea19f72-848f-4389-a921-bbf2d20ed7f7 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:31.576520 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea19f72-848f-4389-a921-bbf2d20ed7f7 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:31.576993 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea19f72-848f-4389-a921-bbf2d20ed7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:31.631778 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-6ea19f72-848f-4389-a921-bbf2d20ed7f7 None None] MFA Rules not processed for user `e9b89e077af04dc28cba5a09652ae818`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:31.633311 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-6ea19f72-848f-4389-a921-bbf2d20ed7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:31.721048 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1166/2290] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:31 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:31.743092 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576b2e4-4fb4-46ed-88fc-5dea7dadc3be admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:31.821141 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8576b2e4-4fb4-46ed-88fc-5dea7dadc3be admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:31.830271 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f2bb3-0e74-4643-87f4-1be08db75682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:31.830924 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f2bb3-0e74-4643-87f4-1be08db75682 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:31.831278 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f2bb3-0e74-4643-87f4-1be08db75682 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:31.831713 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f2bb3-0e74-4643-87f4-1be08db75682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:31.836114 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea19f72-848f-4389-a921-bbf2d20ed7f7 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:31.837775 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-6ea19f72-848f-4389-a921-bbf2d20ed7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:31.855673 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea19f72-848f-4389-a921-bbf2d20ed7f7 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:31.861357 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d243997-479f-4a01-a273-e00e49292123 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:31.862635 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d243997-479f-4a01-a273-e00e49292123 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:31.862635 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d243997-479f-4a01-a273-e00e49292123 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:31.863364 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d243997-479f-4a01-a273-e00e49292123 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:31.866054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3d243997-479f-4a01-a273-e00e49292123 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:31.917116 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f2bb3-0e74-4643-87f4-1be08db75682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:31.919611 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f2bb3-0e74-4643-87f4-1be08db75682 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:31.929876 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1125/2291] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:31.951666 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d243997-479f-4a01-a273-e00e49292123 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:31.953130 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d243997-479f-4a01-a273-e00e49292123 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:31.962956 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1167/2292] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:33.435266 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f2bb3-0e74-4643-87f4-1be08db75682 service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:33.444041 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f2bb3-0e74-4643-87f4-1be08db75682 service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:33.448419 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e18833-2a06-4bd5-bb65-7800bbd5d6de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:33.449105 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e18833-2a06-4bd5-bb65-7800bbd5d6de service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:33.449393 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e18833-2a06-4bd5-bb65-7800bbd5d6de service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:33.449698 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e18833-2a06-4bd5-bb65-7800bbd5d6de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:33.505572 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e18833-2a06-4bd5-bb65-7800bbd5d6de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:33.507072 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e18833-2a06-4bd5-bb65-7800bbd5d6de service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:33.516137 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1126/2293] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:33 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:34.049776 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d243997-479f-4a01-a273-e00e49292123 service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:34.057989 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d243997-479f-4a01-a273-e00e49292123 service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:34.062028 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d2f41-9fe0-4ff4-bdc6-f0847580982f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:34.062682 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d2f41-9fe0-4ff4-bdc6-f0847580982f service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:34.062986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d2f41-9fe0-4ff4-bdc6-f0847580982f service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:34.063257 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d2f41-9fe0-4ff4-bdc6-f0847580982f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:34.071802 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d2f41-9fe0-4ff4-bdc6-f0847580982f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:34.073213 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d2f41-9fe0-4ff4-bdc6-f0847580982f service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:34.082552 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1168/2294] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:34 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:35.854808 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e18833-2a06-4bd5-bb65-7800bbd5d6de service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:35.856448 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-47e18833-2a06-4bd5-bb65-7800bbd5d6de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:35.933575 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e18833-2a06-4bd5-bb65-7800bbd5d6de service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:35.944300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed73ee-392d-4a00-bf64-4fe938a84078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:35.945456 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed73ee-392d-4a00-bf64-4fe938a84078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:35.945832 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed73ee-392d-4a00-bf64-4fe938a84078 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:35.946173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ed73ee-392d-4a00-bf64-4fe938a84078 admin admin] PATH_INFO: `/v3/users/d830a55c182642e19fd1c5cbff46735b` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:35.947598 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed73ee-392d-4a00-bf64-4fe938a84078 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d830a55c182642e19fd1c5cbff46735b)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:35.950066 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ed73ee-392d-4a00-bf64-4fe938a84078 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:36.003692 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-55ed73ee-392d-4a00-bf64-4fe938a84078 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd830a55c182642e19fd1c5cbff46735b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:36.013728 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-55ed73ee-392d-4a00-bf64-4fe938a84078 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd830a55c182642e19fd1c5cbff46735b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:36.014532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-55ed73ee-392d-4a00-bf64-4fe938a84078 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd830a55c182642e19fd1c5cbff46735b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:36.023564 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-55ed73ee-392d-4a00-bf64-4fe938a84078 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd830a55c182642e19fd1c5cbff46735b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:36.038005 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-55ed73ee-392d-4a00-bf64-4fe938a84078 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd830a55c182642e19fd1c5cbff46735b'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:36.044978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1127/2295] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:35 2022] DELETE /identity/v3/users/d830a55c182642e19fd1c5cbff46735b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:36.049702 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d63e7-2c03-45f9-99f6-d5b78ac381db None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:36.050214 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d63e7-2c03-45f9-99f6-d5b78ac381db None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:36.050305 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d63e7-2c03-45f9-99f6-d5b78ac381db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:36.069232 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-772d63e7-2c03-45f9-99f6-d5b78ac381db None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:36.070533 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-772d63e7-2c03-45f9-99f6-d5b78ac381db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:36.146731 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1169/2296] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:36.156652 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed73ee-392d-4a00-bf64-4fe938a84078 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:36.158358 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-55ed73ee-392d-4a00-bf64-4fe938a84078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:36.225381 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ed73ee-392d-4a00-bf64-4fe938a84078 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:36.231072 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed6a8e-e5d2-4ab0-80a1-cbf5205fedcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:36.231727 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed6a8e-e5d2-4ab0-80a1-cbf5205fedcc service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:36.232588 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed6a8e-e5d2-4ab0-80a1-cbf5205fedcc service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:36.233186 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bed6a8e-e5d2-4ab0-80a1-cbf5205fedcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:36.248815 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed6a8e-e5d2-4ab0-80a1-cbf5205fedcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:36.250247 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bed6a8e-e5d2-4ab0-80a1-cbf5205fedcc service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:36.270395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1128/2297] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:36.574171 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d63e7-2c03-45f9-99f6-d5b78ac381db None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:36.576337 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-772d63e7-2c03-45f9-99f6-d5b78ac381db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:36.598103 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d63e7-2c03-45f9-99f6-d5b78ac381db None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:36.637773 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa01e1-5c3a-4aab-967c-69ca6f5331de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:36.639673 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa01e1-5c3a-4aab-967c-69ca6f5331de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:36.640102 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa01e1-5c3a-4aab-967c-69ca6f5331de admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:36.640516 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa01e1-5c3a-4aab-967c-69ca6f5331de admin admin] PATH_INFO: `/v3/projects/7ba734de4f4043c192b16468cd6af441` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:36.642674 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa01e1-5c3a-4aab-967c-69ca6f5331de admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba734de4f4043c192b16468cd6af441)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:36.645796 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa01e1-5c3a-4aab-967c-69ca6f5331de admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:36.720516 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-f5aa01e1-5c3a-4aab-967c-69ca6f5331de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba734de4f4043c192b16468cd6af441', 'request_id': 'req-f5aa01e1-5c3a-4aab-967c-69ca6f5331de'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:36.728579 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-f5aa01e1-5c3a-4aab-967c-69ca6f5331de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba734de4f4043c192b16468cd6af441', 'request_id': 'req-f5aa01e1-5c3a-4aab-967c-69ca6f5331de'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:36.737059 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-f5aa01e1-5c3a-4aab-967c-69ca6f5331de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba734de4f4043c192b16468cd6af441', 'request_id': 'req-f5aa01e1-5c3a-4aab-967c-69ca6f5331de'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:36.757785 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-f5aa01e1-5c3a-4aab-967c-69ca6f5331de admin admin] The token cache is being invalidate because project 7ba734de4f4043c192b16468cd6af441 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:36.758327 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-f5aa01e1-5c3a-4aab-967c-69ca6f5331de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:36.759751 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-f5aa01e1-5c3a-4aab-967c-69ca6f5331de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:36.763172 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1170/2298] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:36 2022] DELETE /identity/v3/projects/7ba734de4f4043c192b16468cd6af441 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:36.769676 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed6a8e-e5d2-4ab0-80a1-cbf5205fedcc service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:36.780360 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bed6a8e-e5d2-4ab0-80a1-cbf5205fedcc service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:36.889026 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e9801-b791-4fc1-8bc9-58b9ebaaabe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:36.890022 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e9801-b791-4fc1-8bc9-58b9ebaaabe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:36.890391 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e9801-b791-4fc1-8bc9-58b9ebaaabe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:36.890782 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e9801-b791-4fc1-8bc9-58b9ebaaabe1 admin admin] PATH_INFO: `/v3/users/bce5fc2b2f63436f951d6267ce93b8dd` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:36.895262 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e9801-b791-4fc1-8bc9-58b9ebaaabe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bce5fc2b2f63436f951d6267ce93b8dd)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:36.897760 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e9801-b791-4fc1-8bc9-58b9ebaaabe1 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:36.991430 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-078e9801-b791-4fc1-8bc9-58b9ebaaabe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bce5fc2b2f63436f951d6267ce93b8dd'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:37.005844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-078e9801-b791-4fc1-8bc9-58b9ebaaabe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bce5fc2b2f63436f951d6267ce93b8dd'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:37.006787 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-078e9801-b791-4fc1-8bc9-58b9ebaaabe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bce5fc2b2f63436f951d6267ce93b8dd'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:37.018530 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-078e9801-b791-4fc1-8bc9-58b9ebaaabe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bce5fc2b2f63436f951d6267ce93b8dd'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:37.039413 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-078e9801-b791-4fc1-8bc9-58b9ebaaabe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bce5fc2b2f63436f951d6267ce93b8dd'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:37.053838 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1129/2299] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:36 2022] DELETE /identity/v3/users/bce5fc2b2f63436f951d6267ce93b8dd => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:37.414549 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa01e1-5c3a-4aab-967c-69ca6f5331de admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:37.416209 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f5aa01e1-5c3a-4aab-967c-69ca6f5331de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:37.430539 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa01e1-5c3a-4aab-967c-69ca6f5331de admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:37.511585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b93f4a-0d2d-46bf-b647-51fc52db588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:37.513370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b93f4a-0d2d-46bf-b647-51fc52db588c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:37.513795 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b93f4a-0d2d-46bf-b647-51fc52db588c admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:37.514196 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b93f4a-0d2d-46bf-b647-51fc52db588c admin admin] PATH_INFO: `/v3/projects/aa687a5e933445919d9fce0cf5629088` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:37.515565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b93f4a-0d2d-46bf-b647-51fc52db588c admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa687a5e933445919d9fce0cf5629088)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:37.517610 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b93f4a-0d2d-46bf-b647-51fc52db588c admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:37.577689 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-90b93f4a-0d2d-46bf-b647-51fc52db588c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa687a5e933445919d9fce0cf5629088', 'request_id': 'req-90b93f4a-0d2d-46bf-b647-51fc52db588c'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:37.584127 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-90b93f4a-0d2d-46bf-b647-51fc52db588c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa687a5e933445919d9fce0cf5629088', 'request_id': 'req-90b93f4a-0d2d-46bf-b647-51fc52db588c'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:37.590926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-90b93f4a-0d2d-46bf-b647-51fc52db588c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa687a5e933445919d9fce0cf5629088', 'request_id': 'req-90b93f4a-0d2d-46bf-b647-51fc52db588c'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:37.607402 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-90b93f4a-0d2d-46bf-b647-51fc52db588c admin admin] The token cache is being invalidate because project aa687a5e933445919d9fce0cf5629088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:37.608372 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-90b93f4a-0d2d-46bf-b647-51fc52db588c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:37.609219 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-90b93f4a-0d2d-46bf-b647-51fc52db588c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:37.612014 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1171/2300] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:37 2022] DELETE /identity/v3/projects/aa687a5e933445919d9fce0cf5629088 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:37.617202 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e9801-b791-4fc1-8bc9-58b9ebaaabe1 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:37.621238 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-078e9801-b791-4fc1-8bc9-58b9ebaaabe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:37.641740 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e9801-b791-4fc1-8bc9-58b9ebaaabe1 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:37.716168 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1644826-2785-4c6c-8e72-1ca79a90495a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:37.717040 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1644826-2785-4c6c-8e72-1ca79a90495a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:37.717372 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1644826-2785-4c6c-8e72-1ca79a90495a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:37.717655 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1644826-2785-4c6c-8e72-1ca79a90495a admin admin] PATH_INFO: `/v3/users/5d9cba8c8f0d41b58b1ecb7848559389` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:37.718898 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1644826-2785-4c6c-8e72-1ca79a90495a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d9cba8c8f0d41b58b1ecb7848559389)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:37.720815 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1644826-2785-4c6c-8e72-1ca79a90495a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:37.775044 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d1644826-2785-4c6c-8e72-1ca79a90495a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d9cba8c8f0d41b58b1ecb7848559389'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:37.784127 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d1644826-2785-4c6c-8e72-1ca79a90495a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d9cba8c8f0d41b58b1ecb7848559389'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:37.784966 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d1644826-2785-4c6c-8e72-1ca79a90495a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d9cba8c8f0d41b58b1ecb7848559389'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:37.791942 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d1644826-2785-4c6c-8e72-1ca79a90495a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d9cba8c8f0d41b58b1ecb7848559389'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:37.803648 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d1644826-2785-4c6c-8e72-1ca79a90495a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d9cba8c8f0d41b58b1ecb7848559389'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:37.813767 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1130/2301] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:37 2022] DELETE /identity/v3/users/5d9cba8c8f0d41b58b1ecb7848559389 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:52:38.256376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b93f4a-0d2d-46bf-b647-51fc52db588c admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:38.259910 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-90b93f4a-0d2d-46bf-b647-51fc52db588c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:38.277694 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b93f4a-0d2d-46bf-b647-51fc52db588c admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:38.349174 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a11b25-5578-450a-82bc-4198ee53ba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:38.349819 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a11b25-5578-450a-82bc-4198ee53ba9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:38.349931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a11b25-5578-450a-82bc-4198ee53ba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:38.350171 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a11b25-5578-450a-82bc-4198ee53ba9c admin admin] PATH_INFO: `/v3/users/6af32ebd9bcf4dd28a09c606c81f447f` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:38.352717 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a11b25-5578-450a-82bc-4198ee53ba9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6af32ebd9bcf4dd28a09c606c81f447f)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:38.355471 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a11b25-5578-450a-82bc-4198ee53ba9c admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:38.388733 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1644826-2785-4c6c-8e72-1ca79a90495a admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:38.391123 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d1644826-2785-4c6c-8e72-1ca79a90495a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:38.428589 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1644826-2785-4c6c-8e72-1ca79a90495a admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:38.441397 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73250c0b-8f78-4cd5-96a3-b56b777e91c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:38.443087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73250c0b-8f78-4cd5-96a3-b56b777e91c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:38.443554 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73250c0b-8f78-4cd5-96a3-b56b777e91c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:38.444012 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73250c0b-8f78-4cd5-96a3-b56b777e91c1 admin admin] PATH_INFO: `/v3/projects/01cb644158ae4c28844d1cce42b053c6` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:38.446137 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73250c0b-8f78-4cd5-96a3-b56b777e91c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01cb644158ae4c28844d1cce42b053c6)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:38.449882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-66a11b25-5578-450a-82bc-4198ee53ba9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6af32ebd9bcf4dd28a09c606c81f447f'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:38.450565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-66a11b25-5578-450a-82bc-4198ee53ba9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6af32ebd9bcf4dd28a09c606c81f447f'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:38.451156 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73250c0b-8f78-4cd5-96a3-b56b777e91c1 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:38.459751 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-66a11b25-5578-450a-82bc-4198ee53ba9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6af32ebd9bcf4dd28a09c606c81f447f'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:38.468104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-66a11b25-5578-450a-82bc-4198ee53ba9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6af32ebd9bcf4dd28a09c606c81f447f'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:38.480844 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-66a11b25-5578-450a-82bc-4198ee53ba9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6af32ebd9bcf4dd28a09c606c81f447f'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:38.493312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1172/2302] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:38 2022] DELETE /identity/v3/users/6af32ebd9bcf4dd28a09c606c81f447f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:38.503585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c203e-44ec-4f7e-b588-db216ff4a482 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:38.503866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c203e-44ec-4f7e-b588-db216ff4a482 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:38.504564 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c203e-44ec-4f7e-b588-db216ff4a482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:38.519063 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-73250c0b-8f78-4cd5-96a3-b56b777e91c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01cb644158ae4c28844d1cce42b053c6', 'request_id': 'req-73250c0b-8f78-4cd5-96a3-b56b777e91c1'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:38.524865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-73250c0b-8f78-4cd5-96a3-b56b777e91c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01cb644158ae4c28844d1cce42b053c6', 'request_id': 'req-73250c0b-8f78-4cd5-96a3-b56b777e91c1'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:38.532285 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-a89c203e-44ec-4f7e-b588-db216ff4a482 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:38.533400 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-73250c0b-8f78-4cd5-96a3-b56b777e91c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01cb644158ae4c28844d1cce42b053c6', 'request_id': 'req-73250c0b-8f78-4cd5-96a3-b56b777e91c1'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:38.535812 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a89c203e-44ec-4f7e-b588-db216ff4a482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:38.557055 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-73250c0b-8f78-4cd5-96a3-b56b777e91c1 admin admin] The token cache is being invalidate because project 01cb644158ae4c28844d1cce42b053c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:38.557426 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-73250c0b-8f78-4cd5-96a3-b56b777e91c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:38.558146 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-73250c0b-8f78-4cd5-96a3-b56b777e91c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:38.564090 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1131/2303] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:38 2022] DELETE /identity/v3/projects/01cb644158ae4c28844d1cce42b053c6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:52:38.565489 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501c6cb-5ef5-4972-8ce9-4ff1aef9d716 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:38.565777 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501c6cb-5ef5-4972-8ce9-4ff1aef9d716 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:38.566055 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501c6cb-5ef5-4972-8ce9-4ff1aef9d716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:38.598784 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-1501c6cb-5ef5-4972-8ce9-4ff1aef9d716 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:38.600089 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1501c6cb-5ef5-4972-8ce9-4ff1aef9d716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:38.619445 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1173/2304] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:38.625215 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c203e-44ec-4f7e-b588-db216ff4a482 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:38.627932 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a89c203e-44ec-4f7e-b588-db216ff4a482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:38.671381 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1132/2305] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:38.679978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9daf9b-fb88-4095-b5b6-720dc66ab7ae None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:38.680264 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9daf9b-fb88-4095-b5b6-720dc66ab7ae None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:38.680540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9daf9b-fb88-4095-b5b6-720dc66ab7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:38.694238 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c203e-44ec-4f7e-b588-db216ff4a482 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:38.698499 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413a9c4-96d9-4333-8b31-9ee89364c0ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:38.699456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413a9c4-96d9-4333-8b31-9ee89364c0ed service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:38.699692 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6b9daf9b-fb88-4095-b5b6-720dc66ab7ae None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:38.700112 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413a9c4-96d9-4333-8b31-9ee89364c0ed service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:38.700598 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413a9c4-96d9-4333-8b31-9ee89364c0ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:38.701163 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6b9daf9b-fb88-4095-b5b6-720dc66ab7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:38.710543 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1133/2306] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:52:38.713545 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413a9c4-96d9-4333-8b31-9ee89364c0ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:38.714734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9daf9b-fb88-4095-b5b6-720dc66ab7ae None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:38.715775 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c413a9c4-96d9-4333-8b31-9ee89364c0ed service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:38.724465 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9daf9b-fb88-4095-b5b6-720dc66ab7ae None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:38.725760 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1174/2307] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:52:38.729592 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03a271-2c72-4fe3-985f-fa84406bda45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:38.730242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03a271-2c72-4fe3-985f-fa84406bda45 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:38.730575 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03a271-2c72-4fe3-985f-fa84406bda45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:38.731449 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03a271-2c72-4fe3-985f-fa84406bda45 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:38.732183 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03a271-2c72-4fe3-985f-fa84406bda45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:52:38.732489 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03a271-2c72-4fe3-985f-fa84406bda45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:38.734208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03a271-2c72-4fe3-985f-fa84406bda45 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:38.746515 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1134/2308] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:52:38.750867 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413a9c4-96d9-4333-8b31-9ee89364c0ed service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:38.761494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413a9c4-96d9-4333-8b31-9ee89364c0ed service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:38.775311 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb09c56-d32f-48c8-91af-22e65815fc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:38.776092 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb09c56-d32f-48c8-91af-22e65815fc8d admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:38.776373 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb09c56-d32f-48c8-91af-22e65815fc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:38.776649 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb09c56-d32f-48c8-91af-22e65815fc8d admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:38.777357 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb09c56-d32f-48c8-91af-22e65815fc8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:38.780001 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb09c56-d32f-48c8-91af-22e65815fc8d admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:38.809639 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1175/2309] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:52:38 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:52:38.814627 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03a271-2c72-4fe3-985f-fa84406bda45 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:38.829034 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03a271-2c72-4fe3-985f-fa84406bda45 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:38.920387 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0ccfc-1171-4550-971b-da2106c3fd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:38.921233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0ccfc-1171-4550-971b-da2106c3fd1c admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:38.921719 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0ccfc-1171-4550-971b-da2106c3fd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:38.922108 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d0ccfc-1171-4550-971b-da2106c3fd1c admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:38.923036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0ccfc-1171-4550-971b-da2106c3fd1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:38.926795 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d0ccfc-1171-4550-971b-da2106c3fd1c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:38.953605 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1135/2310] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:52:38 2022] POST /identity/v3/users => generated 286 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:52:38.954846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb09c56-d32f-48c8-91af-22e65815fc8d admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:38.966943 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb09c56-d32f-48c8-91af-22e65815fc8d admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:38.973720 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb384447-c136-45f7-baa5-fb8f8a51fc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:38.974522 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb384447-c136-45f7-baa5-fb8f8a51fc8a admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:38.974963 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb384447-c136-45f7-baa5-fb8f8a51fc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:38.975380 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb384447-c136-45f7-baa5-fb8f8a51fc8a admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:38.976228 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb384447-c136-45f7-baa5-fb8f8a51fc8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:38.978407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb384447-c136-45f7-baa5-fb8f8a51fc8a admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:38.997742 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1176/2311] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:52:38.999022 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0ccfc-1171-4550-971b-da2106c3fd1c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:39.012775 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d0ccfc-1171-4550-971b-da2106c3fd1c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:39.019123 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd732e-8bd7-42e2-9bbe-c7107131cd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:39.020155 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd732e-8bd7-42e2-9bbe-c7107131cd52 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:39.020587 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd732e-8bd7-42e2-9bbe-c7107131cd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:39.020936 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd732e-8bd7-42e2-9bbe-c7107131cd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:39.022016 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd732e-8bd7-42e2-9bbe-c7107131cd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:39.023727 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd732e-8bd7-42e2-9bbe-c7107131cd52 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:39.041018 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb384447-c136-45f7-baa5-fb8f8a51fc8a admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:39.043687 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-fb384447-c136-45f7-baa5-fb8f8a51fc8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:39.044627 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1136/2312] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:52:39.055532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd732e-8bd7-42e2-9bbe-c7107131cd52 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:39.066442 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd732e-8bd7-42e2-9bbe-c7107131cd52 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:39.071597 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9580642e-e59c-4034-be0e-d32f20b90803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:39.072410 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580642e-e59c-4034-be0e-d32f20b90803 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:39.072695 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580642e-e59c-4034-be0e-d32f20b90803 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:39.073098 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9580642e-e59c-4034-be0e-d32f20b90803 admin admin] PATH_INFO: `/v3/projects/921097a9de454054adc6baa01dc1ca01/users/8577176cc8cb4f64a96a5815897189ba/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:39.092308 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb384447-c136-45f7-baa5-fb8f8a51fc8a admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:39.101078 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096d08b-7ddf-4302-884c-f855cc582227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:39.101952 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096d08b-7ddf-4302-884c-f855cc582227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:39.102229 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096d08b-7ddf-4302-884c-f855cc582227 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:39.102501 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9096d08b-7ddf-4302-884c-f855cc582227 admin admin] PATH_INFO: `/v3/projects/b267058a86c7488e8a394ef6599be5ff` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:39.103897 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580642e-e59c-4034-be0e-d32f20b90803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=921097a9de454054adc6baa01dc1ca01, user_id=8577176cc8cb4f64a96a5815897189ba, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:39.106873 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9580642e-e59c-4034-be0e-d32f20b90803 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:39.113102 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096d08b-7ddf-4302-884c-f855cc582227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b267058a86c7488e8a394ef6599be5ff)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:39.115979 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9096d08b-7ddf-4302-884c-f855cc582227 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:39.162641 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1137/2313] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:52:39 2022] PUT /identity/v3/projects/921097a9de454054adc6baa01dc1ca01/users/8577176cc8cb4f64a96a5815897189ba/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:52:39.167815 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58b9c9-4b13-445f-a10f-bba0e784bd3d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:39.168638 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58b9c9-4b13-445f-a10f-bba0e784bd3d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:39.168939 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58b9c9-4b13-445f-a10f-bba0e784bd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:39.213933 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-5d58b9c9-4b13-445f-a10f-bba0e784bd3d None None] MFA Rules not processed for user `8577176cc8cb4f64a96a5815897189ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:52:39.215285 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5d58b9c9-4b13-445f-a10f-bba0e784bd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:39.224449 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-9096d08b-7ddf-4302-884c-f855cc582227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b267058a86c7488e8a394ef6599be5ff', 'request_id': 'req-9096d08b-7ddf-4302-884c-f855cc582227'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:39.235053 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-9096d08b-7ddf-4302-884c-f855cc582227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b267058a86c7488e8a394ef6599be5ff', 'request_id': 'req-9096d08b-7ddf-4302-884c-f855cc582227'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:39.244609 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-9096d08b-7ddf-4302-884c-f855cc582227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b267058a86c7488e8a394ef6599be5ff', 'request_id': 'req-9096d08b-7ddf-4302-884c-f855cc582227'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:39.263678 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-9096d08b-7ddf-4302-884c-f855cc582227 admin admin] The token cache is being invalidate because project b267058a86c7488e8a394ef6599be5ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:39.264320 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-9096d08b-7ddf-4302-884c-f855cc582227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:39.265281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-9096d08b-7ddf-4302-884c-f855cc582227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:39.267469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1177/2314] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:39 2022] DELETE /identity/v3/projects/b267058a86c7488e8a394ef6599be5ff => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:39.272916 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096d08b-7ddf-4302-884c-f855cc582227 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:39.274861 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9096d08b-7ddf-4302-884c-f855cc582227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:39.361863 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1138/2315] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:52:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:52:39.391856 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58b9c9-4b13-445f-a10f-bba0e784bd3d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:39.394755 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5d58b9c9-4b13-445f-a10f-bba0e784bd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:39.400955 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9096d08b-7ddf-4302-884c-f855cc582227 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:39.429586 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede50b6-54b3-40d1-a6e3-5613ed3bbf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:39.430471 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede50b6-54b3-40d1-a6e3-5613ed3bbf9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:39.430902 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede50b6-54b3-40d1-a6e3-5613ed3bbf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:39.431173 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede50b6-54b3-40d1-a6e3-5613ed3bbf9d admin admin] PATH_INFO: `/v3/users/cb5f185afd714c22b8dfa9caecfdc337` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:39.433281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede50b6-54b3-40d1-a6e3-5613ed3bbf9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb5f185afd714c22b8dfa9caecfdc337)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:39.439547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede50b6-54b3-40d1-a6e3-5613ed3bbf9d admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:39.476767 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58b9c9-4b13-445f-a10f-bba0e784bd3d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:39.482253 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec284642-ebe9-4f6a-bba3-1121107f2950 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92dc1464c4b24c6c8ea5dfcc796f0279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:39.486464 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec284642-ebe9-4f6a-bba3-1121107f2950 service glance] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:39.487013 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec284642-ebe9-4f6a-bba3-1121107f2950 service glance] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:39.487545 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec284642-ebe9-4f6a-bba3-1121107f2950 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:39.502031 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec284642-ebe9-4f6a-bba3-1121107f2950 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:39.503865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec284642-ebe9-4f6a-bba3-1121107f2950 service glance] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:39.517074 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1139/2316] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:52:39.519903 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-3ede50b6-54b3-40d1-a6e3-5613ed3bbf9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb5f185afd714c22b8dfa9caecfdc337'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:39.521727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-3ede50b6-54b3-40d1-a6e3-5613ed3bbf9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb5f185afd714c22b8dfa9caecfdc337'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:39.533191 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-3ede50b6-54b3-40d1-a6e3-5613ed3bbf9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb5f185afd714c22b8dfa9caecfdc337'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:39.548399 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-3ede50b6-54b3-40d1-a6e3-5613ed3bbf9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb5f185afd714c22b8dfa9caecfdc337'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:39.573168 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-3ede50b6-54b3-40d1-a6e3-5613ed3bbf9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb5f185afd714c22b8dfa9caecfdc337'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:39.582957 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1178/2317] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:39 2022] DELETE /identity/v3/users/cb5f185afd714c22b8dfa9caecfdc337 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:52:39.897827 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec284642-ebe9-4f6a-bba3-1121107f2950 service glance] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:39.929978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec284642-ebe9-4f6a-bba3-1121107f2950 service glance] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:40.003472 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654768e-768f-4d53-ae0f-7bf61c2d0cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:40.004329 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654768e-768f-4d53-ae0f-7bf61c2d0cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:40.004613 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654768e-768f-4d53-ae0f-7bf61c2d0cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:40.004887 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2654768e-768f-4d53-ae0f-7bf61c2d0cd8 admin admin] PATH_INFO: `/v3/projects/de86012b50734e02acac550e0c2cc57e` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:40.006071 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654768e-768f-4d53-ae0f-7bf61c2d0cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de86012b50734e02acac550e0c2cc57e)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:40.007989 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2654768e-768f-4d53-ae0f-7bf61c2d0cd8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:40.075294 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-2654768e-768f-4d53-ae0f-7bf61c2d0cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de86012b50734e02acac550e0c2cc57e', 'request_id': 'req-2654768e-768f-4d53-ae0f-7bf61c2d0cd8'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:40.082499 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-2654768e-768f-4d53-ae0f-7bf61c2d0cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de86012b50734e02acac550e0c2cc57e', 'request_id': 'req-2654768e-768f-4d53-ae0f-7bf61c2d0cd8'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:40.089314 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-2654768e-768f-4d53-ae0f-7bf61c2d0cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de86012b50734e02acac550e0c2cc57e', 'request_id': 'req-2654768e-768f-4d53-ae0f-7bf61c2d0cd8'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:40.101943 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-2654768e-768f-4d53-ae0f-7bf61c2d0cd8 admin admin] The token cache is being invalidate because project de86012b50734e02acac550e0c2cc57e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:40.102232 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-2654768e-768f-4d53-ae0f-7bf61c2d0cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:40.102896 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-2654768e-768f-4d53-ae0f-7bf61c2d0cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:40.104445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1140/2318] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:39 2022] DELETE /identity/v3/projects/de86012b50734e02acac550e0c2cc57e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:40.108953 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede50b6-54b3-40d1-a6e3-5613ed3bbf9d admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:40.110453 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3ede50b6-54b3-40d1-a6e3-5613ed3bbf9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:40.124002 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede50b6-54b3-40d1-a6e3-5613ed3bbf9d admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:40.177041 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e116f0-a544-4e74-8602-ca5955a782d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:40.177823 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e116f0-a544-4e74-8602-ca5955a782d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:40.178097 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e116f0-a544-4e74-8602-ca5955a782d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:40.178365 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e116f0-a544-4e74-8602-ca5955a782d0 admin admin] PATH_INFO: `/v3/users/e9b89e077af04dc28cba5a09652ae818` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:40.179548 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e116f0-a544-4e74-8602-ca5955a782d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9b89e077af04dc28cba5a09652ae818)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:40.181443 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e116f0-a544-4e74-8602-ca5955a782d0 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:40.224191 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-71e116f0-a544-4e74-8602-ca5955a782d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9b89e077af04dc28cba5a09652ae818'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:40.224824 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-71e116f0-a544-4e74-8602-ca5955a782d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9b89e077af04dc28cba5a09652ae818'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:40.232073 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-71e116f0-a544-4e74-8602-ca5955a782d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9b89e077af04dc28cba5a09652ae818'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:40.238603 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-71e116f0-a544-4e74-8602-ca5955a782d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9b89e077af04dc28cba5a09652ae818'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:40.249584 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-71e116f0-a544-4e74-8602-ca5955a782d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9b89e077af04dc28cba5a09652ae818'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:40.255210 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1179/2319] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:52:40 2022] DELETE /identity/v3/users/e9b89e077af04dc28cba5a09652ae818 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:40.602275 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654768e-768f-4d53-ae0f-7bf61c2d0cd8 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:40.602275 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2654768e-768f-4d53-ae0f-7bf61c2d0cd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:40.628827 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2654768e-768f-4d53-ae0f-7bf61c2d0cd8 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:40.694825 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be2f3e-40ba-4f4e-af65-7244f7af6dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:40.695610 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be2f3e-40ba-4f4e-af65-7244f7af6dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:40.695943 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be2f3e-40ba-4f4e-af65-7244f7af6dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:40.696163 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be2f3e-40ba-4f4e-af65-7244f7af6dd7 admin admin] PATH_INFO: `/v3/projects/ca0a96114a644db19cab28c0ed2a0269` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:40.697389 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be2f3e-40ba-4f4e-af65-7244f7af6dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca0a96114a644db19cab28c0ed2a0269)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:40.699446 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be2f3e-40ba-4f4e-af65-7244f7af6dd7 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:40.747963 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-67be2f3e-40ba-4f4e-af65-7244f7af6dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca0a96114a644db19cab28c0ed2a0269', 'request_id': 'req-67be2f3e-40ba-4f4e-af65-7244f7af6dd7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:40.753176 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-67be2f3e-40ba-4f4e-af65-7244f7af6dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca0a96114a644db19cab28c0ed2a0269', 'request_id': 'req-67be2f3e-40ba-4f4e-af65-7244f7af6dd7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:40.759630 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-67be2f3e-40ba-4f4e-af65-7244f7af6dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca0a96114a644db19cab28c0ed2a0269', 'request_id': 'req-67be2f3e-40ba-4f4e-af65-7244f7af6dd7'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:40.773368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-67be2f3e-40ba-4f4e-af65-7244f7af6dd7 admin admin] The token cache is being invalidate because project ca0a96114a644db19cab28c0ed2a0269 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:52:40.773653 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-67be2f3e-40ba-4f4e-af65-7244f7af6dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:40.774280 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-67be2f3e-40ba-4f4e-af65-7244f7af6dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:52:40.776065 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1141/2320] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:52:40 2022] DELETE /identity/v3/projects/ca0a96114a644db19cab28c0ed2a0269 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:52:50.180607 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e116f0-a544-4e74-8602-ca5955a782d0 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:52:50.181979 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-71e116f0-a544-4e74-8602-ca5955a782d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:50.285440 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e116f0-a544-4e74-8602-ca5955a782d0 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:52:50.336275 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c67aff-643e-4e35-9c9f-b3a1b63c4d91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:52:50.336937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c67aff-643e-4e35-9c9f-b3a1b63c4d91 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:52:50.337311 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c67aff-643e-4e35-9c9f-b3a1b63c4d91 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:52:50.337559 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c67aff-643e-4e35-9c9f-b3a1b63c4d91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:52:50.339395 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-14c67aff-643e-4e35-9c9f-b3a1b63c4d91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:52:50.425647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c67aff-643e-4e35-9c9f-b3a1b63c4d91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:52:50.427136 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c67aff-643e-4e35-9c9f-b3a1b63c4d91 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:52:50.437598 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1180/2321] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:52:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:53:03.266319 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8b151-7788-49d6-a67c-f588898fd9ef None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:03.266814 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8b151-7788-49d6-a67c-f588898fd9ef None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:03.266975 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8b151-7788-49d6-a67c-f588898fd9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:03.284663 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-77f8b151-7788-49d6-a67c-f588898fd9ef None None] MFA Rules not processed for user `9924b7b7dd6448d78bc9d166a2b51927`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:03.285843 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-77f8b151-7788-49d6-a67c-f588898fd9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:03.343037 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1142/2322] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:53:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:53:07.083193 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c67aff-643e-4e35-9c9f-b3a1b63c4d91 service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:07.084647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-14c67aff-643e-4e35-9c9f-b3a1b63c4d91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:07.205777 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c67aff-643e-4e35-9c9f-b3a1b63c4d91 service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:07.210427 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6312e-0f7f-4dc0-b485-f0717b48dcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:07.211346 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6312e-0f7f-4dc0-b485-f0717b48dcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:07.211628 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6312e-0f7f-4dc0-b485-f0717b48dcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:07.211899 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6312e-0f7f-4dc0-b485-f0717b48dcb4 admin admin] PATH_INFO: `/v3/users/615a6e246cdc4b11af2035bbab9fc138` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:07.213111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6312e-0f7f-4dc0-b485-f0717b48dcb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=615a6e246cdc4b11af2035bbab9fc138)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:07.215804 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6312e-0f7f-4dc0-b485-f0717b48dcb4 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:07.277982 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-2bd6312e-0f7f-4dc0-b485-f0717b48dcb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '615a6e246cdc4b11af2035bbab9fc138'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.278762 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-2bd6312e-0f7f-4dc0-b485-f0717b48dcb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '615a6e246cdc4b11af2035bbab9fc138'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.287938 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-2bd6312e-0f7f-4dc0-b485-f0717b48dcb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '615a6e246cdc4b11af2035bbab9fc138'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.297144 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-2bd6312e-0f7f-4dc0-b485-f0717b48dcb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '615a6e246cdc4b11af2035bbab9fc138'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.313260 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-2bd6312e-0f7f-4dc0-b485-f0717b48dcb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '615a6e246cdc4b11af2035bbab9fc138'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.322633 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1181/2323] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:53:07 2022] DELETE /identity/v3/users/615a6e246cdc4b11af2035bbab9fc138 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:53:07.325727 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f292a3e-8ff2-49c4-a772-0e53af540ba9 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:07.326187 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f292a3e-8ff2-49c4-a772-0e53af540ba9 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:07.326268 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f292a3e-8ff2-49c4-a772-0e53af540ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:07.367176 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3f292a3e-8ff2-49c4-a772-0e53af540ba9 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:07.368481 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3f292a3e-8ff2-49c4-a772-0e53af540ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:07.445932 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1143/2324] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:53:07.456738 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6312e-0f7f-4dc0-b485-f0717b48dcb4 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:07.458162 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-2bd6312e-0f7f-4dc0-b485-f0717b48dcb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:07.525115 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6312e-0f7f-4dc0-b485-f0717b48dcb4 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:07.529043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9693eed-0f99-407d-871a-e37553ae00fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:07.529740 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9693eed-0f99-407d-871a-e37553ae00fd service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:07.530024 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9693eed-0f99-407d-871a-e37553ae00fd service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:07.530304 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9693eed-0f99-407d-871a-e37553ae00fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:07.540282 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9693eed-0f99-407d-871a-e37553ae00fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:07.542271 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9693eed-0f99-407d-871a-e37553ae00fd service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:07.556770 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1182/2325] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:53:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:53:07.820485 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f292a3e-8ff2-49c4-a772-0e53af540ba9 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:07.821931 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3f292a3e-8ff2-49c4-a772-0e53af540ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:07.833784 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f292a3e-8ff2-49c4-a772-0e53af540ba9 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:07.838618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed47647-b6bc-4ef4-816c-a5fef7af3695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:07.839496 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed47647-b6bc-4ef4-816c-a5fef7af3695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:07.839789 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed47647-b6bc-4ef4-816c-a5fef7af3695 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:07.840120 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed47647-b6bc-4ef4-816c-a5fef7af3695 admin admin] PATH_INFO: `/v3/projects/e5d907f670c84a2c9549fbffc2e72c25` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:07.841403 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed47647-b6bc-4ef4-816c-a5fef7af3695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d907f670c84a2c9549fbffc2e72c25)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:07.843182 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed47647-b6bc-4ef4-816c-a5fef7af3695 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:07.888951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9ed47647-b6bc-4ef4-816c-a5fef7af3695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d907f670c84a2c9549fbffc2e72c25', 'request_id': 'req-9ed47647-b6bc-4ef4-816c-a5fef7af3695'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.894094 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9ed47647-b6bc-4ef4-816c-a5fef7af3695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d907f670c84a2c9549fbffc2e72c25', 'request_id': 'req-9ed47647-b6bc-4ef4-816c-a5fef7af3695'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.900080 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9ed47647-b6bc-4ef4-816c-a5fef7af3695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d907f670c84a2c9549fbffc2e72c25', 'request_id': 'req-9ed47647-b6bc-4ef4-816c-a5fef7af3695'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.913391 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9ed47647-b6bc-4ef4-816c-a5fef7af3695 admin admin] The token cache is being invalidate because project e5d907f670c84a2c9549fbffc2e72c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:53:07.913682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9ed47647-b6bc-4ef4-816c-a5fef7af3695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.914312 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9ed47647-b6bc-4ef4-816c-a5fef7af3695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:07.915879 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1144/2326] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:53:07 2022] DELETE /identity/v3/projects/e5d907f670c84a2c9549fbffc2e72c25 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:53:07.921368 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ffb44-08d7-49d1-aed7-53260b826643 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:07.921656 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ffb44-08d7-49d1-aed7-53260b826643 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:07.921932 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ffb44-08d7-49d1-aed7-53260b826643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:07.967293 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-ae4ffb44-08d7-49d1-aed7-53260b826643 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:07.968516 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-ae4ffb44-08d7-49d1-aed7-53260b826643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:08.025882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1183/2327] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:53:08.034173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d6098-141b-4795-8a83-57cbeec51263 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:08.034477 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d6098-141b-4795-8a83-57cbeec51263 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:08.034762 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3d6098-141b-4795-8a83-57cbeec51263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:08.053053 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-0c3d6098-141b-4795-8a83-57cbeec51263 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:08.054222 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0c3d6098-141b-4795-8a83-57cbeec51263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:08.062811 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1145/2328] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:53:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:53:08.066871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ffb44-08d7-49d1-aed7-53260b826643 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:08.077071 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ffb44-08d7-49d1-aed7-53260b826643 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:08.082372 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e1cb0-5fd4-434d-81a4-9762e61fbf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:08.083072 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e1cb0-5fd4-434d-81a4-9762e61fbf9f admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:08.083355 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e1cb0-5fd4-434d-81a4-9762e61fbf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:08.083886 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e1cb0-5fd4-434d-81a4-9762e61fbf9f admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:08.084341 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e1cb0-5fd4-434d-81a4-9762e61fbf9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:53:08.084648 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e1cb0-5fd4-434d-81a4-9762e61fbf9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:08.086247 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e1cb0-5fd4-434d-81a4-9762e61fbf9f admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:08.097929 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1184/2329] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:53:08.102253 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d6098-141b-4795-8a83-57cbeec51263 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:08.111408 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3d6098-141b-4795-8a83-57cbeec51263 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:08.115962 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d58a6-13af-4b64-9fbf-55d40b996ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:08.116790 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d58a6-13af-4b64-9fbf-55d40b996ad8 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:08.117072 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d58a6-13af-4b64-9fbf-55d40b996ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:08.117343 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d58a6-13af-4b64-9fbf-55d40b996ad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:08.118036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d58a6-13af-4b64-9fbf-55d40b996ad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:08.119990 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d58a6-13af-4b64-9fbf-55d40b996ad8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:08.146394 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1146/2330] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:53:08 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:53:08.150672 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e1cb0-5fd4-434d-81a4-9762e61fbf9f admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:08.160469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e1cb0-5fd4-434d-81a4-9762e61fbf9f admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:08.216516 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f263f-4d49-4b3b-ba58-74b8a6dea807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:08.217257 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f263f-4d49-4b3b-ba58-74b8a6dea807 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:08.217639 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f263f-4d49-4b3b-ba58-74b8a6dea807 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:08.217993 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854f263f-4d49-4b3b-ba58-74b8a6dea807 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:08.218810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f263f-4d49-4b3b-ba58-74b8a6dea807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:08.220816 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854f263f-4d49-4b3b-ba58-74b8a6dea807 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:08.240444 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1185/2331] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:53:08 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:53:08.244439 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d58a6-13af-4b64-9fbf-55d40b996ad8 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:08.254865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d58a6-13af-4b64-9fbf-55d40b996ad8 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:08.259344 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e67bf0-7cf2-4fcf-ae67-c1f5ed58a3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:08.260264 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e67bf0-7cf2-4fcf-ae67-c1f5ed58a3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:08.260542 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e67bf0-7cf2-4fcf-ae67-c1f5ed58a3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:08.260810 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e67bf0-7cf2-4fcf-ae67-c1f5ed58a3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:08.261566 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e67bf0-7cf2-4fcf-ae67-c1f5ed58a3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:08.263683 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e67bf0-7cf2-4fcf-ae67-c1f5ed58a3e3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:08.274565 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1147/2332] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:53:08.278479 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f263f-4d49-4b3b-ba58-74b8a6dea807 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:08.288247 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854f263f-4d49-4b3b-ba58-74b8a6dea807 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:08.293279 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00431f42-ee2f-4c2c-a69a-3ce516fb6ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:08.293926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00431f42-ee2f-4c2c-a69a-3ce516fb6ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:08.294207 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00431f42-ee2f-4c2c-a69a-3ce516fb6ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:08.294481 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00431f42-ee2f-4c2c-a69a-3ce516fb6ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:08.295226 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00431f42-ee2f-4c2c-a69a-3ce516fb6ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:08.296815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00431f42-ee2f-4c2c-a69a-3ce516fb6ad4 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:08.306321 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1186/2333] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:53:08.310874 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e67bf0-7cf2-4fcf-ae67-c1f5ed58a3e3 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:08.320735 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e67bf0-7cf2-4fcf-ae67-c1f5ed58a3e3 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:08.325420 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cfad9-d929-443d-9318-e92ec8c1191a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:08.326284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cfad9-d929-443d-9318-e92ec8c1191a admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:08.326853 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cfad9-d929-443d-9318-e92ec8c1191a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:08.326853 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9cfad9-d929-443d-9318-e92ec8c1191a admin admin] PATH_INFO: `/v3/projects/0e5110c34e4f44c3890339f3f0c63557/users/08e9c5b9eec34735b9fbfeefd3504546/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:08.340795 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9cfad9-d929-443d-9318-e92ec8c1191a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5110c34e4f44c3890339f3f0c63557, user_id=08e9c5b9eec34735b9fbfeefd3504546, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:08.343422 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9cfad9-d929-443d-9318-e92ec8c1191a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:08.355968 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1148/2334] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:53:08 2022] PUT /identity/v3/projects/0e5110c34e4f44c3890339f3f0c63557/users/08e9c5b9eec34735b9fbfeefd3504546/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:53:08.366887 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597c7b7-3f49-4293-9737-562655852248 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:08.367276 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597c7b7-3f49-4293-9737-562655852248 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:08.367558 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5597c7b7-3f49-4293-9737-562655852248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:08.393889 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-5597c7b7-3f49-4293-9737-562655852248 None None] MFA Rules not processed for user `08e9c5b9eec34735b9fbfeefd3504546`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:08.395449 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-5597c7b7-3f49-4293-9737-562655852248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:08.456794 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1187/2335] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:53:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:53:08.468400 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cfad9-d929-443d-9318-e92ec8c1191a admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:08.470081 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8a9cfad9-d929-443d-9318-e92ec8c1191a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:08.526116 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9cfad9-d929-443d-9318-e92ec8c1191a admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:08.529824 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f311b-e44f-497d-8d52-4d15139b1635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:08.530467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f311b-e44f-497d-8d52-4d15139b1635 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:08.530793 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f311b-e44f-497d-8d52-4d15139b1635 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:08.531075 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f311b-e44f-497d-8d52-4d15139b1635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:08.539599 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f311b-e44f-497d-8d52-4d15139b1635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:08.541022 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f311b-e44f-497d-8d52-4d15139b1635 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:08.550681 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1149/2336] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:53:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:53:27.133563 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597c7b7-3f49-4293-9737-562655852248 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:27.135419 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-5597c7b7-3f49-4293-9737-562655852248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:27.212232 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5597c7b7-3f49-4293-9737-562655852248 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:27.218680 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512933b8-307f-4eea-9f78-bf1aee986947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:27.219565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512933b8-307f-4eea-9f78-bf1aee986947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:27.219945 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512933b8-307f-4eea-9f78-bf1aee986947 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:27.220141 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512933b8-307f-4eea-9f78-bf1aee986947 admin admin] PATH_INFO: `/v3/users/8577176cc8cb4f64a96a5815897189ba` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:27.221313 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512933b8-307f-4eea-9f78-bf1aee986947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8577176cc8cb4f64a96a5815897189ba)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:27.223539 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512933b8-307f-4eea-9f78-bf1aee986947 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:27.279891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-512933b8-307f-4eea-9f78-bf1aee986947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8577176cc8cb4f64a96a5815897189ba'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:27.280571 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-512933b8-307f-4eea-9f78-bf1aee986947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8577176cc8cb4f64a96a5815897189ba'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:27.290254 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-512933b8-307f-4eea-9f78-bf1aee986947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8577176cc8cb4f64a96a5815897189ba'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:27.299117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-512933b8-307f-4eea-9f78-bf1aee986947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8577176cc8cb4f64a96a5815897189ba'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:27.313209 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-512933b8-307f-4eea-9f78-bf1aee986947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8577176cc8cb4f64a96a5815897189ba'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:27.319827 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1188/2337] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:53:27 2022] DELETE /identity/v3/users/8577176cc8cb4f64a96a5815897189ba => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:53:27.324532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087b53c-9c22-4e45-8af5-a74c1e404c75 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:27.325078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087b53c-9c22-4e45-8af5-a74c1e404c75 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:27.325078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c087b53c-9c22-4e45-8af5-a74c1e404c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:27.347406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c087b53c-9c22-4e45-8af5-a74c1e404c75 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:27.348677 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c087b53c-9c22-4e45-8af5-a74c1e404c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:27.414238 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1150/2338] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:53:27.424358 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512933b8-307f-4eea-9f78-bf1aee986947 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:27.425857 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-512933b8-307f-4eea-9f78-bf1aee986947 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:27.492527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512933b8-307f-4eea-9f78-bf1aee986947 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:27.496563 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc556c-6b5c-466c-84f5-cddaf874921b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:27.497215 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc556c-6b5c-466c-84f5-cddaf874921b service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:27.497495 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc556c-6b5c-466c-84f5-cddaf874921b service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:27.497824 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc556c-6b5c-466c-84f5-cddaf874921b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:27.508889 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc556c-6b5c-466c-84f5-cddaf874921b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:27.510409 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc556c-6b5c-466c-84f5-cddaf874921b service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:27.520044 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1189/2339] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:53:27.798869 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087b53c-9c22-4e45-8af5-a74c1e404c75 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:27.806077 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c087b53c-9c22-4e45-8af5-a74c1e404c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:27.827539 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c087b53c-9c22-4e45-8af5-a74c1e404c75 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:27.832521 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f86ac-d4c9-4694-96be-037c8559c4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:27.833363 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f86ac-d4c9-4694-96be-037c8559c4ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:27.833635 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f86ac-d4c9-4694-96be-037c8559c4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:27.834126 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f86ac-d4c9-4694-96be-037c8559c4ec admin admin] PATH_INFO: `/v3/projects/921097a9de454054adc6baa01dc1ca01` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:27.835302 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f86ac-d4c9-4694-96be-037c8559c4ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=921097a9de454054adc6baa01dc1ca01)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:27.837220 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f86ac-d4c9-4694-96be-037c8559c4ec admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:27.887118 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f84f86ac-d4c9-4694-96be-037c8559c4ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '921097a9de454054adc6baa01dc1ca01', 'request_id': 'req-f84f86ac-d4c9-4694-96be-037c8559c4ec'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:27.892478 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f84f86ac-d4c9-4694-96be-037c8559c4ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '921097a9de454054adc6baa01dc1ca01', 'request_id': 'req-f84f86ac-d4c9-4694-96be-037c8559c4ec'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:27.899328 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f84f86ac-d4c9-4694-96be-037c8559c4ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '921097a9de454054adc6baa01dc1ca01', 'request_id': 'req-f84f86ac-d4c9-4694-96be-037c8559c4ec'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:27.912311 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f84f86ac-d4c9-4694-96be-037c8559c4ec admin admin] The token cache is being invalidate because project 921097a9de454054adc6baa01dc1ca01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:53:27.912617 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f84f86ac-d4c9-4694-96be-037c8559c4ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:27.913265 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f84f86ac-d4c9-4694-96be-037c8559c4ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:27.915128 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1151/2340] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:53:27 2022] DELETE /identity/v3/projects/921097a9de454054adc6baa01dc1ca01 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:53:27.919884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7451ae-f776-492b-9378-b32c8964294f None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:27.920171 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7451ae-f776-492b-9378-b32c8964294f None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:27.920453 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7451ae-f776-492b-9378-b32c8964294f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:27.938121 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-af7451ae-f776-492b-9378-b32c8964294f None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:27.939340 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-af7451ae-f776-492b-9378-b32c8964294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:27.999982 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1190/2341] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:53:28.008366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dc4f9-e9fa-457d-a6d5-c451132cc66d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:28.008652 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dc4f9-e9fa-457d-a6d5-c451132cc66d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:28.008928 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6dc4f9-e9fa-457d-a6d5-c451132cc66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:28.028122 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-cc6dc4f9-e9fa-457d-a6d5-c451132cc66d None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:28.029302 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-cc6dc4f9-e9fa-457d-a6d5-c451132cc66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:28.037439 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1152/2342] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:53:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:53:28.041400 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7451ae-f776-492b-9378-b32c8964294f None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:28.050996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7451ae-f776-492b-9378-b32c8964294f None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:28.055470 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e4a8f-3040-406a-9fd3-09ab44d14da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:28.056104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e4a8f-3040-406a-9fd3-09ab44d14da3 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:28.056382 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e4a8f-3040-406a-9fd3-09ab44d14da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:28.056653 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e4a8f-3040-406a-9fd3-09ab44d14da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:28.057359 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e4a8f-3040-406a-9fd3-09ab44d14da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:53:28.057661 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e4a8f-3040-406a-9fd3-09ab44d14da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:28.059272 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e4a8f-3040-406a-9fd3-09ab44d14da3 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:28.070276 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1191/2343] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:53:28.075021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dc4f9-e9fa-457d-a6d5-c451132cc66d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:28.083971 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6dc4f9-e9fa-457d-a6d5-c451132cc66d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:28.088491 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d4f09-7e40-48d8-a9d0-51b6161f18ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:28.089782 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d4f09-7e40-48d8-a9d0-51b6161f18ba admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:28.090064 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d4f09-7e40-48d8-a9d0-51b6161f18ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:28.090341 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36d4f09-7e40-48d8-a9d0-51b6161f18ba admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:28.091056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d4f09-7e40-48d8-a9d0-51b6161f18ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:28.092933 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36d4f09-7e40-48d8-a9d0-51b6161f18ba admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:28.117111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1153/2344] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:53:28 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:53:28.121263 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e4a8f-3040-406a-9fd3-09ab44d14da3 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:28.130934 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e4a8f-3040-406a-9fd3-09ab44d14da3 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:28.185232 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4054a-fdb0-43ae-af18-9e872531654b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:28.185885 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4054a-fdb0-43ae-af18-9e872531654b admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:28.186215 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4054a-fdb0-43ae-af18-9e872531654b admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:28.186462 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4054a-fdb0-43ae-af18-9e872531654b admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:28.187520 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4054a-fdb0-43ae-af18-9e872531654b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:28.189599 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4054a-fdb0-43ae-af18-9e872531654b admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:28.209540 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1192/2345] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:53:28 2022] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:53:28.213759 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d4f09-7e40-48d8-a9d0-51b6161f18ba admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:28.223726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36d4f09-7e40-48d8-a9d0-51b6161f18ba admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:28.228342 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841f780-c74e-410a-8b40-dfab3e4aee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:28.229015 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841f780-c74e-410a-8b40-dfab3e4aee31 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:28.229313 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841f780-c74e-410a-8b40-dfab3e4aee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:28.229590 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841f780-c74e-410a-8b40-dfab3e4aee31 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:28.230323 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841f780-c74e-410a-8b40-dfab3e4aee31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:28.232030 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841f780-c74e-410a-8b40-dfab3e4aee31 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:28.242614 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1154/2346] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:53:28.246630 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4054a-fdb0-43ae-af18-9e872531654b admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:28.256360 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4054a-fdb0-43ae-af18-9e872531654b admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:28.262050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1c0a6-617a-418a-acf1-6bd95927e284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:28.262733 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1c0a6-617a-418a-acf1-6bd95927e284 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:28.263018 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1c0a6-617a-418a-acf1-6bd95927e284 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:28.263295 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1c0a6-617a-418a-acf1-6bd95927e284 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:28.264016 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1c0a6-617a-418a-acf1-6bd95927e284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:28.265637 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1c0a6-617a-418a-acf1-6bd95927e284 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:28.275507 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1193/2347] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:53:28.279726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841f780-c74e-410a-8b40-dfab3e4aee31 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:28.289975 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841f780-c74e-410a-8b40-dfab3e4aee31 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:28.294850 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b37055-b268-4c22-9714-484270be3954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:28.295816 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b37055-b268-4c22-9714-484270be3954 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:28.296051 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b37055-b268-4c22-9714-484270be3954 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:28.296329 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b37055-b268-4c22-9714-484270be3954 admin admin] PATH_INFO: `/v3/projects/8d38a2198fb54d85b9d57ad61ceaacbe/users/1aa893f01e184789b11c1afb21aaedd9/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:28.312403 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b37055-b268-4c22-9714-484270be3954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d38a2198fb54d85b9d57ad61ceaacbe, user_id=1aa893f01e184789b11c1afb21aaedd9, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:28.315210 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b37055-b268-4c22-9714-484270be3954 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:28.328705 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1155/2348] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:53:28 2022] PUT /identity/v3/projects/8d38a2198fb54d85b9d57ad61ceaacbe/users/1aa893f01e184789b11c1afb21aaedd9/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:53:28.339527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df254b1e-7649-48f9-b80b-a5999c4eb98b None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:28.339811 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df254b1e-7649-48f9-b80b-a5999c4eb98b None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:28.340117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df254b1e-7649-48f9-b80b-a5999c4eb98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:28.368318 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-df254b1e-7649-48f9-b80b-a5999c4eb98b None None] MFA Rules not processed for user `1aa893f01e184789b11c1afb21aaedd9`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:28.369605 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-df254b1e-7649-48f9-b80b-a5999c4eb98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:28.435317 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1194/2349] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:53:28 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:53:28.446467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b37055-b268-4c22-9714-484270be3954 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:28.448825 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f2b37055-b268-4c22-9714-484270be3954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:28.522725 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b37055-b268-4c22-9714-484270be3954 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:28.526496 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a971b91-16e6-4571-9d87-2b595cea16da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:28.527164 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a971b91-16e6-4571-9d87-2b595cea16da service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:28.527441 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a971b91-16e6-4571-9d87-2b595cea16da service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:28.527713 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a971b91-16e6-4571-9d87-2b595cea16da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:28.535635 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a971b91-16e6-4571-9d87-2b595cea16da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:28.537035 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a971b91-16e6-4571-9d87-2b595cea16da service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:28.545996 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1156/2350] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:53:28 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:53:29.811862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df254b1e-7649-48f9-b80b-a5999c4eb98b None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:29.813555 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-df254b1e-7649-48f9-b80b-a5999c4eb98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:29.877408 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df254b1e-7649-48f9-b80b-a5999c4eb98b None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:29.881827 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3490e-236a-42f4-b882-8ff16712a269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:29.882721 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3490e-236a-42f4-b882-8ff16712a269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:29.883000 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3490e-236a-42f4-b882-8ff16712a269 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:29.883272 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3490e-236a-42f4-b882-8ff16712a269 admin admin] PATH_INFO: `/v3/users/08e9c5b9eec34735b9fbfeefd3504546` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:29.884705 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3490e-236a-42f4-b882-8ff16712a269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08e9c5b9eec34735b9fbfeefd3504546)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:29.887312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3490e-236a-42f4-b882-8ff16712a269 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:29.939837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a6a3490e-236a-42f4-b882-8ff16712a269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08e9c5b9eec34735b9fbfeefd3504546'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:29.940645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a6a3490e-236a-42f4-b882-8ff16712a269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08e9c5b9eec34735b9fbfeefd3504546'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:29.950382 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a6a3490e-236a-42f4-b882-8ff16712a269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08e9c5b9eec34735b9fbfeefd3504546'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:29.957707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a6a3490e-236a-42f4-b882-8ff16712a269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08e9c5b9eec34735b9fbfeefd3504546'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:29.970763 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a6a3490e-236a-42f4-b882-8ff16712a269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08e9c5b9eec34735b9fbfeefd3504546'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:29.978800 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1195/2351] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:53:29 2022] DELETE /identity/v3/users/08e9c5b9eec34735b9fbfeefd3504546 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:53:29.985256 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363c19c-5e5d-4b69-b7b6-706fd59c230c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:29.985796 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363c19c-5e5d-4b69-b7b6-706fd59c230c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:29.986214 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363c19c-5e5d-4b69-b7b6-706fd59c230c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:30.006897 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b363c19c-5e5d-4b69-b7b6-706fd59c230c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:53:30.008091 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b363c19c-5e5d-4b69-b7b6-706fd59c230c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:30.067904 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1157/2352] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:53:30.081396 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3490e-236a-42f4-b882-8ff16712a269 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:30.082894 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a6a3490e-236a-42f4-b882-8ff16712a269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:30.139567 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3490e-236a-42f4-b882-8ff16712a269 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:30.143244 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66564fa-003c-44f1-b957-18bca05820ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:30.143882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66564fa-003c-44f1-b957-18bca05820ff service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:30.144267 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66564fa-003c-44f1-b957-18bca05820ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:30.144546 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66564fa-003c-44f1-b957-18bca05820ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:30.153307 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66564fa-003c-44f1-b957-18bca05820ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:30.154782 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66564fa-003c-44f1-b957-18bca05820ff service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:30.163814 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1196/2353] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:53:30.456842 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363c19c-5e5d-4b69-b7b6-706fd59c230c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:53:30.458273 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b363c19c-5e5d-4b69-b7b6-706fd59c230c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:53:30.471064 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363c19c-5e5d-4b69-b7b6-706fd59c230c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:53:30.475839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65553eb-1387-4a3f-9500-826f8e6d50e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:53:30.476924 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65553eb-1387-4a3f-9500-826f8e6d50e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:53:30.477245 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65553eb-1387-4a3f-9500-826f8e6d50e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:53:30.477515 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65553eb-1387-4a3f-9500-826f8e6d50e8 admin admin] PATH_INFO: `/v3/projects/0e5110c34e4f44c3890339f3f0c63557` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:53:30.478931 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65553eb-1387-4a3f-9500-826f8e6d50e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5110c34e4f44c3890339f3f0c63557)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:53:30.481426 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65553eb-1387-4a3f-9500-826f8e6d50e8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:53:30.528842 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d65553eb-1387-4a3f-9500-826f8e6d50e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5110c34e4f44c3890339f3f0c63557', 'request_id': 'req-d65553eb-1387-4a3f-9500-826f8e6d50e8'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:30.534649 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d65553eb-1387-4a3f-9500-826f8e6d50e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5110c34e4f44c3890339f3f0c63557', 'request_id': 'req-d65553eb-1387-4a3f-9500-826f8e6d50e8'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:30.541208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d65553eb-1387-4a3f-9500-826f8e6d50e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5110c34e4f44c3890339f3f0c63557', 'request_id': 'req-d65553eb-1387-4a3f-9500-826f8e6d50e8'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:30.553169 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d65553eb-1387-4a3f-9500-826f8e6d50e8 admin admin] The token cache is being invalidate because project 0e5110c34e4f44c3890339f3f0c63557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:53:30.553393 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d65553eb-1387-4a3f-9500-826f8e6d50e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:30.554022 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d65553eb-1387-4a3f-9500-826f8e6d50e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:53:30.555609 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1158/2354] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:53:30 2022] DELETE /identity/v3/projects/0e5110c34e4f44c3890339f3f0c63557 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:54:07.373409 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66564fa-003c-44f1-b957-18bca05820ff service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:07.374815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d66564fa-003c-44f1-b957-18bca05820ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:07.388265 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66564fa-003c-44f1-b957-18bca05820ff service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:07.441057 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118487c8-2903-4e84-9302-8c5499445f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:07.441910 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118487c8-2903-4e84-9302-8c5499445f2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:07.442188 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118487c8-2903-4e84-9302-8c5499445f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:07.442460 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118487c8-2903-4e84-9302-8c5499445f2c admin admin] PATH_INFO: `/v3/users/1aa893f01e184789b11c1afb21aaedd9` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:07.443646 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118487c8-2903-4e84-9302-8c5499445f2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa893f01e184789b11c1afb21aaedd9)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:07.445543 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118487c8-2903-4e84-9302-8c5499445f2c admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:07.489626 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-118487c8-2903-4e84-9302-8c5499445f2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa893f01e184789b11c1afb21aaedd9'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:07.490329 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-118487c8-2903-4e84-9302-8c5499445f2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa893f01e184789b11c1afb21aaedd9'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:07.497216 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-118487c8-2903-4e84-9302-8c5499445f2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa893f01e184789b11c1afb21aaedd9'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:07.504175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-118487c8-2903-4e84-9302-8c5499445f2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa893f01e184789b11c1afb21aaedd9'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:07.519938 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-118487c8-2903-4e84-9302-8c5499445f2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa893f01e184789b11c1afb21aaedd9'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:07.526278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1197/2355] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:54:07 2022] DELETE /identity/v3/users/1aa893f01e184789b11c1afb21aaedd9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:54:07.530889 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf30e3-54b6-4d36-ac41-bfc413b4e2de None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:07.531390 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf30e3-54b6-4d36-ac41-bfc413b4e2de None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:07.531557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf30e3-54b6-4d36-ac41-bfc413b4e2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:07.549638 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b5bf30e3-54b6-4d36-ac41-bfc413b4e2de None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:07.550871 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b5bf30e3-54b6-4d36-ac41-bfc413b4e2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:07.607298 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1159/2356] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:07.616845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118487c8-2903-4e84-9302-8c5499445f2c admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:07.618332 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-118487c8-2903-4e84-9302-8c5499445f2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:07.673533 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118487c8-2903-4e84-9302-8c5499445f2c admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:07.677155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bb952-0ff4-485a-863f-f2caee059ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:07.677789 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bb952-0ff4-485a-863f-f2caee059ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:07.678069 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bb952-0ff4-485a-863f-f2caee059ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:07.678346 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bb952-0ff4-485a-863f-f2caee059ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:07.687369 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bb952-0ff4-485a-863f-f2caee059ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:07.688845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bb952-0ff4-485a-863f-f2caee059ae7 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:07.698261 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1198/2357] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:54:07.952128 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf30e3-54b6-4d36-ac41-bfc413b4e2de None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:07.953591 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b5bf30e3-54b6-4d36-ac41-bfc413b4e2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:07.965377 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf30e3-54b6-4d36-ac41-bfc413b4e2de None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:07.971068 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ae444-af27-4706-b00b-8414e967c15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:07.972156 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ae444-af27-4706-b00b-8414e967c15d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:07.972443 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ae444-af27-4706-b00b-8414e967c15d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:07.972718 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ae444-af27-4706-b00b-8414e967c15d admin admin] PATH_INFO: `/v3/projects/8d38a2198fb54d85b9d57ad61ceaacbe` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:07.973911 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ae444-af27-4706-b00b-8414e967c15d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d38a2198fb54d85b9d57ad61ceaacbe)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:07.976958 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759ae444-af27-4706-b00b-8414e967c15d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:08.031708 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-759ae444-af27-4706-b00b-8414e967c15d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d38a2198fb54d85b9d57ad61ceaacbe', 'request_id': 'req-759ae444-af27-4706-b00b-8414e967c15d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:08.036935 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-759ae444-af27-4706-b00b-8414e967c15d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d38a2198fb54d85b9d57ad61ceaacbe', 'request_id': 'req-759ae444-af27-4706-b00b-8414e967c15d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:08.043420 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-759ae444-af27-4706-b00b-8414e967c15d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d38a2198fb54d85b9d57ad61ceaacbe', 'request_id': 'req-759ae444-af27-4706-b00b-8414e967c15d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:08.054948 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-759ae444-af27-4706-b00b-8414e967c15d admin admin] The token cache is being invalidate because project 8d38a2198fb54d85b9d57ad61ceaacbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:54:08.055232 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-759ae444-af27-4706-b00b-8414e967c15d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:08.055847 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-759ae444-af27-4706-b00b-8414e967c15d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:08.057996 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1160/2358] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:54:07 2022] DELETE /identity/v3/projects/8d38a2198fb54d85b9d57ad61ceaacbe => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:54:08.062835 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff157ec-ad2f-4e7b-92ad-6a6de5ba9ffa None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:08.063156 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff157ec-ad2f-4e7b-92ad-6a6de5ba9ffa None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:08.063435 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff157ec-ad2f-4e7b-92ad-6a6de5ba9ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:08.080720 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-9ff157ec-ad2f-4e7b-92ad-6a6de5ba9ffa None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:08.082033 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9ff157ec-ad2f-4e7b-92ad-6a6de5ba9ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:08.138093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1199/2359] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:08.146272 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f16652-99f5-4bd5-9fe8-f2926da52ffd None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:08.146559 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f16652-99f5-4bd5-9fe8-f2926da52ffd None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:08.146863 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f16652-99f5-4bd5-9fe8-f2926da52ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:08.164865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-05f16652-99f5-4bd5-9fe8-f2926da52ffd None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:08.166680 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-05f16652-99f5-4bd5-9fe8-f2926da52ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:08.174372 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1161/2360] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:54:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:08.178300 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff157ec-ad2f-4e7b-92ad-6a6de5ba9ffa None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:08.187681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff157ec-ad2f-4e7b-92ad-6a6de5ba9ffa None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:08.192161 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccace944-c987-4ef6-b258-b8fcb162e0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:08.192797 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccace944-c987-4ef6-b258-b8fcb162e0eb admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:08.193078 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccace944-c987-4ef6-b258-b8fcb162e0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:08.193361 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccace944-c987-4ef6-b258-b8fcb162e0eb admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:08.194069 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccace944-c987-4ef6-b258-b8fcb162e0eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:54:08.194375 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccace944-c987-4ef6-b258-b8fcb162e0eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:08.196008 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccace944-c987-4ef6-b258-b8fcb162e0eb admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:08.207315 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1200/2361] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:54:08.211182 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f16652-99f5-4bd5-9fe8-f2926da52ffd None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:08.220547 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f16652-99f5-4bd5-9fe8-f2926da52ffd None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:08.225097 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa23c9c-07ef-4718-bfe7-bd3fc88906e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:08.225726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa23c9c-07ef-4718-bfe7-bd3fc88906e2 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:08.226004 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa23c9c-07ef-4718-bfe7-bd3fc88906e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:08.226274 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa23c9c-07ef-4718-bfe7-bd3fc88906e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:08.226988 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa23c9c-07ef-4718-bfe7-bd3fc88906e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:08.229443 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa23c9c-07ef-4718-bfe7-bd3fc88906e2 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:08.253508 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1162/2362] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:54:08 2022] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:54:08.257623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccace944-c987-4ef6-b258-b8fcb162e0eb admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:08.267527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccace944-c987-4ef6-b258-b8fcb162e0eb admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:08.321211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a61f1a-ea1d-4aa5-9072-eb00fcb9ae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:08.321856 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a61f1a-ea1d-4aa5-9072-eb00fcb9ae50 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:08.322161 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a61f1a-ea1d-4aa5-9072-eb00fcb9ae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:08.322456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a61f1a-ea1d-4aa5-9072-eb00fcb9ae50 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:08.323241 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a61f1a-ea1d-4aa5-9072-eb00fcb9ae50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:08.325355 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a61f1a-ea1d-4aa5-9072-eb00fcb9ae50 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:08.344599 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1201/2363] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:54:08 2022] POST /identity/v3/users => generated 287 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:54:08.348685 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa23c9c-07ef-4718-bfe7-bd3fc88906e2 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:08.359095 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa23c9c-07ef-4718-bfe7-bd3fc88906e2 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:08.363613 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5522a-7bba-40e9-a072-931b632e8d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:08.364258 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5522a-7bba-40e9-a072-931b632e8d01 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:08.364537 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5522a-7bba-40e9-a072-931b632e8d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:08.364811 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b5522a-7bba-40e9-a072-931b632e8d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:08.365524 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5522a-7bba-40e9-a072-931b632e8d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:08.367133 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b5522a-7bba-40e9-a072-931b632e8d01 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:08.377284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1163/2364] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:54:08.381140 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a61f1a-ea1d-4aa5-9072-eb00fcb9ae50 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:08.391576 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a61f1a-ea1d-4aa5-9072-eb00fcb9ae50 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:08.396066 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0d4a5-00bc-4897-8fcd-638a6128ae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:08.396712 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0d4a5-00bc-4897-8fcd-638a6128ae56 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:08.396993 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0d4a5-00bc-4897-8fcd-638a6128ae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:08.397273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0d4a5-00bc-4897-8fcd-638a6128ae56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:08.397990 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0d4a5-00bc-4897-8fcd-638a6128ae56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:08.399645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0d4a5-00bc-4897-8fcd-638a6128ae56 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:08.409705 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1202/2365] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:54:08.413822 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5522a-7bba-40e9-a072-931b632e8d01 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:08.424061 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b5522a-7bba-40e9-a072-931b632e8d01 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:08.428528 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626785c-a19e-4be3-8ad8-33f5a37df766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:08.429375 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626785c-a19e-4be3-8ad8-33f5a37df766 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:08.429682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626785c-a19e-4be3-8ad8-33f5a37df766 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:08.429951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0626785c-a19e-4be3-8ad8-33f5a37df766 admin admin] PATH_INFO: `/v3/projects/25038d716b5e4a21a2a1a25b6f932b86/users/fd9619348cf246d991fc0f2a0057dc9a/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:08.443730 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626785c-a19e-4be3-8ad8-33f5a37df766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25038d716b5e4a21a2a1a25b6f932b86, user_id=fd9619348cf246d991fc0f2a0057dc9a, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:08.446308 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0626785c-a19e-4be3-8ad8-33f5a37df766 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:08.458055 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1164/2366] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:54:08 2022] PUT /identity/v3/projects/25038d716b5e4a21a2a1a25b6f932b86/users/fd9619348cf246d991fc0f2a0057dc9a/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:54:08.468630 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dc054-dfcb-4f24-8c0a-255a527e5152 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:08.468921 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dc054-dfcb-4f24-8c0a-255a527e5152 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:08.469201 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35dc054-dfcb-4f24-8c0a-255a527e5152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:08.495150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-a35dc054-dfcb-4f24-8c0a-255a527e5152 None None] MFA Rules not processed for user `fd9619348cf246d991fc0f2a0057dc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:08.496362 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a35dc054-dfcb-4f24-8c0a-255a527e5152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:08.557900 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1203/2367] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:54:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:08.568433 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626785c-a19e-4be3-8ad8-33f5a37df766 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:08.570091 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0626785c-a19e-4be3-8ad8-33f5a37df766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:08.624845 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0626785c-a19e-4be3-8ad8-33f5a37df766 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:08.628463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca9443-81df-4880-acc3-dd335a403919 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:08.629099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca9443-81df-4880-acc3-dd335a403919 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:08.629382 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca9443-81df-4880-acc3-dd335a403919 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:08.629660 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca9443-81df-4880-acc3-dd335a403919 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:08.638466 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca9443-81df-4880-acc3-dd335a403919 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:08.639917 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ca9443-81df-4880-acc3-dd335a403919 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:08.648446 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1165/2368] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:54:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:54:09.974894 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddab914-c539-4ae2-babb-99204db79dc5 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:09.975576 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddab914-c539-4ae2-babb-99204db79dc5 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:09.975904 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddab914-c539-4ae2-babb-99204db79dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:09.993871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-3ddab914-c539-4ae2-babb-99204db79dc5 None None] MFA Rules not processed for user `fd9619348cf246d991fc0f2a0057dc9a`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:09.995111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3ddab914-c539-4ae2-babb-99204db79dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:10.002044 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1204/2369] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:54:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:10.151851 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91e88f-1fde-4da4-967c-95bc84f5fdbe None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:10.152333 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91e88f-1fde-4da4-967c-95bc84f5fdbe None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:10.152426 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91e88f-1fde-4da4-967c-95bc84f5fdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:10.209856 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-1d91e88f-1fde-4da4-967c-95bc84f5fdbe None None] MFA Rules not processed for user `e0653575c0a24603bb9287e6222313de`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:10.211113 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1d91e88f-1fde-4da4-967c-95bc84f5fdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:10.284011 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1166/2370] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Apr 11 16:54:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:10.333651 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddab914-c539-4ae2-babb-99204db79dc5 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:10.335194 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3ddab914-c539-4ae2-babb-99204db79dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:10.425672 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddab914-c539-4ae2-babb-99204db79dc5 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:10.430617 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498b48d-e797-4a9d-a4fb-c6a682266e06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6659c6661840a79ba9ff1c3c9e93c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:10.431767 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498b48d-e797-4a9d-a4fb-c6a682266e06 service swift] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:10.432046 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498b48d-e797-4a9d-a4fb-c6a682266e06 service swift] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:10.432330 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498b48d-e797-4a9d-a4fb-c6a682266e06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:10.441130 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498b48d-e797-4a9d-a4fb-c6a682266e06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:10.442822 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2498b48d-e797-4a9d-a4fb-c6a682266e06 service swift] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:10.451890 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1205/2371] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Apr 11 16:54:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:54:11.402521 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91e88f-1fde-4da4-967c-95bc84f5fdbe None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:11.404158 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1d91e88f-1fde-4da4-967c-95bc84f5fdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:11.511494 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91e88f-1fde-4da4-967c-95bc84f5fdbe None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:11.520511 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e302fd7-a417-4cb4-8e88-09f1fef9f9b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f5ef8708f54401af7e8defa8d13141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:11.521164 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e302fd7-a417-4cb4-8e88-09f1fef9f9b0 service placement] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:11.521655 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e302fd7-a417-4cb4-8e88-09f1fef9f9b0 service placement] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:11.521935 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e302fd7-a417-4cb4-8e88-09f1fef9f9b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:11.526296 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8e302fd7-a417-4cb4-8e88-09f1fef9f9b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:11.539886 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e302fd7-a417-4cb4-8e88-09f1fef9f9b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:11.542012 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e302fd7-a417-4cb4-8e88-09f1fef9f9b0 service placement] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:11.554435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1167/2372] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:54:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:54:27.315857 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a44af-7de9-4b32-9b0d-d84bf260571e None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:27.316418 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a44af-7de9-4b32-9b0d-d84bf260571e None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:27.316418 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a44af-7de9-4b32-9b0d-d84bf260571e None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:27.317776 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1206/2373] 10.222.0.73 () {54 vars in 921 bytes} [Mon Apr 11 16:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:54:27.324771 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d954f66-e4d8-4d32-8d2e-4d016e2e726e None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:27.325304 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d954f66-e4d8-4d32-8d2e-4d016e2e726e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:27.325304 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d954f66-e4d8-4d32-8d2e-4d016e2e726e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:27.388126 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9d954f66-e4d8-4d32-8d2e-4d016e2e726e None None] MFA Rules not processed for user `ba3665d046864985916fdd6c4a4edcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:27.389901 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9d954f66-e4d8-4d32-8d2e-4d016e2e726e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:27.452777 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce87f86-b418-4a6c-bba6-25551dc7a151 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:27.453062 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce87f86-b418-4a6c-bba6-25551dc7a151 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:27.453519 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce87f86-b418-4a6c-bba6-25551dc7a151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:27.474377 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-4ce87f86-b418-4a6c-bba6-25551dc7a151 None None] MFA Rules not processed for user `e0653575c0a24603bb9287e6222313de`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:27.475264 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4ce87f86-b418-4a6c-bba6-25551dc7a151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:27.483783 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1207/2374] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Apr 11 16:54:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:27.497074 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce87f86-b418-4a6c-bba6-25551dc7a151 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:27.513294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce87f86-b418-4a6c-bba6-25551dc7a151 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:27.518121 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1168/2375] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Apr 11 16:54:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:54:27.518745 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79def0d-d135-4b5b-9a02-e2ae5d9e3610 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6659c6661840a79ba9ff1c3c9e93c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:27.519438 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79def0d-d135-4b5b-9a02-e2ae5d9e3610 service swift] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:27.519658 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79def0d-d135-4b5b-9a02-e2ae5d9e3610 service swift] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:27.519933 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79def0d-d135-4b5b-9a02-e2ae5d9e3610 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:27.526097 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d954f66-e4d8-4d32-8d2e-4d016e2e726e None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:27.527523 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9d954f66-e4d8-4d32-8d2e-4d016e2e726e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:27.528845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79def0d-d135-4b5b-9a02-e2ae5d9e3610 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:27.530524 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79def0d-d135-4b5b-9a02-e2ae5d9e3610 service swift] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:27.540565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1208/2376] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Apr 11 16:54:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 11 16:54:27.626738 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d954f66-e4d8-4d32-8d2e-4d016e2e726e None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:27.631223 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2048c25a-861b-4500-aa4e-d0631a1cbb0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92dc1464c4b24c6c8ea5dfcc796f0279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:27.631873 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048c25a-861b-4500-aa4e-d0631a1cbb0b service glance] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:27.632157 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048c25a-861b-4500-aa4e-d0631a1cbb0b service glance] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:27.632435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2048c25a-861b-4500-aa4e-d0631a1cbb0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:27.643974 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048c25a-861b-4500-aa4e-d0631a1cbb0b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:27.645337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2048c25a-861b-4500-aa4e-d0631a1cbb0b service glance] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:27.657259 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1169/2377] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:54:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:54:27.726956 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f225661-e07b-41ad-b631-55ffd193d174 None None] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:27.727959 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f225661-e07b-41ad-b631-55ffd193d174 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:27.728378 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f225661-e07b-41ad-b631-55ffd193d174 None None] PATH_INFO: `/` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:27.730215 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1209/2378] 10.222.0.73 () {54 vars in 921 bytes} [Mon Apr 11 16:54:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:54:27.735300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ada50d-ef0f-48c3-95e6-2c0f71734521 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:27.735595 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ada50d-ef0f-48c3-95e6-2c0f71734521 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:27.735878 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ada50d-ef0f-48c3-95e6-2c0f71734521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:27.754766 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-31ada50d-ef0f-48c3-95e6-2c0f71734521 None None] MFA Rules not processed for user `7990c92f59454156bbd99445387ca889`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:27.756216 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-31ada50d-ef0f-48c3-95e6-2c0f71734521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:27.813840 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1170/2379] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Apr 11 16:54:27 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:27.825057 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f225661-e07b-41ad-b631-55ffd193d174 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:27.826871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3f225661-e07b-41ad-b631-55ffd193d174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:27.841144 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f225661-e07b-41ad-b631-55ffd193d174 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:27.844811 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b18f7-c359-4c39-ab16-7365ec91dbb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:27.845475 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b18f7-c359-4c39-ab16-7365ec91dbb5 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:27.845760 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b18f7-c359-4c39-ab16-7365ec91dbb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:27.846039 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b18f7-c359-4c39-ab16-7365ec91dbb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:27.853318 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b18f7-c359-4c39-ab16-7365ec91dbb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:27.855439 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b18f7-c359-4c39-ab16-7365ec91dbb5 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:27.863289 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1210/2380] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:54:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:54:27.980837 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a4f46-e591-46b6-97cb-43bf28e6bd69 None None] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:27.981138 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a4f46-e591-46b6-97cb-43bf28e6bd69 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:27.981447 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a4f46-e591-46b6-97cb-43bf28e6bd69 None None] PATH_INFO: `/` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:27.982902 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1171/2381] 10.222.0.73 () {54 vars in 921 bytes} [Mon Apr 11 16:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 16:54:27.992150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0da7d-e9bf-4a35-af9c-44e98afbac7e None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:27.992439 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0da7d-e9bf-4a35-af9c-44e98afbac7e None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:27.992730 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b0da7d-e9bf-4a35-af9c-44e98afbac7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:28.011303 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-22b0da7d-e9bf-4a35-af9c-44e98afbac7e None None] MFA Rules not processed for user `ba3665d046864985916fdd6c4a4edcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:28.012490 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-22b0da7d-e9bf-4a35-af9c-44e98afbac7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:28.021756 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1211/2382] 10.222.0.73 () {58 vars in 1018 bytes} [Mon Apr 11 16:54:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:28.033865 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a4f46-e591-46b6-97cb-43bf28e6bd69 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:28.049536 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a4f46-e591-46b6-97cb-43bf28e6bd69 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:28.053215 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c85fa8-fc28-41d8-9e2f-8661756891c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:28.053883 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c85fa8-fc28-41d8-9e2f-8661756891c4 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:28.054157 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c85fa8-fc28-41d8-9e2f-8661756891c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:28.054423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c85fa8-fc28-41d8-9e2f-8661756891c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:28.064657 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c85fa8-fc28-41d8-9e2f-8661756891c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:28.066065 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c85fa8-fc28-41d8-9e2f-8661756891c4 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:28.078732 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1172/2383] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:54:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:54:28.134067 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66382d21-3335-4ac9-b954-615b207054ed None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:28.134373 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66382d21-3335-4ac9-b954-615b207054ed None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:28.134701 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66382d21-3335-4ac9-b954-615b207054ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:28.153565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-66382d21-3335-4ac9-b954-615b207054ed None None] MFA Rules not processed for user `e0653575c0a24603bb9287e6222313de`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:28.154742 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-66382d21-3335-4ac9-b954-615b207054ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:28.162194 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1212/2384] 10.222.0.73 () {58 vars in 967 bytes} [Mon Apr 11 16:54:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:28.175142 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c85fa8-fc28-41d8-9e2f-8661756891c4 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:28.185973 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c85fa8-fc28-41d8-9e2f-8661756891c4 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:28.191037 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0532a-2661-4cf2-9aff-8682b9ab2411 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6659c6661840a79ba9ff1c3c9e93c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:28.191662 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0532a-2661-4cf2-9aff-8682b9ab2411 service swift] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:28.191937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0532a-2661-4cf2-9aff-8682b9ab2411 service swift] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:28.192209 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0532a-2661-4cf2-9aff-8682b9ab2411 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:28.200578 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0532a-2661-4cf2-9aff-8682b9ab2411 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:28.202145 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0532a-2661-4cf2-9aff-8682b9ab2411 service swift] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:28.210083 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1173/2385] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Apr 11 16:54:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:54:28.405048 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8864b0-6b95-49fd-9293-dc4cc24d73cb None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:28.405501 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8864b0-6b95-49fd-9293-dc4cc24d73cb None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:28.405595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8864b0-6b95-49fd-9293-dc4cc24d73cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:28.423578 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-3e8864b0-6b95-49fd-9293-dc4cc24d73cb None None] MFA Rules not processed for user `e0653575c0a24603bb9287e6222313de`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:28.424687 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3e8864b0-6b95-49fd-9293-dc4cc24d73cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:28.432353 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1213/2386] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Apr 11 16:54:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:28.445308 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0532a-2661-4cf2-9aff-8682b9ab2411 service swift] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:28.458641 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0532a-2661-4cf2-9aff-8682b9ab2411 service swift] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:28.465114 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132d543-7984-41a9-b1de-a12be955a1ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6659c6661840a79ba9ff1c3c9e93c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:28.465761 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132d543-7984-41a9-b1de-a12be955a1ac service swift] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:28.466045 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132d543-7984-41a9-b1de-a12be955a1ac service swift] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:28.466321 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2132d543-7984-41a9-b1de-a12be955a1ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:28.477622 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132d543-7984-41a9-b1de-a12be955a1ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:28.479176 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2132d543-7984-41a9-b1de-a12be955a1ac service swift] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:28.494778 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1174/2387] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Apr 11 16:54:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:54:28.826086 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c084ef2-5e6c-46a0-81f8-0c5c6ce77bbe None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:28.826469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c084ef2-5e6c-46a0-81f8-0c5c6ce77bbe None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:28.826785 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c084ef2-5e6c-46a0-81f8-0c5c6ce77bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:28.843735 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-9c084ef2-5e6c-46a0-81f8-0c5c6ce77bbe None None] MFA Rules not processed for user `e0653575c0a24603bb9287e6222313de`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:28.844927 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9c084ef2-5e6c-46a0-81f8-0c5c6ce77bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:28.851944 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1214/2388] 10.222.0.73 () {58 vars in 967 bytes} [Mon Apr 11 16:54:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:28.864076 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132d543-7984-41a9-b1de-a12be955a1ac service swift] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:28.874937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2132d543-7984-41a9-b1de-a12be955a1ac service swift] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:28.879858 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170b30f-a67e-4483-a1c4-9144e4cd19e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6659c6661840a79ba9ff1c3c9e93c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:28.880481 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170b30f-a67e-4483-a1c4-9144e4cd19e7 service swift] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:28.880755 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170b30f-a67e-4483-a1c4-9144e4cd19e7 service swift] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:28.881024 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170b30f-a67e-4483-a1c4-9144e4cd19e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:28.889053 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170b30f-a67e-4483-a1c4-9144e4cd19e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:28.890636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170b30f-a67e-4483-a1c4-9144e4cd19e7 service swift] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:28.898305 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1175/2389] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Apr 11 16:54:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:54:31.130512 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c084ef2-5e6c-46a0-81f8-0c5c6ce77bbe None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:31.195473 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c084ef2-5e6c-46a0-81f8-0c5c6ce77bbe None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:31.200874 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40cc3d-0618-4000-b727-bda8091acb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:31.201842 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40cc3d-0618-4000-b727-bda8091acb0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:31.202130 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40cc3d-0618-4000-b727-bda8091acb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:31.202437 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e40cc3d-0618-4000-b727-bda8091acb0c admin admin] PATH_INFO: `/v3/users/fd9619348cf246d991fc0f2a0057dc9a` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:31.203822 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40cc3d-0618-4000-b727-bda8091acb0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd9619348cf246d991fc0f2a0057dc9a)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:31.206016 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e40cc3d-0618-4000-b727-bda8091acb0c admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:31.255173 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5e40cc3d-0618-4000-b727-bda8091acb0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd9619348cf246d991fc0f2a0057dc9a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:31.255899 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5e40cc3d-0618-4000-b727-bda8091acb0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd9619348cf246d991fc0f2a0057dc9a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:31.264142 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5e40cc3d-0618-4000-b727-bda8091acb0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd9619348cf246d991fc0f2a0057dc9a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:31.271352 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5e40cc3d-0618-4000-b727-bda8091acb0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd9619348cf246d991fc0f2a0057dc9a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:31.284122 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-5e40cc3d-0618-4000-b727-bda8091acb0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd9619348cf246d991fc0f2a0057dc9a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:31.290508 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1215/2390] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:54:31 2022] DELETE /identity/v3/users/fd9619348cf246d991fc0f2a0057dc9a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:54:31.295361 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f621fc1-8b6d-4d91-b5ab-73b1728573a7 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:31.295851 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f621fc1-8b6d-4d91-b5ab-73b1728573a7 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:31.295965 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f621fc1-8b6d-4d91-b5ab-73b1728573a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:31.313462 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-4f621fc1-8b6d-4d91-b5ab-73b1728573a7 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:31.314859 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4f621fc1-8b6d-4d91-b5ab-73b1728573a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:31.375572 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1176/2391] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:31.386734 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40cc3d-0618-4000-b727-bda8091acb0c admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:31.388223 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-5e40cc3d-0618-4000-b727-bda8091acb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:31.449073 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e40cc3d-0618-4000-b727-bda8091acb0c admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:31.452917 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b25b1-b092-4060-bb49-c3ad71cb12bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:31.453620 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b25b1-b092-4060-bb49-c3ad71cb12bf service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:31.453944 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b25b1-b092-4060-bb49-c3ad71cb12bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:31.454255 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b25b1-b092-4060-bb49-c3ad71cb12bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:31.463494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b25b1-b092-4060-bb49-c3ad71cb12bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:31.465070 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b25b1-b092-4060-bb49-c3ad71cb12bf service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:31.476139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1216/2392] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:54:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:54:31.653647 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f621fc1-8b6d-4d91-b5ab-73b1728573a7 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:31.655987 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4f621fc1-8b6d-4d91-b5ab-73b1728573a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:31.679418 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f621fc1-8b6d-4d91-b5ab-73b1728573a7 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:31.685091 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f2903a-2b53-4d42-9d0c-849b51cc906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:31.685984 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2903a-2b53-4d42-9d0c-849b51cc906a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:31.686321 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2903a-2b53-4d42-9d0c-849b51cc906a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:31.686609 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f2903a-2b53-4d42-9d0c-849b51cc906a admin admin] PATH_INFO: `/v3/projects/25038d716b5e4a21a2a1a25b6f932b86` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:31.687799 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2903a-2b53-4d42-9d0c-849b51cc906a admin admin] RBAC: Authorizing `identity:delete_project(project_id=25038d716b5e4a21a2a1a25b6f932b86)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:31.689681 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f2903a-2b53-4d42-9d0c-849b51cc906a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:31.734719 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-35f2903a-2b53-4d42-9d0c-849b51cc906a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25038d716b5e4a21a2a1a25b6f932b86', 'request_id': 'req-35f2903a-2b53-4d42-9d0c-849b51cc906a'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:31.739871 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-35f2903a-2b53-4d42-9d0c-849b51cc906a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25038d716b5e4a21a2a1a25b6f932b86', 'request_id': 'req-35f2903a-2b53-4d42-9d0c-849b51cc906a'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:31.746365 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-35f2903a-2b53-4d42-9d0c-849b51cc906a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25038d716b5e4a21a2a1a25b6f932b86', 'request_id': 'req-35f2903a-2b53-4d42-9d0c-849b51cc906a'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:31.758329 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-35f2903a-2b53-4d42-9d0c-849b51cc906a admin admin] The token cache is being invalidate because project 25038d716b5e4a21a2a1a25b6f932b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:54:31.758633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-35f2903a-2b53-4d42-9d0c-849b51cc906a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:31.759259 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-35f2903a-2b53-4d42-9d0c-849b51cc906a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:54:31.760779 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1177/2393] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:54:31 2022] DELETE /identity/v3/projects/25038d716b5e4a21a2a1a25b6f932b86 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:54:31.765752 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96d527-6065-4b56-b080-dd0fa88638f4 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:31.766037 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96d527-6065-4b56-b080-dd0fa88638f4 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:31.766309 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca96d527-6065-4b56-b080-dd0fa88638f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:31.783831 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-ca96d527-6065-4b56-b080-dd0fa88638f4 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:31.785002 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-ca96d527-6065-4b56-b080-dd0fa88638f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:31.843170 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1217/2394] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:31.850998 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e414ed-8b0a-4055-9677-dbab2dbccded None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:31.851259 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e414ed-8b0a-4055-9677-dbab2dbccded None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:31.851543 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e414ed-8b0a-4055-9677-dbab2dbccded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:31.872677 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-51e414ed-8b0a-4055-9677-dbab2dbccded None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:31.873889 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-51e414ed-8b0a-4055-9677-dbab2dbccded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:31.882263 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1178/2395] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:31.886889 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96d527-6065-4b56-b080-dd0fa88638f4 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:31.896347 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca96d527-6065-4b56-b080-dd0fa88638f4 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:31.900858 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb35ad9-f4ce-4653-b0f7-c2bdd7788669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:31.901507 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb35ad9-f4ce-4653-b0f7-c2bdd7788669 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:31.901794 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb35ad9-f4ce-4653-b0f7-c2bdd7788669 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:31.902075 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb35ad9-f4ce-4653-b0f7-c2bdd7788669 admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:31.902823 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb35ad9-f4ce-4653-b0f7-c2bdd7788669 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:54:31.903131 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb35ad9-f4ce-4653-b0f7-c2bdd7788669 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:31.904742 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb35ad9-f4ce-4653-b0f7-c2bdd7788669 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:31.916631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1218/2396] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:54:31.921096 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e414ed-8b0a-4055-9677-dbab2dbccded None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:31.930127 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e414ed-8b0a-4055-9677-dbab2dbccded None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:31.935400 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4020308-9f46-4250-8c29-09d72678f7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:31.936046 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4020308-9f46-4250-8c29-09d72678f7e8 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:31.936328 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4020308-9f46-4250-8c29-09d72678f7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:31.936605 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4020308-9f46-4250-8c29-09d72678f7e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:31.937306 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4020308-9f46-4250-8c29-09d72678f7e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:31.939261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4020308-9f46-4250-8c29-09d72678f7e8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:31.965063 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1179/2397] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:54:31 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:54:31.969178 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb35ad9-f4ce-4653-b0f7-c2bdd7788669 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:31.979872 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb35ad9-f4ce-4653-b0f7-c2bdd7788669 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:32.036390 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389d1ca-bd3d-4bed-ac12-18169d1e81a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:32.037066 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389d1ca-bd3d-4bed-ac12-18169d1e81a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:32.037346 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389d1ca-bd3d-4bed-ac12-18169d1e81a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:32.037623 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389d1ca-bd3d-4bed-ac12-18169d1e81a7 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:32.038320 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389d1ca-bd3d-4bed-ac12-18169d1e81a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:32.040856 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389d1ca-bd3d-4bed-ac12-18169d1e81a7 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:32.061292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1219/2398] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:54:31 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:54:32.065410 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4020308-9f46-4250-8c29-09d72678f7e8 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:32.076682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4020308-9f46-4250-8c29-09d72678f7e8 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:32.081842 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8d761-ad70-4c1a-b7bc-53ca3b91d825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:32.082698 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8d761-ad70-4c1a-b7bc-53ca3b91d825 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:32.082980 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8d761-ad70-4c1a-b7bc-53ca3b91d825 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:32.083249 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a8d761-ad70-4c1a-b7bc-53ca3b91d825 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:32.083981 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8d761-ad70-4c1a-b7bc-53ca3b91d825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:32.085607 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a8d761-ad70-4c1a-b7bc-53ca3b91d825 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:32.096188 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1180/2399] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:54:32.100160 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389d1ca-bd3d-4bed-ac12-18169d1e81a7 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:32.111126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389d1ca-bd3d-4bed-ac12-18169d1e81a7 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:32.115879 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18d102-f0e2-4383-8297-a8cf20af7c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:32.116574 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18d102-f0e2-4383-8297-a8cf20af7c3c admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:32.116857 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18d102-f0e2-4383-8297-a8cf20af7c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:32.117137 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18d102-f0e2-4383-8297-a8cf20af7c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:32.118430 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18d102-f0e2-4383-8297-a8cf20af7c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:32.120085 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18d102-f0e2-4383-8297-a8cf20af7c3c admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:32.130157 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1220/2400] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:54:32.136213 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8d761-ad70-4c1a-b7bc-53ca3b91d825 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:32.150698 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a8d761-ad70-4c1a-b7bc-53ca3b91d825 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:32.156057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fd391-7354-4983-afdf-87446fc8abd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:32.157050 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fd391-7354-4983-afdf-87446fc8abd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:32.157382 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fd391-7354-4983-afdf-87446fc8abd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:32.157714 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fd391-7354-4983-afdf-87446fc8abd3 admin admin] PATH_INFO: `/v3/projects/5e8e5da108f24ed3b3955c8a12bdf580/users/de624ce35a9b4c2b8b0ac5301c54f799/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:32.175611 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fd391-7354-4983-afdf-87446fc8abd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e8e5da108f24ed3b3955c8a12bdf580, user_id=de624ce35a9b4c2b8b0ac5301c54f799, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:32.178880 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fd391-7354-4983-afdf-87446fc8abd3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:32.193947 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1181/2401] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:54:32 2022] PUT /identity/v3/projects/5e8e5da108f24ed3b3955c8a12bdf580/users/de624ce35a9b4c2b8b0ac5301c54f799/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:54:32.198999 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc5054-5d61-4407-a622-a061140b5744 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:32.199526 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc5054-5d61-4407-a622-a061140b5744 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:32.199645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc5054-5d61-4407-a622-a061140b5744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:32.219776 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-fabc5054-5d61-4407-a622-a061140b5744 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:32.221188 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-fabc5054-5d61-4407-a622-a061140b5744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:32.290966 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1221/2402] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:54:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:32.303812 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fd391-7354-4983-afdf-87446fc8abd3 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:32.306142 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-504fd391-7354-4983-afdf-87446fc8abd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:32.373222 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fd391-7354-4983-afdf-87446fc8abd3 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:32.377646 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed8eb4-aea3-441c-b827-5d32a12d0660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:32.378299 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed8eb4-aea3-441c-b827-5d32a12d0660 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:32.378791 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed8eb4-aea3-441c-b827-5d32a12d0660 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:32.379194 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed8eb4-aea3-441c-b827-5d32a12d0660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:32.389438 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed8eb4-aea3-441c-b827-5d32a12d0660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:32.390899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed8eb4-aea3-441c-b827-5d32a12d0660 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:32.400981 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1182/2403] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:54:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:54:35.473226 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec54348-94a6-4010-bcc1-a8f2c6294130 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:35.473743 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec54348-94a6-4010-bcc1-a8f2c6294130 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:35.473839 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec54348-94a6-4010-bcc1-a8f2c6294130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:35.495266 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-5ec54348-94a6-4010-bcc1-a8f2c6294130 None None] MFA Rules not processed for user `e0653575c0a24603bb9287e6222313de`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:35.496516 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-5ec54348-94a6-4010-bcc1-a8f2c6294130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:35.562698 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1222/2404] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Apr 11 16:54:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:35.576551 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed8eb4-aea3-441c-b827-5d32a12d0660 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:35.578583 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f8ed8eb4-aea3-441c-b827-5d32a12d0660 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:35.654263 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed8eb4-aea3-441c-b827-5d32a12d0660 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:35.659761 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b79f4-6c90-423b-af6f-4c949a8e29c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6659c6661840a79ba9ff1c3c9e93c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:35.660593 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b79f4-6c90-423b-af6f-4c949a8e29c8 service swift] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:35.661205 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b79f4-6c90-423b-af6f-4c949a8e29c8 service swift] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:35.662053 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b79f4-6c90-423b-af6f-4c949a8e29c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:35.671466 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b79f4-6c90-423b-af6f-4c949a8e29c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:35.672745 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b79f4-6c90-423b-af6f-4c949a8e29c8 service swift] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:35.685008 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1183/2405] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Apr 11 16:54:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 11 16:54:39.228054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80204395-969c-49cf-808a-e05ba26037e1 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:39.229405 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80204395-969c-49cf-808a-e05ba26037e1 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:39.229930 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80204395-969c-49cf-808a-e05ba26037e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:39.284148 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-80204395-969c-49cf-808a-e05ba26037e1 None None] MFA Rules not processed for user `de624ce35a9b4c2b8b0ac5301c54f799`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:39.285752 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-80204395-969c-49cf-808a-e05ba26037e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:39.420891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1223/2406] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:54:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:39.432973 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b79f4-6c90-423b-af6f-4c949a8e29c8 service swift] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:39.452021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b79f4-6c90-423b-af6f-4c949a8e29c8 service swift] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:39.461020 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0294e23-8114-4181-b560-e54918645bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:39.462002 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0294e23-8114-4181-b560-e54918645bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:39.462453 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0294e23-8114-4181-b560-e54918645bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:39.462965 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0294e23-8114-4181-b560-e54918645bc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:39.463877 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0294e23-8114-4181-b560-e54918645bc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:39.466154 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0294e23-8114-4181-b560-e54918645bc0 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:39.526613 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1184/2407] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:54:39 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:54:39.530194 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80204395-969c-49cf-808a-e05ba26037e1 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:39.547032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80204395-969c-49cf-808a-e05ba26037e1 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:39.644693 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae9c6b-a3f4-42c4-8142-d02459b762b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:39.645904 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae9c6b-a3f4-42c4-8142-d02459b762b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:39.646282 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae9c6b-a3f4-42c4-8142-d02459b762b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:39.646718 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae9c6b-a3f4-42c4-8142-d02459b762b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:39.647518 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae9c6b-a3f4-42c4-8142-d02459b762b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:39.650276 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae9c6b-a3f4-42c4-8142-d02459b762b8 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:39.683091 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1224/2408] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:54:39 2022] POST /identity/v3/users => generated 294 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:54:39.687208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0294e23-8114-4181-b560-e54918645bc0 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:39.699141 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0294e23-8114-4181-b560-e54918645bc0 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:39.704132 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374c0dd-d410-4057-8f57-a96e649738a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:39.704869 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374c0dd-d410-4057-8f57-a96e649738a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:39.705151 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374c0dd-d410-4057-8f57-a96e649738a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:39.705428 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374c0dd-d410-4057-8f57-a96e649738a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:39.706312 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374c0dd-d410-4057-8f57-a96e649738a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:39.707984 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374c0dd-d410-4057-8f57-a96e649738a2 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:39.721526 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1185/2409] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:54:39.725471 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae9c6b-a3f4-42c4-8142-d02459b762b8 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:39.737582 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae9c6b-a3f4-42c4-8142-d02459b762b8 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:39.743583 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe3f7e-62ac-44ee-8ee5-95571d7fdb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:39.744672 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe3f7e-62ac-44ee-8ee5-95571d7fdb75 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:39.745070 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe3f7e-62ac-44ee-8ee5-95571d7fdb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:39.745530 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe3f7e-62ac-44ee-8ee5-95571d7fdb75 admin admin] PATH_INFO: `/v3/projects/22b135fb155e41d7895fbbca0d9864b5/users/5a4db63f5fc4457bab3c53ddc94a17b2/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:39.783748 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe3f7e-62ac-44ee-8ee5-95571d7fdb75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b135fb155e41d7895fbbca0d9864b5, user_id=5a4db63f5fc4457bab3c53ddc94a17b2, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:39.793450 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe3f7e-62ac-44ee-8ee5-95571d7fdb75 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:39.810084 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1225/2410] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:54:39 2022] PUT /identity/v3/projects/22b135fb155e41d7895fbbca0d9864b5/users/5a4db63f5fc4457bab3c53ddc94a17b2/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:54:39.814077 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374c0dd-d410-4057-8f57-a96e649738a2 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:39.833924 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374c0dd-d410-4057-8f57-a96e649738a2 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:39.923770 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a24e9a-b346-412c-a535-1f50347e4b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:39.924522 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a24e9a-b346-412c-a535-1f50347e4b2e admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:39.924883 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a24e9a-b346-412c-a535-1f50347e4b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:39.925162 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a24e9a-b346-412c-a535-1f50347e4b2e admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:39.925972 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a24e9a-b346-412c-a535-1f50347e4b2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:39.927907 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a24e9a-b346-412c-a535-1f50347e4b2e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:39.939406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1186/2411] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:54:39 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:54:39.943823 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe3f7e-62ac-44ee-8ee5-95571d7fdb75 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:39.956297 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe3f7e-62ac-44ee-8ee5-95571d7fdb75 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:39.962012 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b4dc5-e058-445e-aeb9-d3490691fa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:39.962987 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b4dc5-e058-445e-aeb9-d3490691fa2b admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:39.963284 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b4dc5-e058-445e-aeb9-d3490691fa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:39.963572 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b4dc5-e058-445e-aeb9-d3490691fa2b admin admin] PATH_INFO: `/v3/projects/22b135fb155e41d7895fbbca0d9864b5/users/5a4db63f5fc4457bab3c53ddc94a17b2/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:39.970013 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b4dc5-e058-445e-aeb9-d3490691fa2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22b135fb155e41d7895fbbca0d9864b5, user_id=5a4db63f5fc4457bab3c53ddc94a17b2, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:39.973127 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b4dc5-e058-445e-aeb9-d3490691fa2b admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:39.989703 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1226/2412] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:54:39 2022] PUT /identity/v3/projects/22b135fb155e41d7895fbbca0d9864b5/users/5a4db63f5fc4457bab3c53ddc94a17b2/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:54:47.354790 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbaa093-c33d-49ac-8c05-8139e49a5abb None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:47.355396 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbaa093-c33d-49ac-8c05-8139e49a5abb None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:47.355396 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbaa093-c33d-49ac-8c05-8139e49a5abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:47.384559 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-abbaa093-c33d-49ac-8c05-8139e49a5abb None None] MFA Rules not processed for user `5a4db63f5fc4457bab3c53ddc94a17b2`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:47.385831 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-abbaa093-c33d-49ac-8c05-8139e49a5abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:47.452700 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1187/2413] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:54:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:47.463463 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b4dc5-e058-445e-aeb9-d3490691fa2b admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:47.465124 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-c74b4dc5-e058-445e-aeb9-d3490691fa2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:47.537563 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b4dc5-e058-445e-aeb9-d3490691fa2b admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:47.543954 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94a2e0-bb31-4392-82d5-ce9f88b7e6c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:47.544643 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94a2e0-bb31-4392-82d5-ce9f88b7e6c8 service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:47.544869 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94a2e0-bb31-4392-82d5-ce9f88b7e6c8 service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:47.545139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94a2e0-bb31-4392-82d5-ce9f88b7e6c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:47.600141 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94a2e0-bb31-4392-82d5-ce9f88b7e6c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:47.602422 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94a2e0-bb31-4392-82d5-ce9f88b7e6c8 service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:47.611595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1227/2414] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:54:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:54:54.579355 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5d7c9-2440-4e7b-b089-f9e1caa7f463 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:54.580203 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5d7c9-2440-4e7b-b089-f9e1caa7f463 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:54.580203 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b5d7c9-2440-4e7b-b089-f9e1caa7f463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:54.597410 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b7b5d7c9-2440-4e7b-b089-f9e1caa7f463 None None] MFA Rules not processed for user `9924b7b7dd6448d78bc9d166a2b51927`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:54.598627 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b7b5d7c9-2440-4e7b-b089-f9e1caa7f463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:54.652867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1188/2415] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:54:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:54:58.952218 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b7a8-e37e-4e60-b8fc-e837fac880f6 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:58.952647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b7a8-e37e-4e60-b8fc-e837fac880f6 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:58.952781 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9b7a8-e37e-4e60-b8fc-e837fac880f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:58.972655 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-3ef9b7a8-e37e-4e60-b8fc-e837fac880f6 None None] MFA Rules not processed for user `e0653575c0a24603bb9287e6222313de`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:54:58.973874 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3ef9b7a8-e37e-4e60-b8fc-e837fac880f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:54:59.038173 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1228/2416] 10.222.0.73 () {58 vars in 967 bytes} [Mon Apr 11 16:54:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:54:59.050893 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5d7c9-2440-4e7b-b089-f9e1caa7f463 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:54:59.119793 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b5d7c9-2440-4e7b-b089-f9e1caa7f463 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:54:59.124898 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6032b6b-be35-4973-bb64-5c814cc8757c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6659c6661840a79ba9ff1c3c9e93c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:54:59.125669 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6032b6b-be35-4973-bb64-5c814cc8757c service swift] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:54:59.125951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6032b6b-be35-4973-bb64-5c814cc8757c service swift] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:54:59.126225 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6032b6b-be35-4973-bb64-5c814cc8757c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:54:59.135475 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6032b6b-be35-4973-bb64-5c814cc8757c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:54:59.137057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6032b6b-be35-4973-bb64-5c814cc8757c service swift] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:54:59.145109 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1189/2417] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Apr 11 16:54:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:55:05.616050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a67836-009a-400e-8772-1d37032815bc None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:05.616542 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a67836-009a-400e-8772-1d37032815bc None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:05.616639 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a67836-009a-400e-8772-1d37032815bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:05.634161 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-12a67836-009a-400e-8772-1d37032815bc None None] MFA Rules not processed for user `de624ce35a9b4c2b8b0ac5301c54f799`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:55:05.635350 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-12a67836-009a-400e-8772-1d37032815bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:05.641932 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1229/2418] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:55:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:55:22.791201 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6032b6b-be35-4973-bb64-5c814cc8757c service swift] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:22.844424 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6032b6b-be35-4973-bb64-5c814cc8757c service swift] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:22.847931 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad07a2c-3414-420c-9f50-ce8d937285ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:22.848557 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad07a2c-3414-420c-9f50-ce8d937285ee service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:22.848834 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad07a2c-3414-420c-9f50-ce8d937285ee service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:22.849104 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad07a2c-3414-420c-9f50-ce8d937285ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:22.857750 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad07a2c-3414-420c-9f50-ce8d937285ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:22.859189 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad07a2c-3414-420c-9f50-ce8d937285ee service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:22.868708 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1190/2419] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:55:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:55:46.496437 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a67836-009a-400e-8772-1d37032815bc None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:46.497892 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-12a67836-009a-400e-8772-1d37032815bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:46.509564 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a67836-009a-400e-8772-1d37032815bc None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:46.513610 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60629b-e4ef-4686-8323-f09928a14187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:46.514241 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60629b-e4ef-4686-8323-f09928a14187 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:46.514519 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60629b-e4ef-4686-8323-f09928a14187 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:46.514820 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f60629b-e4ef-4686-8323-f09928a14187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:46.516485 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-2f60629b-e4ef-4686-8323-f09928a14187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:46.528892 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60629b-e4ef-4686-8323-f09928a14187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:46.530302 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f60629b-e4ef-4686-8323-f09928a14187 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:46.540665 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1230/2420] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:55:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:55:47.285899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad07a2c-3414-420c-9f50-ce8d937285ee service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:47.287405 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-cad07a2c-3414-420c-9f50-ce8d937285ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:47.341992 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad07a2c-3414-420c-9f50-ce8d937285ee service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:47.345678 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09760a2-ab76-4a0c-b738-76a5e2fa9f2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:47.346384 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09760a2-ab76-4a0c-b738-76a5e2fa9f2e service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:47.346770 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09760a2-ab76-4a0c-b738-76a5e2fa9f2e service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:47.347076 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09760a2-ab76-4a0c-b738-76a5e2fa9f2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:47.349111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a09760a2-ab76-4a0c-b738-76a5e2fa9f2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:47.363084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09760a2-ab76-4a0c-b738-76a5e2fa9f2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:47.364501 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09760a2-ab76-4a0c-b738-76a5e2fa9f2e service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:47.385170 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1191/2421] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:55:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:55:54.608292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60629b-e4ef-4686-8323-f09928a14187 service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:54.619302 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f60629b-e4ef-4686-8323-f09928a14187 service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:54.624732 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9f78e-4f44-47fb-94cc-d8c9b30bf2a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:54.625359 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9f78e-4f44-47fb-94cc-d8c9b30bf2a1 service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:54.625638 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9f78e-4f44-47fb-94cc-d8c9b30bf2a1 service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:54.625911 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9f78e-4f44-47fb-94cc-d8c9b30bf2a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:54.627730 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-fce9f78e-4f44-47fb-94cc-d8c9b30bf2a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:54.638259 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9f78e-4f44-47fb-94cc-d8c9b30bf2a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:54.639888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9f78e-4f44-47fb-94cc-d8c9b30bf2a1 service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:54.649014 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1231/2422] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:55:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:55:55.820198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09760a2-ab76-4a0c-b738-76a5e2fa9f2e service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:55:55.821604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a09760a2-ab76-4a0c-b738-76a5e2fa9f2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:55.835609 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09760a2-ab76-4a0c-b738-76a5e2fa9f2e service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:55:55.841522 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13186e-d703-447f-ac1a-7b86676e027a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:55:55.841763 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13186e-d703-447f-ac1a-7b86676e027a service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:55:55.841995 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13186e-d703-447f-ac1a-7b86676e027a service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:55:55.842269 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13186e-d703-447f-ac1a-7b86676e027a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:55:55.844056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bc13186e-d703-447f-ac1a-7b86676e027a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:55:55.901420 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13186e-d703-447f-ac1a-7b86676e027a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:55:55.903586 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc13186e-d703-447f-ac1a-7b86676e027a service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:55:55.913330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1192/2423] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:55:55 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:56:04.192570 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfc769-4c51-40c6-ad95-e2df33427b52 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:04.193155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfc769-4c51-40c6-ad95-e2df33427b52 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:04.193441 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bfc769-4c51-40c6-ad95-e2df33427b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:04.212338 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-41bfc769-4c51-40c6-ad95-e2df33427b52 None None] MFA Rules not processed for user `8ff2ac0b68d1414fb72955edc07ee3fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:56:04.213641 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-41bfc769-4c51-40c6-ad95-e2df33427b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:04.221205 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1232/2424] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:56:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:56:04.529366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13186e-d703-447f-ac1a-7b86676e027a service nova] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:04.539040 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13186e-d703-447f-ac1a-7b86676e027a service nova] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:04.543479 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ec958-c40e-4c9f-8eb6-154bac2515c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:04.544121 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ec958-c40e-4c9f-8eb6-154bac2515c6 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:04.544399 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ec958-c40e-4c9f-8eb6-154bac2515c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:04.544670 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ec958-c40e-4c9f-8eb6-154bac2515c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:04.546429 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-810ec958-c40e-4c9f-8eb6-154bac2515c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:04.556632 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ec958-c40e-4c9f-8eb6-154bac2515c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:04.558794 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ec958-c40e-4c9f-8eb6-154bac2515c6 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:04.566965 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1193/2425] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:56:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:56:04.882542 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfc769-4c51-40c6-ad95-e2df33427b52 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:04.883937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-41bfc769-4c51-40c6-ad95-e2df33427b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:04.981247 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bfc769-4c51-40c6-ad95-e2df33427b52 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:04.987629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856c1a4-90dd-413b-a397-9175cb2fca3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f5ef8708f54401af7e8defa8d13141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:04.988416 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856c1a4-90dd-413b-a397-9175cb2fca3f service placement] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:04.988799 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856c1a4-90dd-413b-a397-9175cb2fca3f service placement] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:04.989142 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856c1a4-90dd-413b-a397-9175cb2fca3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:04.991612 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9856c1a4-90dd-413b-a397-9175cb2fca3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:05.006708 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856c1a4-90dd-413b-a397-9175cb2fca3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:05.007943 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856c1a4-90dd-413b-a397-9175cb2fca3f service placement] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:05.018541 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1233/2426] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:56:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:56:05.723627 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358586e5-ea92-451d-b211-c7088509fae8 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:05.724119 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358586e5-ea92-451d-b211-c7088509fae8 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:05.724229 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358586e5-ea92-451d-b211-c7088509fae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:05.741279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-358586e5-ea92-451d-b211-c7088509fae8 None None] MFA Rules not processed for user `49a2fa85335f47a9adc74656ee1609ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:56:05.742450 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-358586e5-ea92-451d-b211-c7088509fae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:05.794708 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1194/2427] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:56:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:56:13.290824 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856c1a4-90dd-413b-a397-9175cb2fca3f service placement] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:13.295526 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358586e5-ea92-451d-b211-c7088509fae8 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:13.300824 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856c1a4-90dd-413b-a397-9175cb2fca3f service placement] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:13.304568 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ee65a-4d33-410a-97cb-d261e827e009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:13.305214 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ee65a-4d33-410a-97cb-d261e827e009 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:13.305499 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ee65a-4d33-410a-97cb-d261e827e009 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:13.305777 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ee65a-4d33-410a-97cb-d261e827e009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:13.305887 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358586e5-ea92-451d-b211-c7088509fae8 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:13.307778 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d17ee65a-4d33-410a-97cb-d261e827e009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:13.309597 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ec27e-3b6d-4cf0-b8fc-ba7916193926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:13.310171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ec27e-3b6d-4cf0-b8fc-ba7916193926 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:13.310383 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ec27e-3b6d-4cf0-b8fc-ba7916193926 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:13.310689 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ec27e-3b6d-4cf0-b8fc-ba7916193926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:13.317638 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ee65a-4d33-410a-97cb-d261e827e009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:13.318223 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ec27e-3b6d-4cf0-b8fc-ba7916193926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:13.319110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17ee65a-4d33-410a-97cb-d261e827e009 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:13.319662 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ec27e-3b6d-4cf0-b8fc-ba7916193926 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:13.327099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1234/2428] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:56:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:56:13.327469 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1195/2429] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:56:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:56:14.754346 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ee65a-4d33-410a-97cb-d261e827e009 service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:14.775835 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17ee65a-4d33-410a-97cb-d261e827e009 service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:14.793111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54089bd-bd52-47ff-bf16-c939759f84bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:14.795106 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54089bd-bd52-47ff-bf16-c939759f84bb service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:14.795736 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54089bd-bd52-47ff-bf16-c939759f84bb service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:14.797296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54089bd-bd52-47ff-bf16-c939759f84bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:14.800276 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-e54089bd-bd52-47ff-bf16-c939759f84bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:14.819666 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54089bd-bd52-47ff-bf16-c939759f84bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:14.821270 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54089bd-bd52-47ff-bf16-c939759f84bb service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:14.833409 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1235/2430] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:56:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:56:15.753111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ec27e-3b6d-4cf0-b8fc-ba7916193926 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:15.762435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ec27e-3b6d-4cf0-b8fc-ba7916193926 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:15.766062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc59795-b968-4e34-9f03-f53bbaea5e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:15.766730 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc59795-b968-4e34-9f03-f53bbaea5e16 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:15.767009 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc59795-b968-4e34-9f03-f53bbaea5e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:15.767278 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc59795-b968-4e34-9f03-f53bbaea5e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:15.769036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3fc59795-b968-4e34-9f03-f53bbaea5e16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:15.832249 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc59795-b968-4e34-9f03-f53bbaea5e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:15.833692 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc59795-b968-4e34-9f03-f53bbaea5e16 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:15.843432 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1196/2431] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:56:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:56:20.047348 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54089bd-bd52-47ff-bf16-c939759f84bb service nova] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:20.050673 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-e54089bd-bd52-47ff-bf16-c939759f84bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:20.071183 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54089bd-bd52-47ff-bf16-c939759f84bb service nova] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:20.077480 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5aed06-05a0-443d-b1f1-712c381bbfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:20.078370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5aed06-05a0-443d-b1f1-712c381bbfb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:20.078712 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5aed06-05a0-443d-b1f1-712c381bbfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:20.078991 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5aed06-05a0-443d-b1f1-712c381bbfb9 admin admin] PATH_INFO: `/v3/users/9924b7b7dd6448d78bc9d166a2b51927` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:20.080329 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5aed06-05a0-443d-b1f1-712c381bbfb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9924b7b7dd6448d78bc9d166a2b51927)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:20.082257 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5aed06-05a0-443d-b1f1-712c381bbfb9 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:20.149710 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-2a5aed06-05a0-443d-b1f1-712c381bbfb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9924b7b7dd6448d78bc9d166a2b51927'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:56:20.150330 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-2a5aed06-05a0-443d-b1f1-712c381bbfb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9924b7b7dd6448d78bc9d166a2b51927'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:56:20.161341 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-2a5aed06-05a0-443d-b1f1-712c381bbfb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9924b7b7dd6448d78bc9d166a2b51927'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:56:20.169209 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-2a5aed06-05a0-443d-b1f1-712c381bbfb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9924b7b7dd6448d78bc9d166a2b51927'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:56:20.186193 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-2a5aed06-05a0-443d-b1f1-712c381bbfb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9924b7b7dd6448d78bc9d166a2b51927'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:56:20.196450 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1236/2432] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:56:20 2022] DELETE /identity/v3/users/9924b7b7dd6448d78bc9d166a2b51927 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:56:20.383383 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc59795-b968-4e34-9f03-f53bbaea5e16 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:20.393045 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc59795-b968-4e34-9f03-f53bbaea5e16 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:20.459054 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c64b1d-7ee6-45e2-bbbc-36bf8139a66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:20.459918 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c64b1d-7ee6-45e2-bbbc-36bf8139a66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:20.460192 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c64b1d-7ee6-45e2-bbbc-36bf8139a66d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:20.460734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c64b1d-7ee6-45e2-bbbc-36bf8139a66d admin admin] PATH_INFO: `/v3/projects/3a69ed2513084a06887269c7f55fa8ed` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:20.463150 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c64b1d-7ee6-45e2-bbbc-36bf8139a66d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a69ed2513084a06887269c7f55fa8ed)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:20.465238 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c64b1d-7ee6-45e2-bbbc-36bf8139a66d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:20.519163 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-25c64b1d-7ee6-45e2-bbbc-36bf8139a66d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a69ed2513084a06887269c7f55fa8ed', 'request_id': 'req-25c64b1d-7ee6-45e2-bbbc-36bf8139a66d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:56:20.524313 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-25c64b1d-7ee6-45e2-bbbc-36bf8139a66d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a69ed2513084a06887269c7f55fa8ed', 'request_id': 'req-25c64b1d-7ee6-45e2-bbbc-36bf8139a66d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:56:20.530919 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-25c64b1d-7ee6-45e2-bbbc-36bf8139a66d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a69ed2513084a06887269c7f55fa8ed', 'request_id': 'req-25c64b1d-7ee6-45e2-bbbc-36bf8139a66d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:56:20.546136 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-25c64b1d-7ee6-45e2-bbbc-36bf8139a66d admin admin] The token cache is being invalidate because project 3a69ed2513084a06887269c7f55fa8ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:56:20.546290 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-25c64b1d-7ee6-45e2-bbbc-36bf8139a66d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:56:20.546999 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-25c64b1d-7ee6-45e2-bbbc-36bf8139a66d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:56:20.548877 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1197/2433] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:56:20 2022] DELETE /identity/v3/projects/3a69ed2513084a06887269c7f55fa8ed => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:56:20.554381 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8020d9-2e0b-4e34-8794-3abd0507a208 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:20.554828 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8020d9-2e0b-4e34-8794-3abd0507a208 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:20.555217 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8020d9-2e0b-4e34-8794-3abd0507a208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:20.574484 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-cf8020d9-2e0b-4e34-8794-3abd0507a208 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:56:20.576020 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-cf8020d9-2e0b-4e34-8794-3abd0507a208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:20.636887 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1237/2434] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:56:20.644618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51961b17-bc34-4207-97b5-e7152aed4d59 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:20.644976 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51961b17-bc34-4207-97b5-e7152aed4d59 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:20.645318 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51961b17-bc34-4207-97b5-e7152aed4d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:20.663021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-51961b17-bc34-4207-97b5-e7152aed4d59 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:56:20.664124 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-51961b17-bc34-4207-97b5-e7152aed4d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:20.671937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1198/2435] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:56:20.676180 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8020d9-2e0b-4e34-8794-3abd0507a208 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:20.686332 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8020d9-2e0b-4e34-8794-3abd0507a208 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:20.692224 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c43a2-5417-4398-9aae-6a697fff5510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:20.692873 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c43a2-5417-4398-9aae-6a697fff5510 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:20.693155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c43a2-5417-4398-9aae-6a697fff5510 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:20.693432 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093c43a2-5417-4398-9aae-6a697fff5510 admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:20.694149 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c43a2-5417-4398-9aae-6a697fff5510 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:56:20.694456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c43a2-5417-4398-9aae-6a697fff5510 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:20.696090 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093c43a2-5417-4398-9aae-6a697fff5510 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:20.707891 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1238/2436] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:56:20.712112 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51961b17-bc34-4207-97b5-e7152aed4d59 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:20.721156 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51961b17-bc34-4207-97b5-e7152aed4d59 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:20.725757 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc4d87-ed5d-48f0-87c3-b0668179b7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:20.726392 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc4d87-ed5d-48f0-87c3-b0668179b7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:20.726714 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc4d87-ed5d-48f0-87c3-b0668179b7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:20.726993 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcc4d87-ed5d-48f0-87c3-b0668179b7a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:20.727676 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc4d87-ed5d-48f0-87c3-b0668179b7a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:20.729555 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcc4d87-ed5d-48f0-87c3-b0668179b7a0 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:20.754224 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1199/2437] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:56:20 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:56:20.758395 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c43a2-5417-4398-9aae-6a697fff5510 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:20.768600 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093c43a2-5417-4398-9aae-6a697fff5510 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:20.823781 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850198f8-b504-4ff2-b44f-c5a59f9096ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:20.824431 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850198f8-b504-4ff2-b44f-c5a59f9096ac admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:20.824709 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850198f8-b504-4ff2-b44f-c5a59f9096ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:20.824981 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850198f8-b504-4ff2-b44f-c5a59f9096ac admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:20.825663 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850198f8-b504-4ff2-b44f-c5a59f9096ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:20.827615 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850198f8-b504-4ff2-b44f-c5a59f9096ac admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:20.846057 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1239/2438] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:56:20 2022] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:56:20.849908 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc4d87-ed5d-48f0-87c3-b0668179b7a0 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:20.860204 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcc4d87-ed5d-48f0-87c3-b0668179b7a0 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:20.864826 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f2e56-649f-4410-a0d4-21c6b0d9c020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:20.865475 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f2e56-649f-4410-a0d4-21c6b0d9c020 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:20.865755 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f2e56-649f-4410-a0d4-21c6b0d9c020 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:20.866024 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f2e56-649f-4410-a0d4-21c6b0d9c020 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:20.866763 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f2e56-649f-4410-a0d4-21c6b0d9c020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:20.868341 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f2e56-649f-4410-a0d4-21c6b0d9c020 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:20.878906 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1200/2439] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:56:20.882887 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850198f8-b504-4ff2-b44f-c5a59f9096ac admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:20.892765 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850198f8-b504-4ff2-b44f-c5a59f9096ac admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:20.897227 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b7ed2-eea2-475f-bf17-669b0abd9352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:20.897868 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b7ed2-eea2-475f-bf17-669b0abd9352 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:20.898148 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b7ed2-eea2-475f-bf17-669b0abd9352 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:20.898423 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b7ed2-eea2-475f-bf17-669b0abd9352 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:20.899166 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b7ed2-eea2-475f-bf17-669b0abd9352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:20.900742 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b7ed2-eea2-475f-bf17-669b0abd9352 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:20.910926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1240/2440] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:56:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:56:20.915036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f2e56-649f-4410-a0d4-21c6b0d9c020 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:20.925160 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f2e56-649f-4410-a0d4-21c6b0d9c020 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:20.929671 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bd399-f3e4-47da-9287-60ed461dc95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:20.930533 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bd399-f3e4-47da-9287-60ed461dc95a admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:20.930845 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bd399-f3e4-47da-9287-60ed461dc95a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:20.931118 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310bd399-f3e4-47da-9287-60ed461dc95a admin admin] PATH_INFO: `/v3/projects/560e37bd1eae45cea00a7d544ad73cf0/users/cca858d4c5454a5ea7577b6f78b19d6c/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:20.945086 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bd399-f3e4-47da-9287-60ed461dc95a admin admin] RBAC: Authorizing `identity:create_grant(project_id=560e37bd1eae45cea00a7d544ad73cf0, user_id=cca858d4c5454a5ea7577b6f78b19d6c, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:20.948436 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310bd399-f3e4-47da-9287-60ed461dc95a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:20.960282 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1201/2441] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:56:20 2022] PUT /identity/v3/projects/560e37bd1eae45cea00a7d544ad73cf0/users/cca858d4c5454a5ea7577b6f78b19d6c/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:56:20.965974 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b92ca-c06e-4c03-bcd2-23e01897fe03 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:20.966256 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b92ca-c06e-4c03-bcd2-23e01897fe03 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:20.966557 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b92ca-c06e-4c03-bcd2-23e01897fe03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:20.983799 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-479b92ca-c06e-4c03-bcd2-23e01897fe03 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:56:20.984985 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-479b92ca-c06e-4c03-bcd2-23e01897fe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:21.041681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1241/2442] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:56:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:56:21.051337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bd399-f3e4-47da-9287-60ed461dc95a admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:21.052980 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-310bd399-f3e4-47da-9287-60ed461dc95a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:21.107857 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310bd399-f3e4-47da-9287-60ed461dc95a admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:21.111561 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14150d-49fc-4e73-b7c2-34249f208da1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:21.112200 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14150d-49fc-4e73-b7c2-34249f208da1 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:21.112481 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14150d-49fc-4e73-b7c2-34249f208da1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:21.112753 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14150d-49fc-4e73-b7c2-34249f208da1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:21.121808 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14150d-49fc-4e73-b7c2-34249f208da1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:21.123353 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14150d-49fc-4e73-b7c2-34249f208da1 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:21.133499 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1202/2443] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:56:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:56:25.997411 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80697560-c5d5-4ae8-b854-02666ee13520 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:25.999613 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80697560-c5d5-4ae8-b854-02666ee13520 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:26.000240 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80697560-c5d5-4ae8-b854-02666ee13520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:26.030005 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-80697560-c5d5-4ae8-b854-02666ee13520 None None] MFA Rules not processed for user `cca858d4c5454a5ea7577b6f78b19d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:56:26.031974 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-80697560-c5d5-4ae8-b854-02666ee13520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:26.129602 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1242/2444] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:56:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:56:26.140749 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14150d-49fc-4e73-b7c2-34249f208da1 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:26.142794 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6c14150d-49fc-4e73-b7c2-34249f208da1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:26.220587 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14150d-49fc-4e73-b7c2-34249f208da1 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:26.226942 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7fc51-928a-42af-acfc-b21ce75b5466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:26.227606 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7fc51-928a-42af-acfc-b21ce75b5466 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:26.227893 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7fc51-928a-42af-acfc-b21ce75b5466 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:26.228168 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7fc51-928a-42af-acfc-b21ce75b5466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:26.237868 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7fc51-928a-42af-acfc-b21ce75b5466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:26.239508 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7fc51-928a-42af-acfc-b21ce75b5466 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:26.250393 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1203/2445] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:56:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:56:28.279546 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cfc1d-7560-4bfd-94de-192d58cc8668 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:28.280114 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cfc1d-7560-4bfd-94de-192d58cc8668 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:28.280114 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0cfc1d-7560-4bfd-94de-192d58cc8668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:28.303896 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-be0cfc1d-7560-4bfd-94de-192d58cc8668 None None] MFA Rules not processed for user `cca858d4c5454a5ea7577b6f78b19d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:56:28.305407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-be0cfc1d-7560-4bfd-94de-192d58cc8668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:28.314857 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1243/2446] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:56:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:56:28.689529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7fc51-928a-42af-acfc-b21ce75b5466 service nova] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:28.699830 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7fc51-928a-42af-acfc-b21ce75b5466 service nova] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:28.703734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701e418-cd70-45c7-8c8a-698e69e3459c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:28.704387 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701e418-cd70-45c7-8c8a-698e69e3459c service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:28.704668 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701e418-cd70-45c7-8c8a-698e69e3459c service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:28.704946 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701e418-cd70-45c7-8c8a-698e69e3459c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:28.706924 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7701e418-cd70-45c7-8c8a-698e69e3459c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:28.722945 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701e418-cd70-45c7-8c8a-698e69e3459c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:28.724399 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701e418-cd70-45c7-8c8a-698e69e3459c service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:28.734977 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1204/2447] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:56:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:56:35.854845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cfc1d-7560-4bfd-94de-192d58cc8668 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:35.867790 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0cfc1d-7560-4bfd-94de-192d58cc8668 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:35.873229 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cafa28-aa51-478b-92da-a0856938223a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:35.873867 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cafa28-aa51-478b-92da-a0856938223a service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:35.874146 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cafa28-aa51-478b-92da-a0856938223a service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:35.874417 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cafa28-aa51-478b-92da-a0856938223a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:35.876177 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f5cafa28-aa51-478b-92da-a0856938223a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:35.888584 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cafa28-aa51-478b-92da-a0856938223a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:35.890174 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cafa28-aa51-478b-92da-a0856938223a service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:35.901312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1244/2448] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:56:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:56:39.473682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701e418-cd70-45c7-8c8a-698e69e3459c service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:56:39.475624 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7701e418-cd70-45c7-8c8a-698e69e3459c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:39.491618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701e418-cd70-45c7-8c8a-698e69e3459c service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:56:39.497912 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c472ee3-e6f5-4c36-9e6c-b116015295bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:56:39.498603 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c472ee3-e6f5-4c36-9e6c-b116015295bf service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:56:39.498917 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c472ee3-e6f5-4c36-9e6c-b116015295bf service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:56:39.499194 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c472ee3-e6f5-4c36-9e6c-b116015295bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:56:39.500969 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0c472ee3-e6f5-4c36-9e6c-b116015295bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:56:39.513950 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c472ee3-e6f5-4c36-9e6c-b116015295bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:56:39.515554 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c472ee3-e6f5-4c36-9e6c-b116015295bf service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:56:39.526095 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1205/2449] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:56:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:57:09.409503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cafa28-aa51-478b-92da-a0856938223a service nova] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:09.421125 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cafa28-aa51-478b-92da-a0856938223a service nova] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:09.426417 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9c684-3944-4c4e-8697-6249e6376056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:09.427126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9c684-3944-4c4e-8697-6249e6376056 service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:09.427401 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9c684-3944-4c4e-8697-6249e6376056 service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:09.427674 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9c684-3944-4c4e-8697-6249e6376056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:09.429360 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a2e9c684-3944-4c4e-8697-6249e6376056 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:09.484642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9c684-3944-4c4e-8697-6249e6376056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:09.486226 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9c684-3944-4c4e-8697-6249e6376056 service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:09.495039 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1245/2450] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:57:09 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:57:26.515996 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de5d4d-0955-428d-bf2e-274f08597040 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:26.516502 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de5d4d-0955-428d-bf2e-274f08597040 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:26.516849 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de5d4d-0955-428d-bf2e-274f08597040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:26.534827 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c7de5d4d-0955-428d-bf2e-274f08597040 None None] MFA Rules not processed for user `e0653575c0a24603bb9287e6222313de`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:26.536018 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c7de5d4d-0955-428d-bf2e-274f08597040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:26.592651 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1206/2451] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Apr 11 16:57:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:26.640263 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9c684-3944-4c4e-8697-6249e6376056 service nova] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:26.641757 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a2e9c684-3944-4c4e-8697-6249e6376056 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:26.715149 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9c684-3944-4c4e-8697-6249e6376056 service nova] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:26.720807 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e0e59-ea77-474a-84ae-416edc45c5c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6659c6661840a79ba9ff1c3c9e93c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:26.721430 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e0e59-ea77-474a-84ae-416edc45c5c0 service swift] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:26.721707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e0e59-ea77-474a-84ae-416edc45c5c0 service swift] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:26.722040 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e0e59-ea77-474a-84ae-416edc45c5c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:26.730072 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e0e59-ea77-474a-84ae-416edc45c5c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:26.731667 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e0e59-ea77-474a-84ae-416edc45c5c0 service swift] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:26.740148 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1246/2452] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Apr 11 16:57:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:57:32.725134 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de5d4d-0955-428d-bf2e-274f08597040 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:32.727230 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c7de5d4d-0955-428d-bf2e-274f08597040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:32.739827 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de5d4d-0955-428d-bf2e-274f08597040 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:32.743660 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e250fa6-2272-451b-a3a5-e1146db888dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:32.744572 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e250fa6-2272-451b-a3a5-e1146db888dd service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:32.745070 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e250fa6-2272-451b-a3a5-e1146db888dd service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:32.745583 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e250fa6-2272-451b-a3a5-e1146db888dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:32.748068 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0e250fa6-2272-451b-a3a5-e1146db888dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:32.763672 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e250fa6-2272-451b-a3a5-e1146db888dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:32.765113 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e250fa6-2272-451b-a3a5-e1146db888dd service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:32.779101 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1207/2453] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:57:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:57:36.814376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de6371-a494-4077-a33f-1c49f3bd7b5d None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:36.814968 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de6371-a494-4077-a33f-1c49f3bd7b5d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:36.814968 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de6371-a494-4077-a33f-1c49f3bd7b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:36.864056 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-88de6371-a494-4077-a33f-1c49f3bd7b5d None None] MFA Rules not processed for user `de624ce35a9b4c2b8b0ac5301c54f799`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:36.865333 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-88de6371-a494-4077-a33f-1c49f3bd7b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:37.051805 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1247/2454] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:37.574381 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74c92f-5e8a-4f7a-b6b5-200c4be730cb None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:37.575314 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74c92f-5e8a-4f7a-b6b5-200c4be730cb None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:37.575791 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f74c92f-5e8a-4f7a-b6b5-200c4be730cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:37.624929 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9f74c92f-5e8a-4f7a-b6b5-200c4be730cb None None] MFA Rules not processed for user `cca858d4c5454a5ea7577b6f78b19d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:37.626367 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9f74c92f-5e8a-4f7a-b6b5-200c4be730cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:37.641527 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1208/2455] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:38.957953 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de6371-a494-4077-a33f-1c49f3bd7b5d None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:38.960501 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-88de6371-a494-4077-a33f-1c49f3bd7b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:38.979611 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de6371-a494-4077-a33f-1c49f3bd7b5d None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:38.990651 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19163cae-5239-4bbe-b3af-fb8d65384756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:38.992398 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19163cae-5239-4bbe-b3af-fb8d65384756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:38.993324 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19163cae-5239-4bbe-b3af-fb8d65384756 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:38.993612 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19163cae-5239-4bbe-b3af-fb8d65384756 admin admin] PATH_INFO: `/v3/users/8ff2ac0b68d1414fb72955edc07ee3fd` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:38.994961 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19163cae-5239-4bbe-b3af-fb8d65384756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff2ac0b68d1414fb72955edc07ee3fd)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:39.001135 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19163cae-5239-4bbe-b3af-fb8d65384756 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:39.070262 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-19163cae-5239-4bbe-b3af-fb8d65384756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff2ac0b68d1414fb72955edc07ee3fd'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:39.071312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-19163cae-5239-4bbe-b3af-fb8d65384756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff2ac0b68d1414fb72955edc07ee3fd'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:39.079374 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-19163cae-5239-4bbe-b3af-fb8d65384756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff2ac0b68d1414fb72955edc07ee3fd'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:39.089176 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-19163cae-5239-4bbe-b3af-fb8d65384756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff2ac0b68d1414fb72955edc07ee3fd'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:39.103796 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-19163cae-5239-4bbe-b3af-fb8d65384756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff2ac0b68d1414fb72955edc07ee3fd'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:39.119247 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1248/2456] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:57:38 2022] DELETE /identity/v3/users/8ff2ac0b68d1414fb72955edc07ee3fd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:39.324576 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74c92f-5e8a-4f7a-b6b5-200c4be730cb None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:39.344676 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f74c92f-5e8a-4f7a-b6b5-200c4be730cb None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:39.460389 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231346a-cd4e-40fd-8716-bf9c74ee88dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:39.461698 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231346a-cd4e-40fd-8716-bf9c74ee88dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:39.461976 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231346a-cd4e-40fd-8716-bf9c74ee88dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:39.462475 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231346a-cd4e-40fd-8716-bf9c74ee88dc admin admin] PATH_INFO: `/v3/projects/28c4fb270b99427b9fb085597e134917` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:39.463880 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231346a-cd4e-40fd-8716-bf9c74ee88dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=28c4fb270b99427b9fb085597e134917)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:39.466691 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231346a-cd4e-40fd-8716-bf9c74ee88dc admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:39.515447 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a231346a-cd4e-40fd-8716-bf9c74ee88dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28c4fb270b99427b9fb085597e134917', 'request_id': 'req-a231346a-cd4e-40fd-8716-bf9c74ee88dc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:39.521053 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a231346a-cd4e-40fd-8716-bf9c74ee88dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28c4fb270b99427b9fb085597e134917', 'request_id': 'req-a231346a-cd4e-40fd-8716-bf9c74ee88dc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:39.529954 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a231346a-cd4e-40fd-8716-bf9c74ee88dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28c4fb270b99427b9fb085597e134917', 'request_id': 'req-a231346a-cd4e-40fd-8716-bf9c74ee88dc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:39.541924 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a231346a-cd4e-40fd-8716-bf9c74ee88dc admin admin] The token cache is being invalidate because project 28c4fb270b99427b9fb085597e134917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:57:39.542208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a231346a-cd4e-40fd-8716-bf9c74ee88dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:39.542840 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a231346a-cd4e-40fd-8716-bf9c74ee88dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:39.544959 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1209/2457] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:57:39 2022] DELETE /identity/v3/projects/28c4fb270b99427b9fb085597e134917 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:39.549933 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f208896-4c23-4761-8a9a-e156f536891b None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:39.550222 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f208896-4c23-4761-8a9a-e156f536891b None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:39.550501 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f208896-4c23-4761-8a9a-e156f536891b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:39.569813 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-3f208896-4c23-4761-8a9a-e156f536891b None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:39.571150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3f208896-4c23-4761-8a9a-e156f536891b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:39.628191 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1249/2458] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:39.636092 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed891f65-69b4-4ac1-96e5-64fa31bd8de8 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:39.636452 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed891f65-69b4-4ac1-96e5-64fa31bd8de8 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:39.636799 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed891f65-69b4-4ac1-96e5-64fa31bd8de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:39.656281 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ed891f65-69b4-4ac1-96e5-64fa31bd8de8 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:39.657580 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ed891f65-69b4-4ac1-96e5-64fa31bd8de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:39.665825 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1210/2459] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:39.670216 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f208896-4c23-4761-8a9a-e156f536891b None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:39.679791 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f208896-4c23-4761-8a9a-e156f536891b None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:39.684441 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2ef0d-09b5-48f6-a4ca-df9af9415d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:39.685090 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2ef0d-09b5-48f6-a4ca-df9af9415d13 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:39.685364 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2ef0d-09b5-48f6-a4ca-df9af9415d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:39.685632 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2ef0d-09b5-48f6-a4ca-df9af9415d13 admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:39.686340 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2ef0d-09b5-48f6-a4ca-df9af9415d13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:57:39.686668 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2ef0d-09b5-48f6-a4ca-df9af9415d13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:39.688260 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a2ef0d-09b5-48f6-a4ca-df9af9415d13 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:39.700327 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1250/2460] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:57:39.705237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed891f65-69b4-4ac1-96e5-64fa31bd8de8 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:39.715085 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed891f65-69b4-4ac1-96e5-64fa31bd8de8 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:39.720309 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09bd78-46ff-4b01-9903-e2778cea9d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:39.720968 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09bd78-46ff-4b01-9903-e2778cea9d89 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:39.721246 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09bd78-46ff-4b01-9903-e2778cea9d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:39.721516 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09bd78-46ff-4b01-9903-e2778cea9d89 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:39.722204 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09bd78-46ff-4b01-9903-e2778cea9d89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:39.724148 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09bd78-46ff-4b01-9903-e2778cea9d89 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:39.761118 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1211/2461] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:57:39 2022] POST /identity/v3/projects => generated 405 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:57:39.765243 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2ef0d-09b5-48f6-a4ca-df9af9415d13 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:39.775296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a2ef0d-09b5-48f6-a4ca-df9af9415d13 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:39.828865 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fbe45-94dd-47c6-861b-717ab653590f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:39.829533 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fbe45-94dd-47c6-861b-717ab653590f admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:39.829813 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fbe45-94dd-47c6-861b-717ab653590f admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:39.830089 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fbe45-94dd-47c6-861b-717ab653590f admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:39.830813 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fbe45-94dd-47c6-861b-717ab653590f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:39.832833 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fbe45-94dd-47c6-861b-717ab653590f admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:39.857268 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1251/2462] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:57:39 2022] POST /identity/v3/users => generated 303 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:57:39.858441 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09bd78-46ff-4b01-9903-e2778cea9d89 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:39.868634 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09bd78-46ff-4b01-9903-e2778cea9d89 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:39.875086 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed29a3-2ec2-427d-a185-4756e2f89ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:39.875750 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed29a3-2ec2-427d-a185-4756e2f89ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:39.876037 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed29a3-2ec2-427d-a185-4756e2f89ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:39.876317 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed29a3-2ec2-427d-a185-4756e2f89ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:39.877043 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed29a3-2ec2-427d-a185-4756e2f89ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:39.878667 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed29a3-2ec2-427d-a185-4756e2f89ff0 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:39.889449 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1212/2463] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:57:39.893871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fbe45-94dd-47c6-861b-717ab653590f admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:39.906007 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fbe45-94dd-47c6-861b-717ab653590f admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:39.911169 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b4247-6255-4151-9af7-e267969a0361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:39.911827 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b4247-6255-4151-9af7-e267969a0361 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:39.912106 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b4247-6255-4151-9af7-e267969a0361 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:39.912378 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b4247-6255-4151-9af7-e267969a0361 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:39.913093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b4247-6255-4151-9af7-e267969a0361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:39.914868 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b4247-6255-4151-9af7-e267969a0361 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:39.924938 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1252/2464] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:57:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:57:39.929001 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed29a3-2ec2-427d-a185-4756e2f89ff0 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:39.939012 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed29a3-2ec2-427d-a185-4756e2f89ff0 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:39.943637 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1d5d0-5bf7-4352-ac3a-ecc2598787a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:39.944512 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1d5d0-5bf7-4352-ac3a-ecc2598787a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:39.944796 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1d5d0-5bf7-4352-ac3a-ecc2598787a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:39.945072 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1d5d0-5bf7-4352-ac3a-ecc2598787a5 admin admin] PATH_INFO: `/v3/projects/6373f0fa961345f986cd9c919dbb9ee4/users/9d77bfba6c534e619a313faeeddc2b50/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:39.960052 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1d5d0-5bf7-4352-ac3a-ecc2598787a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6373f0fa961345f986cd9c919dbb9ee4, user_id=9d77bfba6c534e619a313faeeddc2b50, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:39.962714 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1d5d0-5bf7-4352-ac3a-ecc2598787a5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:39.975570 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1213/2465] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:57:39 2022] PUT /identity/v3/projects/6373f0fa961345f986cd9c919dbb9ee4/users/9d77bfba6c534e619a313faeeddc2b50/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:39.980534 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa49674-03b7-4ef4-903b-7d65953216d4 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:39.981010 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa49674-03b7-4ef4-903b-7d65953216d4 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:39.981154 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa49674-03b7-4ef4-903b-7d65953216d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:39.999747 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-efa49674-03b7-4ef4-903b-7d65953216d4 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:40.001066 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-efa49674-03b7-4ef4-903b-7d65953216d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:40.057695 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1253/2466] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:40.068235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1d5d0-5bf7-4352-ac3a-ecc2598787a5 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:40.069954 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-91c1d5d0-5bf7-4352-ac3a-ecc2598787a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:40.131093 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1d5d0-5bf7-4352-ac3a-ecc2598787a5 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:40.134778 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4e98b-9ec8-4de1-8dd9-231b90d6ff08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:40.135450 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4e98b-9ec8-4de1-8dd9-231b90d6ff08 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:40.135731 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4e98b-9ec8-4de1-8dd9-231b90d6ff08 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:40.136009 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4e98b-9ec8-4de1-8dd9-231b90d6ff08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:40.145166 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4e98b-9ec8-4de1-8dd9-231b90d6ff08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:40.146577 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a4e98b-9ec8-4de1-8dd9-231b90d6ff08 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:40.156517 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1214/2467] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:57:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:57:40.766415 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a03715-4232-4aa6-9cbe-e908b970a7ca None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:40.766843 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a03715-4232-4aa6-9cbe-e908b970a7ca None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:40.767241 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a03715-4232-4aa6-9cbe-e908b970a7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:40.799679 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-75a03715-4232-4aa6-9cbe-e908b970a7ca None None] MFA Rules not processed for user `9d77bfba6c534e619a313faeeddc2b50`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:40.800988 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-75a03715-4232-4aa6-9cbe-e908b970a7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:40.867103 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1254/2468] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:40 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:40.871518 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4e98b-9ec8-4de1-8dd9-231b90d6ff08 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:40.881634 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4e98b-9ec8-4de1-8dd9-231b90d6ff08 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:40.886271 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d579c6-dd57-4ccc-9b08-42af98660344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:40.886951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d579c6-dd57-4ccc-9b08-42af98660344 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:40.887248 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d579c6-dd57-4ccc-9b08-42af98660344 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:40.887544 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d579c6-dd57-4ccc-9b08-42af98660344 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:40.888222 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d579c6-dd57-4ccc-9b08-42af98660344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:40.890104 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d579c6-dd57-4ccc-9b08-42af98660344 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:40.916234 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1215/2469] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:57:40 2022] POST /identity/v3/projects => generated 403 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:57:40.921215 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a03715-4232-4aa6-9cbe-e908b970a7ca None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:40.935041 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a03715-4232-4aa6-9cbe-e908b970a7ca None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:41.001758 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a39067-2b84-4790-a0b1-577738601079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:41.002538 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a39067-2b84-4790-a0b1-577738601079 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:41.002918 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a39067-2b84-4790-a0b1-577738601079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:41.003375 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a39067-2b84-4790-a0b1-577738601079 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:41.004399 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a39067-2b84-4790-a0b1-577738601079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:41.006547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a39067-2b84-4790-a0b1-577738601079 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:41.028626 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1255/2470] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:57:40 2022] POST /identity/v3/users => generated 308 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:57:41.031814 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d579c6-dd57-4ccc-9b08-42af98660344 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:41.042230 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d579c6-dd57-4ccc-9b08-42af98660344 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:41.047143 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b128b9-2d45-4e63-84ee-26ec8be2f015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:41.047788 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b128b9-2d45-4e63-84ee-26ec8be2f015 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:41.048068 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b128b9-2d45-4e63-84ee-26ec8be2f015 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:41.048346 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b128b9-2d45-4e63-84ee-26ec8be2f015 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:41.049061 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b128b9-2d45-4e63-84ee-26ec8be2f015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:41.050869 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b128b9-2d45-4e63-84ee-26ec8be2f015 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:41.060894 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1216/2471] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:57:41.065059 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a39067-2b84-4790-a0b1-577738601079 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:41.074719 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a39067-2b84-4790-a0b1-577738601079 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:41.079694 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adf921-6a50-4f2f-82ca-5144b934f257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:41.080554 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adf921-6a50-4f2f-82ca-5144b934f257 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:41.080833 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adf921-6a50-4f2f-82ca-5144b934f257 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:41.081102 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1adf921-6a50-4f2f-82ca-5144b934f257 admin admin] PATH_INFO: `/v3/projects/8e7991d9a787467eb0c89417eecb3cec/users/83961be6d8cb4f439a444dbcd0b8d131/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:41.095640 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adf921-6a50-4f2f-82ca-5144b934f257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7991d9a787467eb0c89417eecb3cec, user_id=83961be6d8cb4f439a444dbcd0b8d131, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:41.098249 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1adf921-6a50-4f2f-82ca-5144b934f257 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:41.110976 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1256/2472] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:57:41 2022] PUT /identity/v3/projects/8e7991d9a787467eb0c89417eecb3cec/users/83961be6d8cb4f439a444dbcd0b8d131/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:57:41.115113 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b128b9-2d45-4e63-84ee-26ec8be2f015 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:41.124782 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b128b9-2d45-4e63-84ee-26ec8be2f015 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:41.178439 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13defb8-227d-40b9-88f3-7d2b9bb49d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:41.179087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13defb8-227d-40b9-88f3-7d2b9bb49d51 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:41.179371 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13defb8-227d-40b9-88f3-7d2b9bb49d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:41.179647 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13defb8-227d-40b9-88f3-7d2b9bb49d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:41.180355 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13defb8-227d-40b9-88f3-7d2b9bb49d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:41.181941 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13defb8-227d-40b9-88f3-7d2b9bb49d51 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:41.191854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1217/2473] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:57:41.196087 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adf921-6a50-4f2f-82ca-5144b934f257 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:41.206472 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1adf921-6a50-4f2f-82ca-5144b934f257 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:41.211174 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0dc54-a58a-4c2d-a1af-8417bd9bdbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:41.212055 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0dc54-a58a-4c2d-a1af-8417bd9bdbcf admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:41.212335 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0dc54-a58a-4c2d-a1af-8417bd9bdbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:41.212601 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0dc54-a58a-4c2d-a1af-8417bd9bdbcf admin admin] PATH_INFO: `/v3/projects/8e7991d9a787467eb0c89417eecb3cec/users/83961be6d8cb4f439a444dbcd0b8d131/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:41.214561 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0dc54-a58a-4c2d-a1af-8417bd9bdbcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e7991d9a787467eb0c89417eecb3cec, user_id=83961be6d8cb4f439a444dbcd0b8d131, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:41.217294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0dc54-a58a-4c2d-a1af-8417bd9bdbcf admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:41.227193 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1257/2474] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:57:41 2022] PUT /identity/v3/projects/8e7991d9a787467eb0c89417eecb3cec/users/83961be6d8cb4f439a444dbcd0b8d131/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:57:41.875879 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed3a70-d97c-484f-bde1-c6b0b9a6e658 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:41.876405 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed3a70-d97c-484f-bde1-c6b0b9a6e658 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:41.876405 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed3a70-d97c-484f-bde1-c6b0b9a6e658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:41.925401 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-7bed3a70-d97c-484f-bde1-c6b0b9a6e658 None None] MFA Rules not processed for user `83961be6d8cb4f439a444dbcd0b8d131`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:41.927198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7bed3a70-d97c-484f-bde1-c6b0b9a6e658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:42.039146 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1218/2475] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:41 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:43.630954 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0dc54-a58a-4c2d-a1af-8417bd9bdbcf admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:43.749053 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0dc54-a58a-4c2d-a1af-8417bd9bdbcf admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:43.756713 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff01ab0-4e56-472c-858b-8e549d3a3593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:43.757784 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff01ab0-4e56-472c-858b-8e549d3a3593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:43.758162 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff01ab0-4e56-472c-858b-8e549d3a3593 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:43.758394 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff01ab0-4e56-472c-858b-8e549d3a3593 admin admin] PATH_INFO: `/v3/users/9d77bfba6c534e619a313faeeddc2b50` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:43.759926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff01ab0-4e56-472c-858b-8e549d3a3593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d77bfba6c534e619a313faeeddc2b50)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:43.763123 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff01ab0-4e56-472c-858b-8e549d3a3593 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:43.833387 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-cff01ab0-4e56-472c-858b-8e549d3a3593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d77bfba6c534e619a313faeeddc2b50'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:43.834337 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-cff01ab0-4e56-472c-858b-8e549d3a3593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d77bfba6c534e619a313faeeddc2b50'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:43.847808 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-cff01ab0-4e56-472c-858b-8e549d3a3593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d77bfba6c534e619a313faeeddc2b50'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:43.861346 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-cff01ab0-4e56-472c-858b-8e549d3a3593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d77bfba6c534e619a313faeeddc2b50'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:43.879944 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-cff01ab0-4e56-472c-858b-8e549d3a3593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d77bfba6c534e619a313faeeddc2b50'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:43.890826 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1258/2476] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:57:43 2022] DELETE /identity/v3/users/9d77bfba6c534e619a313faeeddc2b50 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:44.531369 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed3a70-d97c-484f-bde1-c6b0b9a6e658 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:44.550852 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed3a70-d97c-484f-bde1-c6b0b9a6e658 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:44.641643 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00d65a-68dc-42c1-908a-c1dd335e2418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:44.643108 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00d65a-68dc-42c1-908a-c1dd335e2418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:44.643466 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00d65a-68dc-42c1-908a-c1dd335e2418 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:44.643814 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00d65a-68dc-42c1-908a-c1dd335e2418 admin admin] PATH_INFO: `/v3/projects/6373f0fa961345f986cd9c919dbb9ee4` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:44.645791 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00d65a-68dc-42c1-908a-c1dd335e2418 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6373f0fa961345f986cd9c919dbb9ee4)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:44.648443 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00d65a-68dc-42c1-908a-c1dd335e2418 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:44.720356 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5b00d65a-68dc-42c1-908a-c1dd335e2418 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6373f0fa961345f986cd9c919dbb9ee4', 'request_id': 'req-5b00d65a-68dc-42c1-908a-c1dd335e2418'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:44.726970 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5b00d65a-68dc-42c1-908a-c1dd335e2418 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6373f0fa961345f986cd9c919dbb9ee4', 'request_id': 'req-5b00d65a-68dc-42c1-908a-c1dd335e2418'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:44.734201 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5b00d65a-68dc-42c1-908a-c1dd335e2418 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6373f0fa961345f986cd9c919dbb9ee4', 'request_id': 'req-5b00d65a-68dc-42c1-908a-c1dd335e2418'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:44.756489 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5b00d65a-68dc-42c1-908a-c1dd335e2418 admin admin] The token cache is being invalidate because project 6373f0fa961345f986cd9c919dbb9ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:57:44.756850 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5b00d65a-68dc-42c1-908a-c1dd335e2418 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:44.758353 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5b00d65a-68dc-42c1-908a-c1dd335e2418 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:44.760947 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1219/2477] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:57:44 2022] DELETE /identity/v3/projects/6373f0fa961345f986cd9c919dbb9ee4 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:44.765474 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff01ab0-4e56-472c-858b-8e549d3a3593 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:44.767087 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-cff01ab0-4e56-472c-858b-8e549d3a3593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:44.783497 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff01ab0-4e56-472c-858b-8e549d3a3593 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:44.855284 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb02a2-fe67-4daf-93d6-ac7fa8ddf2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:44.856781 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb02a2-fe67-4daf-93d6-ac7fa8ddf2b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:44.857064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb02a2-fe67-4daf-93d6-ac7fa8ddf2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:44.857330 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb02a2-fe67-4daf-93d6-ac7fa8ddf2b7 admin admin] PATH_INFO: `/v3/users/83961be6d8cb4f439a444dbcd0b8d131` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:44.860078 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb02a2-fe67-4daf-93d6-ac7fa8ddf2b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83961be6d8cb4f439a444dbcd0b8d131)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:44.862633 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb02a2-fe67-4daf-93d6-ac7fa8ddf2b7 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:44.931554 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-36fb02a2-fe67-4daf-93d6-ac7fa8ddf2b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83961be6d8cb4f439a444dbcd0b8d131'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:44.933249 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-36fb02a2-fe67-4daf-93d6-ac7fa8ddf2b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83961be6d8cb4f439a444dbcd0b8d131'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:44.942640 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-36fb02a2-fe67-4daf-93d6-ac7fa8ddf2b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83961be6d8cb4f439a444dbcd0b8d131'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:44.951211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-36fb02a2-fe67-4daf-93d6-ac7fa8ddf2b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83961be6d8cb4f439a444dbcd0b8d131'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:44.964270 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-36fb02a2-fe67-4daf-93d6-ac7fa8ddf2b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83961be6d8cb4f439a444dbcd0b8d131'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:44.972264 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1259/2478] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:57:44 2022] DELETE /identity/v3/users/83961be6d8cb4f439a444dbcd0b8d131 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:45.611448 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00d65a-68dc-42c1-908a-c1dd335e2418 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:45.615064 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5b00d65a-68dc-42c1-908a-c1dd335e2418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:45.631760 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00d65a-68dc-42c1-908a-c1dd335e2418 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:45.738786 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93686524-7f38-4011-83e1-100022ce4228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:45.740014 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93686524-7f38-4011-83e1-100022ce4228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:45.740511 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93686524-7f38-4011-83e1-100022ce4228 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:45.741273 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93686524-7f38-4011-83e1-100022ce4228 admin admin] PATH_INFO: `/v3/projects/8e7991d9a787467eb0c89417eecb3cec` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:45.743099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93686524-7f38-4011-83e1-100022ce4228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e7991d9a787467eb0c89417eecb3cec)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:45.745284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93686524-7f38-4011-83e1-100022ce4228 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:45.815444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-93686524-7f38-4011-83e1-100022ce4228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e7991d9a787467eb0c89417eecb3cec', 'request_id': 'req-93686524-7f38-4011-83e1-100022ce4228'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:45.822184 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-93686524-7f38-4011-83e1-100022ce4228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e7991d9a787467eb0c89417eecb3cec', 'request_id': 'req-93686524-7f38-4011-83e1-100022ce4228'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:45.830011 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-93686524-7f38-4011-83e1-100022ce4228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e7991d9a787467eb0c89417eecb3cec', 'request_id': 'req-93686524-7f38-4011-83e1-100022ce4228'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:45.850467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-93686524-7f38-4011-83e1-100022ce4228 admin admin] The token cache is being invalidate because project 8e7991d9a787467eb0c89417eecb3cec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:57:45.851073 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-93686524-7f38-4011-83e1-100022ce4228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:45.851991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-93686524-7f38-4011-83e1-100022ce4228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:45.856577 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1220/2479] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:57:45 2022] DELETE /identity/v3/projects/8e7991d9a787467eb0c89417eecb3cec => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:45.861281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d06d5-0471-42f2-816f-7d0b8c444b1d None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:45.861783 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d06d5-0471-42f2-816f-7d0b8c444b1d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:45.861893 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d06d5-0471-42f2-816f-7d0b8c444b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:45.883234 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-820d06d5-0471-42f2-816f-7d0b8c444b1d None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:45.884443 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-820d06d5-0471-42f2-816f-7d0b8c444b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:45.970752 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1260/2480] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:45.972522 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb00b5d-38e6-4c80-bae8-fdf27ef74725 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:45.972993 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb00b5d-38e6-4c80-bae8-fdf27ef74725 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:45.973472 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb00b5d-38e6-4c80-bae8-fdf27ef74725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:45.994722 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-efb00b5d-38e6-4c80-bae8-fdf27ef74725 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:45.996322 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-efb00b5d-38e6-4c80-bae8-fdf27ef74725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:46.013062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1221/2481] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:46.017531 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d06d5-0471-42f2-816f-7d0b8c444b1d None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:46.028492 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d06d5-0471-42f2-816f-7d0b8c444b1d None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:46.033448 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c302254-11a7-4074-80ec-b44ac64101de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:46.034298 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c302254-11a7-4074-80ec-b44ac64101de admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:46.034778 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c302254-11a7-4074-80ec-b44ac64101de admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:46.035211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c302254-11a7-4074-80ec-b44ac64101de admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:46.036277 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c302254-11a7-4074-80ec-b44ac64101de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:57:46.036588 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c302254-11a7-4074-80ec-b44ac64101de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:46.038291 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c302254-11a7-4074-80ec-b44ac64101de admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:46.051277 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1261/2482] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:57:46.055687 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb00b5d-38e6-4c80-bae8-fdf27ef74725 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:46.065559 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb00b5d-38e6-4c80-bae8-fdf27ef74725 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:46.070197 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0109ea-2e46-4587-93cf-c97bf6dcdd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:46.070881 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0109ea-2e46-4587-93cf-c97bf6dcdd43 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:46.071162 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0109ea-2e46-4587-93cf-c97bf6dcdd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:46.071435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0109ea-2e46-4587-93cf-c97bf6dcdd43 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:46.072144 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0109ea-2e46-4587-93cf-c97bf6dcdd43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:46.074056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0109ea-2e46-4587-93cf-c97bf6dcdd43 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:46.103678 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1222/2483] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:57:46 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:57:46.104871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c302254-11a7-4074-80ec-b44ac64101de admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:46.114423 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c302254-11a7-4074-80ec-b44ac64101de admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:46.170394 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18389478-647c-4bf4-9eff-d501bc803784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:46.171219 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18389478-647c-4bf4-9eff-d501bc803784 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:46.171600 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18389478-647c-4bf4-9eff-d501bc803784 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:46.171973 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18389478-647c-4bf4-9eff-d501bc803784 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:46.172753 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18389478-647c-4bf4-9eff-d501bc803784 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:46.174815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18389478-647c-4bf4-9eff-d501bc803784 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:46.202806 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1262/2484] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:57:46 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:57:46.206141 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0109ea-2e46-4587-93cf-c97bf6dcdd43 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:46.218349 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0109ea-2e46-4587-93cf-c97bf6dcdd43 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:46.223614 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55ae5c-13b8-44a4-bf5a-1c9d5ea87e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:46.224356 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55ae5c-13b8-44a4-bf5a-1c9d5ea87e9c admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:46.224710 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55ae5c-13b8-44a4-bf5a-1c9d5ea87e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:46.225057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa55ae5c-13b8-44a4-bf5a-1c9d5ea87e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:46.225847 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55ae5c-13b8-44a4-bf5a-1c9d5ea87e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:46.227690 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa55ae5c-13b8-44a4-bf5a-1c9d5ea87e9c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:46.243358 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1223/2485] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:57:46.244627 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18389478-647c-4bf4-9eff-d501bc803784 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:46.258010 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18389478-647c-4bf4-9eff-d501bc803784 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:46.263169 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb2f5f-22fa-4e5a-b9c1-4cb4da318f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:46.263830 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb2f5f-22fa-4e5a-b9c1-4cb4da318f43 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:46.264110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb2f5f-22fa-4e5a-b9c1-4cb4da318f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:46.264386 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb2f5f-22fa-4e5a-b9c1-4cb4da318f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:46.265105 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb2f5f-22fa-4e5a-b9c1-4cb4da318f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:46.266734 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb2f5f-22fa-4e5a-b9c1-4cb4da318f43 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:46.276562 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1263/2486] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:57:46.280710 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55ae5c-13b8-44a4-bf5a-1c9d5ea87e9c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:46.291485 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa55ae5c-13b8-44a4-bf5a-1c9d5ea87e9c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:46.297657 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d5aa0-86c0-4850-9e76-528210688ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:46.298544 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d5aa0-86c0-4850-9e76-528210688ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:46.298863 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d5aa0-86c0-4850-9e76-528210688ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:46.299146 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d5aa0-86c0-4850-9e76-528210688ee4 admin admin] PATH_INFO: `/v3/projects/72b40d88e6c14694a1314bd2a161c4dd/users/21a59a8a966844be8bd5d6ab75acc9f9/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:46.317091 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d5aa0-86c0-4850-9e76-528210688ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b40d88e6c14694a1314bd2a161c4dd, user_id=21a59a8a966844be8bd5d6ab75acc9f9, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:46.319810 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d5aa0-86c0-4850-9e76-528210688ee4 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:46.345233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1224/2487] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:57:46 2022] PUT /identity/v3/projects/72b40d88e6c14694a1314bd2a161c4dd/users/21a59a8a966844be8bd5d6ab75acc9f9/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:46.345685 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0192455-30ec-4af7-a5ce-652ac4f5f0ef None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:46.345969 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0192455-30ec-4af7-a5ce-652ac4f5f0ef None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:46.346347 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0192455-30ec-4af7-a5ce-652ac4f5f0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:46.391858 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-a0192455-30ec-4af7-a5ce-652ac4f5f0ef None None] MFA Rules not processed for user `21a59a8a966844be8bd5d6ab75acc9f9`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:46.393126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a0192455-30ec-4af7-a5ce-652ac4f5f0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:46.456570 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1264/2488] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:57:46.460897 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d5aa0-86c0-4850-9e76-528210688ee4 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:46.523455 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d5aa0-86c0-4850-9e76-528210688ee4 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:46.528709 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c42b9-0f14-42db-bed9-dcf945464d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:46.529369 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c42b9-0f14-42db-bed9-dcf945464d74 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:46.529651 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c42b9-0f14-42db-bed9-dcf945464d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:46.529925 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c42b9-0f14-42db-bed9-dcf945464d74 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:46.530652 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c42b9-0f14-42db-bed9-dcf945464d74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:46.532553 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c42b9-0f14-42db-bed9-dcf945464d74 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:46.558317 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1225/2489] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:57:46 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:57:46.562917 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0192455-30ec-4af7-a5ce-652ac4f5f0ef None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:46.573629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0192455-30ec-4af7-a5ce-652ac4f5f0ef None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:46.646963 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dd1d2-782d-4ae7-804b-5de529fb61ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:46.647642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dd1d2-782d-4ae7-804b-5de529fb61ce admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:46.647942 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dd1d2-782d-4ae7-804b-5de529fb61ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:46.648221 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34dd1d2-782d-4ae7-804b-5de529fb61ce admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:46.648908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dd1d2-782d-4ae7-804b-5de529fb61ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:46.651040 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34dd1d2-782d-4ae7-804b-5de529fb61ce admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:46.673232 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1265/2490] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:57:46 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:57:46.674381 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c42b9-0f14-42db-bed9-dcf945464d74 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:46.685423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c42b9-0f14-42db-bed9-dcf945464d74 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:46.690027 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7caab7-4f9f-4589-a220-ac97e47c4d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:46.690561 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7caab7-4f9f-4589-a220-ac97e47c4d0b admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:46.690877 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7caab7-4f9f-4589-a220-ac97e47c4d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:46.691151 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7caab7-4f9f-4589-a220-ac97e47c4d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:46.691862 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7caab7-4f9f-4589-a220-ac97e47c4d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:46.693449 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7caab7-4f9f-4589-a220-ac97e47c4d0b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:46.704390 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1226/2491] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:57:46.708608 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dd1d2-782d-4ae7-804b-5de529fb61ce admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:46.718296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34dd1d2-782d-4ae7-804b-5de529fb61ce admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:46.723009 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9dc14-5ce5-4404-b1b8-3e40ffe1a146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:46.723878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9dc14-5ce5-4404-b1b8-3e40ffe1a146 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:46.724155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9dc14-5ce5-4404-b1b8-3e40ffe1a146 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:46.724429 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9dc14-5ce5-4404-b1b8-3e40ffe1a146 admin admin] PATH_INFO: `/v3/projects/7b5f2a7fbd6843a99fc88c2bb15e3350/users/3439b53dbee0415f9c25cc6cac3fc67e/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:46.738808 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9dc14-5ce5-4404-b1b8-3e40ffe1a146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5f2a7fbd6843a99fc88c2bb15e3350, user_id=3439b53dbee0415f9c25cc6cac3fc67e, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:46.741461 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9dc14-5ce5-4404-b1b8-3e40ffe1a146 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:46.754550 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1266/2492] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:57:46 2022] PUT /identity/v3/projects/7b5f2a7fbd6843a99fc88c2bb15e3350/users/3439b53dbee0415f9c25cc6cac3fc67e/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:46.758377 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7caab7-4f9f-4589-a220-ac97e47c4d0b admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:46.768772 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7caab7-4f9f-4589-a220-ac97e47c4d0b admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:46.824117 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfba583-22b1-4a7c-afbc-23a432551ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:46.824778 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfba583-22b1-4a7c-afbc-23a432551ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:46.825056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfba583-22b1-4a7c-afbc-23a432551ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:46.825323 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfba583-22b1-4a7c-afbc-23a432551ba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:46.826035 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfba583-22b1-4a7c-afbc-23a432551ba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:46.827650 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfba583-22b1-4a7c-afbc-23a432551ba5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:46.837130 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1227/2493] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:57:46.841312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9dc14-5ce5-4404-b1b8-3e40ffe1a146 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:46.851303 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9dc14-5ce5-4404-b1b8-3e40ffe1a146 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:46.856539 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd23078-974a-4269-a9da-a063ec7dd1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:46.857408 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd23078-974a-4269-a9da-a063ec7dd1dc admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:46.857687 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd23078-974a-4269-a9da-a063ec7dd1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:46.857958 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd23078-974a-4269-a9da-a063ec7dd1dc admin admin] PATH_INFO: `/v3/projects/7b5f2a7fbd6843a99fc88c2bb15e3350/users/3439b53dbee0415f9c25cc6cac3fc67e/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:46.859958 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd23078-974a-4269-a9da-a063ec7dd1dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5f2a7fbd6843a99fc88c2bb15e3350, user_id=3439b53dbee0415f9c25cc6cac3fc67e, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:46.862631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd23078-974a-4269-a9da-a063ec7dd1dc admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:46.873583 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1267/2494] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:57:46 2022] PUT /identity/v3/projects/7b5f2a7fbd6843a99fc88c2bb15e3350/users/3439b53dbee0415f9c25cc6cac3fc67e/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:46.884037 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4303e-88c3-4da1-936f-f2097a1a09e1 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:46.884396 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4303e-88c3-4da1-936f-f2097a1a09e1 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:46.884680 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f4303e-88c3-4da1-936f-f2097a1a09e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:46.913748 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-95f4303e-88c3-4da1-936f-f2097a1a09e1 None None] MFA Rules not processed for user `3439b53dbee0415f9c25cc6cac3fc67e`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:46.915225 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-95f4303e-88c3-4da1-936f-f2097a1a09e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:46.980852 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1228/2495] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:46 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:46.992090 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd23078-974a-4269-a9da-a063ec7dd1dc admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:46.993773 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4fd23078-974a-4269-a9da-a063ec7dd1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:47.049643 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd23078-974a-4269-a9da-a063ec7dd1dc admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:47.053470 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472f811-6491-4a7b-9760-8c56e72e2b39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:47.054092 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472f811-6491-4a7b-9760-8c56e72e2b39 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:47.054369 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472f811-6491-4a7b-9760-8c56e72e2b39 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:47.054685 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472f811-6491-4a7b-9760-8c56e72e2b39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:47.063374 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472f811-6491-4a7b-9760-8c56e72e2b39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:47.064783 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472f811-6491-4a7b-9760-8c56e72e2b39 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:47.074235 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1268/2496] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:57:46 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:57:47.430448 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4303e-88c3-4da1-936f-f2097a1a09e1 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:47.498822 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f4303e-88c3-4da1-936f-f2097a1a09e1 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:47.505326 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d43a9-3e3a-4864-a58e-38a00a92d296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:47.507040 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d43a9-3e3a-4864-a58e-38a00a92d296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:47.507323 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d43a9-3e3a-4864-a58e-38a00a92d296 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:47.507603 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d43a9-3e3a-4864-a58e-38a00a92d296 admin admin] PATH_INFO: `/v3/users/21a59a8a966844be8bd5d6ab75acc9f9` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:47.510380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d43a9-3e3a-4864-a58e-38a00a92d296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21a59a8a966844be8bd5d6ab75acc9f9)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:47.511467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d43a9-3e3a-4864-a58e-38a00a92d296 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:47.569318 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-267d43a9-3e3a-4864-a58e-38a00a92d296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21a59a8a966844be8bd5d6ab75acc9f9'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:47.578052 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-267d43a9-3e3a-4864-a58e-38a00a92d296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21a59a8a966844be8bd5d6ab75acc9f9'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:47.578879 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-267d43a9-3e3a-4864-a58e-38a00a92d296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21a59a8a966844be8bd5d6ab75acc9f9'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:47.587068 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-267d43a9-3e3a-4864-a58e-38a00a92d296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21a59a8a966844be8bd5d6ab75acc9f9'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:47.598889 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-267d43a9-3e3a-4864-a58e-38a00a92d296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21a59a8a966844be8bd5d6ab75acc9f9'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:47.604755 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1229/2497] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:57:47 2022] DELETE /identity/v3/users/21a59a8a966844be8bd5d6ab75acc9f9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:47.609760 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfa08c-f5d7-4112-b400-3de951fc0454 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:47.610151 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfa08c-f5d7-4112-b400-3de951fc0454 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:47.610545 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dfa08c-f5d7-4112-b400-3de951fc0454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:47.628189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-44dfa08c-f5d7-4112-b400-3de951fc0454 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:47.629632 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-44dfa08c-f5d7-4112-b400-3de951fc0454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:47.695644 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1269/2498] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:47.705143 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d43a9-3e3a-4864-a58e-38a00a92d296 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:47.706652 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-267d43a9-3e3a-4864-a58e-38a00a92d296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:47.764311 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d43a9-3e3a-4864-a58e-38a00a92d296 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:47.768014 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13717125-5070-404f-8b41-9ee185cf35d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:47.768660 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13717125-5070-404f-8b41-9ee185cf35d1 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:47.768943 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13717125-5070-404f-8b41-9ee185cf35d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:47.769211 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13717125-5070-404f-8b41-9ee185cf35d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:47.778763 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13717125-5070-404f-8b41-9ee185cf35d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:47.780196 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13717125-5070-404f-8b41-9ee185cf35d1 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:47.789761 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1230/2499] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:57:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:57:48.133697 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfa08c-f5d7-4112-b400-3de951fc0454 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:48.135722 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-44dfa08c-f5d7-4112-b400-3de951fc0454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:48.166508 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dfa08c-f5d7-4112-b400-3de951fc0454 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:48.173864 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db9ac8-34fc-4528-8ce1-3516579cad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:48.174993 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db9ac8-34fc-4528-8ce1-3516579cad8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:48.175493 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db9ac8-34fc-4528-8ce1-3516579cad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:48.176100 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db9ac8-34fc-4528-8ce1-3516579cad8b admin admin] PATH_INFO: `/v3/projects/72b40d88e6c14694a1314bd2a161c4dd` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:48.178677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db9ac8-34fc-4528-8ce1-3516579cad8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=72b40d88e6c14694a1314bd2a161c4dd)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:48.181270 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4db9ac8-34fc-4528-8ce1-3516579cad8b admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:48.253423 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c4db9ac8-34fc-4528-8ce1-3516579cad8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72b40d88e6c14694a1314bd2a161c4dd', 'request_id': 'req-c4db9ac8-34fc-4528-8ce1-3516579cad8b'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:48.260970 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c4db9ac8-34fc-4528-8ce1-3516579cad8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72b40d88e6c14694a1314bd2a161c4dd', 'request_id': 'req-c4db9ac8-34fc-4528-8ce1-3516579cad8b'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:48.269301 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c4db9ac8-34fc-4528-8ce1-3516579cad8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72b40d88e6c14694a1314bd2a161c4dd', 'request_id': 'req-c4db9ac8-34fc-4528-8ce1-3516579cad8b'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:48.272314 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6f50b-5cf9-4e18-9b38-599c0c89dc5a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:48.272631 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6f50b-5cf9-4e18-9b38-599c0c89dc5a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:48.272874 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6f50b-5cf9-4e18-9b38-599c0c89dc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:48.284604 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c4db9ac8-34fc-4528-8ce1-3516579cad8b admin admin] The token cache is being invalidate because project 72b40d88e6c14694a1314bd2a161c4dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:57:48.285376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c4db9ac8-34fc-4528-8ce1-3516579cad8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:48.286075 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c4db9ac8-34fc-4528-8ce1-3516579cad8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:48.287677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1270/2500] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:57:48 2022] DELETE /identity/v3/projects/72b40d88e6c14694a1314bd2a161c4dd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:48.291469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db9ac8-34fc-4528-8ce1-3516579cad8b admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:48.295573 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-c4db9ac8-34fc-4528-8ce1-3516579cad8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:48.296138 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f5a6f50b-5cf9-4e18-9b38-599c0c89dc5a None None] MFA Rules not processed for user `e0653575c0a24603bb9287e6222313de`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:48.297316 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f5a6f50b-5cf9-4e18-9b38-599c0c89dc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:48.358638 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1231/2501] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Apr 11 16:57:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:57:48.369071 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4db9ac8-34fc-4528-8ce1-3516579cad8b admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:48.372477 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6f50b-5cf9-4e18-9b38-599c0c89dc5a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:48.373949 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f5a6f50b-5cf9-4e18-9b38-599c0c89dc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:48.374190 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fa6b9-f8f3-4312-90e6-7bde595c331e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:48.375093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fa6b9-f8f3-4312-90e6-7bde595c331e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:48.375368 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fa6b9-f8f3-4312-90e6-7bde595c331e admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:48.375950 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3fa6b9-f8f3-4312-90e6-7bde595c331e admin admin] PATH_INFO: `/v3/users/3439b53dbee0415f9c25cc6cac3fc67e` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:48.377716 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fa6b9-f8f3-4312-90e6-7bde595c331e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3439b53dbee0415f9c25cc6cac3fc67e)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:48.379731 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3fa6b9-f8f3-4312-90e6-7bde595c331e admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:48.432871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-0f3fa6b9-f8f3-4312-90e6-7bde595c331e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3439b53dbee0415f9c25cc6cac3fc67e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:48.433610 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-0f3fa6b9-f8f3-4312-90e6-7bde595c331e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3439b53dbee0415f9c25cc6cac3fc67e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:48.441589 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-0f3fa6b9-f8f3-4312-90e6-7bde595c331e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3439b53dbee0415f9c25cc6cac3fc67e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:48.450261 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-0f3fa6b9-f8f3-4312-90e6-7bde595c331e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3439b53dbee0415f9c25cc6cac3fc67e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:48.451514 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6f50b-5cf9-4e18-9b38-599c0c89dc5a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:48.456903 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25e447-bc2a-4950-b258-5158e3aad90c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6659c6661840a79ba9ff1c3c9e93c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:48.457621 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25e447-bc2a-4950-b258-5158e3aad90c service swift] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:48.458004 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25e447-bc2a-4950-b258-5158e3aad90c service swift] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:48.458337 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25e447-bc2a-4950-b258-5158e3aad90c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:48.463302 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-0f3fa6b9-f8f3-4312-90e6-7bde595c331e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3439b53dbee0415f9c25cc6cac3fc67e'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:48.468380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25e447-bc2a-4950-b258-5158e3aad90c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:48.469667 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25e447-bc2a-4950-b258-5158e3aad90c service swift] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:48.470281 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1271/2502] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:57:48 2022] DELETE /identity/v3/users/3439b53dbee0415f9c25cc6cac3fc67e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:48.479049 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1232/2503] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Apr 11 16:57:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 11 16:57:49.145758 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fa6b9-f8f3-4312-90e6-7bde595c331e admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:49.147865 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-0f3fa6b9-f8f3-4312-90e6-7bde595c331e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:49.262934 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3fa6b9-f8f3-4312-90e6-7bde595c331e admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:49.276275 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e003bd-1e07-46f7-964b-b92ae7662586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:49.277668 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e003bd-1e07-46f7-964b-b92ae7662586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:49.278165 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e003bd-1e07-46f7-964b-b92ae7662586 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:49.278710 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e003bd-1e07-46f7-964b-b92ae7662586 admin admin] PATH_INFO: `/v3/projects/7b5f2a7fbd6843a99fc88c2bb15e3350` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:49.280412 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e003bd-1e07-46f7-964b-b92ae7662586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b5f2a7fbd6843a99fc88c2bb15e3350)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:49.283378 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e003bd-1e07-46f7-964b-b92ae7662586 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:49.355100 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-83e003bd-1e07-46f7-964b-b92ae7662586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b5f2a7fbd6843a99fc88c2bb15e3350', 'request_id': 'req-83e003bd-1e07-46f7-964b-b92ae7662586'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:49.361820 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-83e003bd-1e07-46f7-964b-b92ae7662586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b5f2a7fbd6843a99fc88c2bb15e3350', 'request_id': 'req-83e003bd-1e07-46f7-964b-b92ae7662586'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:49.368729 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-83e003bd-1e07-46f7-964b-b92ae7662586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b5f2a7fbd6843a99fc88c2bb15e3350', 'request_id': 'req-83e003bd-1e07-46f7-964b-b92ae7662586'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:49.394259 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-83e003bd-1e07-46f7-964b-b92ae7662586 admin admin] The token cache is being invalidate because project 7b5f2a7fbd6843a99fc88c2bb15e3350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:57:49.394259 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-83e003bd-1e07-46f7-964b-b92ae7662586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:49.395430 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-83e003bd-1e07-46f7-964b-b92ae7662586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:49.396979 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1272/2504] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:57:49 2022] DELETE /identity/v3/projects/7b5f2a7fbd6843a99fc88c2bb15e3350 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:49.401873 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1851b67-b040-4c86-bdbb-314eb43b4f70 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:49.402936 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1851b67-b040-4c86-bdbb-314eb43b4f70 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:49.403118 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1851b67-b040-4c86-bdbb-314eb43b4f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:49.426268 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-e1851b67-b040-4c86-bdbb-314eb43b4f70 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:49.427750 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-e1851b67-b040-4c86-bdbb-314eb43b4f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:49.490114 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1233/2505] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:49.498418 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975987c1-68fe-4e7a-8e6c-e6f3df625320 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:49.498751 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975987c1-68fe-4e7a-8e6c-e6f3df625320 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:49.499033 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975987c1-68fe-4e7a-8e6c-e6f3df625320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:49.518728 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-975987c1-68fe-4e7a-8e6c-e6f3df625320 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:49.519949 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-975987c1-68fe-4e7a-8e6c-e6f3df625320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:49.530337 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1273/2506] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:49.534302 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1851b67-b040-4c86-bdbb-314eb43b4f70 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:49.554445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1851b67-b040-4c86-bdbb-314eb43b4f70 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:49.560089 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf079f-e029-4161-8219-1ef8d6fdc058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:49.560754 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf079f-e029-4161-8219-1ef8d6fdc058 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:49.561036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf079f-e029-4161-8219-1ef8d6fdc058 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:49.561311 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf079f-e029-4161-8219-1ef8d6fdc058 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:49.562030 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf079f-e029-4161-8219-1ef8d6fdc058 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:57:49.562333 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf079f-e029-4161-8219-1ef8d6fdc058 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:49.564291 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf079f-e029-4161-8219-1ef8d6fdc058 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:49.583019 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1234/2507] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:57:49.587381 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975987c1-68fe-4e7a-8e6c-e6f3df625320 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:49.597769 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975987c1-68fe-4e7a-8e6c-e6f3df625320 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:49.603347 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a97e4-4d67-4f4a-acf4-681693e81a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:49.604303 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a97e4-4d67-4f4a-acf4-681693e81a86 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:49.604584 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a97e4-4d67-4f4a-acf4-681693e81a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:49.604974 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a97e4-4d67-4f4a-acf4-681693e81a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:49.606309 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a97e4-4d67-4f4a-acf4-681693e81a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:49.608628 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a97e4-4d67-4f4a-acf4-681693e81a86 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:49.635589 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1274/2508] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:57:49 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:57:49.639818 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf079f-e029-4161-8219-1ef8d6fdc058 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:49.650616 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf079f-e029-4161-8219-1ef8d6fdc058 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:49.710298 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93518298-0607-4c0a-b191-16b997406ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:49.711008 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93518298-0607-4c0a-b191-16b997406ddb admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:49.711385 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93518298-0607-4c0a-b191-16b997406ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:49.712085 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93518298-0607-4c0a-b191-16b997406ddb admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:49.716322 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93518298-0607-4c0a-b191-16b997406ddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:49.716322 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93518298-0607-4c0a-b191-16b997406ddb admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:49.742402 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1235/2509] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:57:49 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:57:49.746363 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a97e4-4d67-4f4a-acf4-681693e81a86 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:49.762658 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a97e4-4d67-4f4a-acf4-681693e81a86 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:49.766615 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ed92e-83f2-410f-9560-5380ad4fb491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:49.767315 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ed92e-83f2-410f-9560-5380ad4fb491 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:49.767596 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ed92e-83f2-410f-9560-5380ad4fb491 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:49.767871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ed92e-83f2-410f-9560-5380ad4fb491 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:49.768628 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ed92e-83f2-410f-9560-5380ad4fb491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:49.770330 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ed92e-83f2-410f-9560-5380ad4fb491 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:49.782969 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1275/2510] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:57:49.786561 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93518298-0607-4c0a-b191-16b997406ddb admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:49.797154 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93518298-0607-4c0a-b191-16b997406ddb admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:49.802097 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087109be-dd37-4c63-b93a-888124de0a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:49.802928 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087109be-dd37-4c63-b93a-888124de0a0f admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:49.803210 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087109be-dd37-4c63-b93a-888124de0a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:49.803485 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087109be-dd37-4c63-b93a-888124de0a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:49.804303 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087109be-dd37-4c63-b93a-888124de0a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:49.806011 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087109be-dd37-4c63-b93a-888124de0a0f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:49.820396 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1236/2511] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:57:49.825184 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ed92e-83f2-410f-9560-5380ad4fb491 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:49.835943 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ed92e-83f2-410f-9560-5380ad4fb491 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:49.842210 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cd500-2271-46f5-8b91-393af48df719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:49.843133 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cd500-2271-46f5-8b91-393af48df719 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:49.843420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cd500-2271-46f5-8b91-393af48df719 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:49.843689 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13cd500-2271-46f5-8b91-393af48df719 admin admin] PATH_INFO: `/v3/projects/f41e0e68065244c29da0d1a4e0addcb2/users/e93ba978d8224f18846aeb16771f93d0/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:49.863080 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cd500-2271-46f5-8b91-393af48df719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41e0e68065244c29da0d1a4e0addcb2, user_id=e93ba978d8224f18846aeb16771f93d0, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:49.866419 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13cd500-2271-46f5-8b91-393af48df719 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:49.891247 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1276/2512] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:57:49 2022] PUT /identity/v3/projects/f41e0e68065244c29da0d1a4e0addcb2/users/e93ba978d8224f18846aeb16771f93d0/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:49.893043 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb9c4d-4d85-4b2b-9350-7a8be4c4a987 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:49.893336 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb9c4d-4d85-4b2b-9350-7a8be4c4a987 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:49.893648 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbb9c4d-4d85-4b2b-9350-7a8be4c4a987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:49.922328 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-4bbb9c4d-4d85-4b2b-9350-7a8be4c4a987 None None] MFA Rules not processed for user `e93ba978d8224f18846aeb16771f93d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:49.923565 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4bbb9c4d-4d85-4b2b-9350-7a8be4c4a987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:49.992423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1237/2513] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:57:49.996829 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cd500-2271-46f5-8b91-393af48df719 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:50.061733 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13cd500-2271-46f5-8b91-393af48df719 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:50.066568 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce64d61-ce4c-42ae-8e49-07e92c67153d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:50.067255 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce64d61-ce4c-42ae-8e49-07e92c67153d admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:50.067531 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce64d61-ce4c-42ae-8e49-07e92c67153d admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:50.067805 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce64d61-ce4c-42ae-8e49-07e92c67153d admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:50.068498 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce64d61-ce4c-42ae-8e49-07e92c67153d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:50.070408 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce64d61-ce4c-42ae-8e49-07e92c67153d admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:50.103456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1277/2514] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:57:49 2022] POST /identity/v3/projects => generated 387 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:57:50.104606 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb9c4d-4d85-4b2b-9350-7a8be4c4a987 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:50.122244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbb9c4d-4d85-4b2b-9350-7a8be4c4a987 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:50.264512 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d37d7-0ae5-4bb7-abb7-588d964947a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:50.265502 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d37d7-0ae5-4bb7-abb7-588d964947a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:50.267380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d37d7-0ae5-4bb7-abb7-588d964947a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:50.268553 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d37d7-0ae5-4bb7-abb7-588d964947a0 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:50.269826 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d37d7-0ae5-4bb7-abb7-588d964947a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:50.277247 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d37d7-0ae5-4bb7-abb7-588d964947a0 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:50.333841 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1238/2515] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:57:50 2022] POST /identity/v3/users => generated 300 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:57:50.338675 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce64d61-ce4c-42ae-8e49-07e92c67153d admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:50.353697 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce64d61-ce4c-42ae-8e49-07e92c67153d admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:50.366134 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69608907-d8bd-4062-b6ce-a4c8b3365c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:50.367087 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69608907-d8bd-4062-b6ce-a4c8b3365c80 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:50.367436 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69608907-d8bd-4062-b6ce-a4c8b3365c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:50.367780 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69608907-d8bd-4062-b6ce-a4c8b3365c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:50.368940 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69608907-d8bd-4062-b6ce-a4c8b3365c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:50.371795 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69608907-d8bd-4062-b6ce-a4c8b3365c80 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:50.401110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d37d7-0ae5-4bb7-abb7-588d964947a0 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:50.411598 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1278/2516] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:57:50.413153 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d37d7-0ae5-4bb7-abb7-588d964947a0 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:50.419641 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a7048-ebe6-4a6b-8973-2d8b29836c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:50.420646 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a7048-ebe6-4a6b-8973-2d8b29836c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:50.420983 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a7048-ebe6-4a6b-8973-2d8b29836c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:50.421363 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a7048-ebe6-4a6b-8973-2d8b29836c8a admin admin] PATH_INFO: `/v3/projects/56d2999d0de24f0aa771f50912e53808/users/afe48964578849ab91d4450fa8b0bce1/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:50.445134 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a7048-ebe6-4a6b-8973-2d8b29836c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d2999d0de24f0aa771f50912e53808, user_id=afe48964578849ab91d4450fa8b0bce1, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:50.447909 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39a7048-ebe6-4a6b-8973-2d8b29836c8a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:50.470964 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1239/2517] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:57:50 2022] PUT /identity/v3/projects/56d2999d0de24f0aa771f50912e53808/users/afe48964578849ab91d4450fa8b0bce1/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:50.475906 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69608907-d8bd-4062-b6ce-a4c8b3365c80 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:50.488308 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69608907-d8bd-4062-b6ce-a4c8b3365c80 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:50.628751 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640ec26-1ae2-4533-b69d-a92bd85867f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:50.629722 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640ec26-1ae2-4533-b69d-a92bd85867f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:50.630008 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640ec26-1ae2-4533-b69d-a92bd85867f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:50.630330 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640ec26-1ae2-4533-b69d-a92bd85867f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:50.631032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640ec26-1ae2-4533-b69d-a92bd85867f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:50.632845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640ec26-1ae2-4533-b69d-a92bd85867f8 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:50.661549 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1279/2518] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:57:50.665878 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a7048-ebe6-4a6b-8973-2d8b29836c8a admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:50.679424 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a7048-ebe6-4a6b-8973-2d8b29836c8a admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:50.695299 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e6820-a8d5-48a3-a8ff-9febf2c0ba3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:50.696897 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e6820-a8d5-48a3-a8ff-9febf2c0ba3e admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:50.697220 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e6820-a8d5-48a3-a8ff-9febf2c0ba3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:50.697498 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e6820-a8d5-48a3-a8ff-9febf2c0ba3e admin admin] PATH_INFO: `/v3/projects/56d2999d0de24f0aa771f50912e53808/users/afe48964578849ab91d4450fa8b0bce1/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:50.702115 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e6820-a8d5-48a3-a8ff-9febf2c0ba3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=56d2999d0de24f0aa771f50912e53808, user_id=afe48964578849ab91d4450fa8b0bce1, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:50.705013 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e6820-a8d5-48a3-a8ff-9febf2c0ba3e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:50.734943 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1240/2519] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:57:50 2022] PUT /identity/v3/projects/56d2999d0de24f0aa771f50912e53808/users/afe48964578849ab91d4450fa8b0bce1/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:50.745676 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156b598-8b44-4733-b15e-bb4211d60605 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:50.746308 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156b598-8b44-4733-b15e-bb4211d60605 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:50.746942 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156b598-8b44-4733-b15e-bb4211d60605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:50.782727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-9156b598-8b44-4733-b15e-bb4211d60605 None None] MFA Rules not processed for user `afe48964578849ab91d4450fa8b0bce1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:50.784264 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9156b598-8b44-4733-b15e-bb4211d60605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:50.876585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1280/2520] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:50.889726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e6820-a8d5-48a3-a8ff-9febf2c0ba3e admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:50.892164 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2e4e6820-a8d5-48a3-a8ff-9febf2c0ba3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:50.957671 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e6820-a8d5-48a3-a8ff-9febf2c0ba3e admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:50.961951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15246ff5-3393-4bdf-bdbf-8baa7b470832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:50.962756 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15246ff5-3393-4bdf-bdbf-8baa7b470832 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:50.963040 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15246ff5-3393-4bdf-bdbf-8baa7b470832 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:50.963279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15246ff5-3393-4bdf-bdbf-8baa7b470832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:50.983148 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15246ff5-3393-4bdf-bdbf-8baa7b470832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:50.984665 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15246ff5-3393-4bdf-bdbf-8baa7b470832 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:51.007224 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1241/2521] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:57:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:57:51.041278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156b598-8b44-4733-b15e-bb4211d60605 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:51.108988 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156b598-8b44-4733-b15e-bb4211d60605 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:51.113842 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a908a14-f241-4c97-8fc5-cca0c961eeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:51.114776 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a908a14-f241-4c97-8fc5-cca0c961eeb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:51.115225 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a908a14-f241-4c97-8fc5-cca0c961eeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:51.115509 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a908a14-f241-4c97-8fc5-cca0c961eeb7 admin admin] PATH_INFO: `/v3/users/e93ba978d8224f18846aeb16771f93d0` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:51.116761 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a908a14-f241-4c97-8fc5-cca0c961eeb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e93ba978d8224f18846aeb16771f93d0)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:51.118878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a908a14-f241-4c97-8fc5-cca0c961eeb7 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:51.192217 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6a908a14-f241-4c97-8fc5-cca0c961eeb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e93ba978d8224f18846aeb16771f93d0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:51.193075 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6a908a14-f241-4c97-8fc5-cca0c961eeb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e93ba978d8224f18846aeb16771f93d0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:51.204702 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6a908a14-f241-4c97-8fc5-cca0c961eeb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e93ba978d8224f18846aeb16771f93d0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:51.214964 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6a908a14-f241-4c97-8fc5-cca0c961eeb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e93ba978d8224f18846aeb16771f93d0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:51.227214 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6a908a14-f241-4c97-8fc5-cca0c961eeb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e93ba978d8224f18846aeb16771f93d0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:51.233609 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1281/2522] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:57:51 2022] DELETE /identity/v3/users/e93ba978d8224f18846aeb16771f93d0 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:51.238630 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47c5de-3f75-40e8-983a-dd6625182b43 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:51.238960 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47c5de-3f75-40e8-983a-dd6625182b43 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:51.239227 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47c5de-3f75-40e8-983a-dd6625182b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:51.268443 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ac47c5de-3f75-40e8-983a-dd6625182b43 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:51.269639 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ac47c5de-3f75-40e8-983a-dd6625182b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:51.357979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1242/2523] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:51.367921 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a908a14-f241-4c97-8fc5-cca0c961eeb7 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:51.369456 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-6a908a14-f241-4c97-8fc5-cca0c961eeb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:51.442127 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a908a14-f241-4c97-8fc5-cca0c961eeb7 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:51.446124 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4beec9-0dd9-46ac-8957-a73c2451bb87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:51.446883 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4beec9-0dd9-46ac-8957-a73c2451bb87 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:51.447214 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4beec9-0dd9-46ac-8957-a73c2451bb87 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:51.447525 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4beec9-0dd9-46ac-8957-a73c2451bb87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:51.457232 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4beec9-0dd9-46ac-8957-a73c2451bb87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:51.458696 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4beec9-0dd9-46ac-8957-a73c2451bb87 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:51.479633 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1282/2524] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:57:51.967654 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47c5de-3f75-40e8-983a-dd6625182b43 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:51.969117 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ac47c5de-3f75-40e8-983a-dd6625182b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:51.984724 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47c5de-3f75-40e8-983a-dd6625182b43 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:52.007005 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1dc598-478c-481d-95f5-a579145de42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:52.007922 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dc598-478c-481d-95f5-a579145de42d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:52.008201 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dc598-478c-481d-95f5-a579145de42d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:52.008475 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1dc598-478c-481d-95f5-a579145de42d admin admin] PATH_INFO: `/v3/projects/f41e0e68065244c29da0d1a4e0addcb2` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:52.009903 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1dc598-478c-481d-95f5-a579145de42d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f41e0e68065244c29da0d1a4e0addcb2)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:52.012416 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1dc598-478c-481d-95f5-a579145de42d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:52.075721 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8a1dc598-478c-481d-95f5-a579145de42d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f41e0e68065244c29da0d1a4e0addcb2', 'request_id': 'req-8a1dc598-478c-481d-95f5-a579145de42d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:52.081646 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8a1dc598-478c-481d-95f5-a579145de42d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f41e0e68065244c29da0d1a4e0addcb2', 'request_id': 'req-8a1dc598-478c-481d-95f5-a579145de42d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:52.092051 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8a1dc598-478c-481d-95f5-a579145de42d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f41e0e68065244c29da0d1a4e0addcb2', 'request_id': 'req-8a1dc598-478c-481d-95f5-a579145de42d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:52.105035 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8a1dc598-478c-481d-95f5-a579145de42d admin admin] The token cache is being invalidate because project f41e0e68065244c29da0d1a4e0addcb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:57:52.105335 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8a1dc598-478c-481d-95f5-a579145de42d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:52.106463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-8a1dc598-478c-481d-95f5-a579145de42d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:52.108400 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1243/2525] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:57:51 2022] DELETE /identity/v3/projects/f41e0e68065244c29da0d1a4e0addcb2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:52.112136 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4beec9-0dd9-46ac-8957-a73c2451bb87 service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:52.122554 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4beec9-0dd9-46ac-8957-a73c2451bb87 service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:52.207192 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecc8f9-f1a2-4525-bce4-4bba27c82808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:52.208375 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecc8f9-f1a2-4525-bce4-4bba27c82808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:52.208842 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecc8f9-f1a2-4525-bce4-4bba27c82808 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:52.209285 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecc8f9-f1a2-4525-bce4-4bba27c82808 admin admin] PATH_INFO: `/v3/users/afe48964578849ab91d4450fa8b0bce1` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:52.212809 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecc8f9-f1a2-4525-bce4-4bba27c82808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe48964578849ab91d4450fa8b0bce1)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:52.214921 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecc8f9-f1a2-4525-bce4-4bba27c82808 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:52.283972 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-beecc8f9-f1a2-4525-bce4-4bba27c82808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe48964578849ab91d4450fa8b0bce1'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:52.284996 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-beecc8f9-f1a2-4525-bce4-4bba27c82808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe48964578849ab91d4450fa8b0bce1'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:52.299787 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-beecc8f9-f1a2-4525-bce4-4bba27c82808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe48964578849ab91d4450fa8b0bce1'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:52.324719 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-beecc8f9-f1a2-4525-bce4-4bba27c82808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe48964578849ab91d4450fa8b0bce1'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:52.336873 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-beecc8f9-f1a2-4525-bce4-4bba27c82808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe48964578849ab91d4450fa8b0bce1'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:52.343103 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1283/2526] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:57:52 2022] DELETE /identity/v3/users/afe48964578849ab91d4450fa8b0bce1 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:57:52.662362 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1dc598-478c-481d-95f5-a579145de42d admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:52.663907 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8a1dc598-478c-481d-95f5-a579145de42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:52.678515 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1dc598-478c-481d-95f5-a579145de42d admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:52.752900 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66d51e-d905-4e25-b531-b7bcc1cd5164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:52.754073 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66d51e-d905-4e25-b531-b7bcc1cd5164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:52.754353 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66d51e-d905-4e25-b531-b7bcc1cd5164 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:52.754658 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66d51e-d905-4e25-b531-b7bcc1cd5164 admin admin] PATH_INFO: `/v3/projects/56d2999d0de24f0aa771f50912e53808` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:52.755864 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66d51e-d905-4e25-b531-b7bcc1cd5164 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56d2999d0de24f0aa771f50912e53808)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:52.757806 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66d51e-d905-4e25-b531-b7bcc1cd5164 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:52.807084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-bf66d51e-d905-4e25-b531-b7bcc1cd5164 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56d2999d0de24f0aa771f50912e53808', 'request_id': 'req-bf66d51e-d905-4e25-b531-b7bcc1cd5164'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:52.824761 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-bf66d51e-d905-4e25-b531-b7bcc1cd5164 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56d2999d0de24f0aa771f50912e53808', 'request_id': 'req-bf66d51e-d905-4e25-b531-b7bcc1cd5164'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:52.834548 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-bf66d51e-d905-4e25-b531-b7bcc1cd5164 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56d2999d0de24f0aa771f50912e53808', 'request_id': 'req-bf66d51e-d905-4e25-b531-b7bcc1cd5164'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:52.848405 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-bf66d51e-d905-4e25-b531-b7bcc1cd5164 admin admin] The token cache is being invalidate because project 56d2999d0de24f0aa771f50912e53808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:57:52.848694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-bf66d51e-d905-4e25-b531-b7bcc1cd5164 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:52.849336 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-bf66d51e-d905-4e25-b531-b7bcc1cd5164 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:52.851100 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1244/2527] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:57:52 2022] DELETE /identity/v3/projects/56d2999d0de24f0aa771f50912e53808 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:52.856681 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a5d7d-ed4d-4cdd-a732-d70ca81e73c1 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:52.858027 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a5d7d-ed4d-4cdd-a732-d70ca81e73c1 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:52.858315 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a5d7d-ed4d-4cdd-a732-d70ca81e73c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:52.879389 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-737a5d7d-ed4d-4cdd-a732-d70ca81e73c1 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:52.892816 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-737a5d7d-ed4d-4cdd-a732-d70ca81e73c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:52.981988 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1284/2528] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:52.989888 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3ffc9-2724-482f-8c2a-c330eac9b1dd None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:52.990393 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3ffc9-2724-482f-8c2a-c330eac9b1dd None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:52.990778 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3ffc9-2724-482f-8c2a-c330eac9b1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:53.013452 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-58e3ffc9-2724-482f-8c2a-c330eac9b1dd None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:53.015199 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-58e3ffc9-2724-482f-8c2a-c330eac9b1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:53.025224 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1245/2529] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:57:53.029228 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a5d7d-ed4d-4cdd-a732-d70ca81e73c1 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:53.040353 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a5d7d-ed4d-4cdd-a732-d70ca81e73c1 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:53.045845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80022ce9-2cbf-4de0-8b3e-1f7022d7b43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:53.046523 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80022ce9-2cbf-4de0-8b3e-1f7022d7b43a admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:53.046840 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80022ce9-2cbf-4de0-8b3e-1f7022d7b43a admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:53.047115 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80022ce9-2cbf-4de0-8b3e-1f7022d7b43a admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:53.047849 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80022ce9-2cbf-4de0-8b3e-1f7022d7b43a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:57:53.048157 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80022ce9-2cbf-4de0-8b3e-1f7022d7b43a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:53.049916 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80022ce9-2cbf-4de0-8b3e-1f7022d7b43a admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:53.064550 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1285/2530] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:57:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:57:53.068848 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3ffc9-2724-482f-8c2a-c330eac9b1dd None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:53.130561 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3ffc9-2724-482f-8c2a-c330eac9b1dd None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:53.149896 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb00d8f-706f-4a9a-9dbd-2d7238c7265d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:53.151250 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb00d8f-706f-4a9a-9dbd-2d7238c7265d admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:53.151624 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb00d8f-706f-4a9a-9dbd-2d7238c7265d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:53.151818 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb00d8f-706f-4a9a-9dbd-2d7238c7265d admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:53.153370 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb00d8f-706f-4a9a-9dbd-2d7238c7265d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:53.170193 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb00d8f-706f-4a9a-9dbd-2d7238c7265d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:53.221995 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1246/2531] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:57:53 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:57:53.223016 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80022ce9-2cbf-4de0-8b3e-1f7022d7b43a admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:53.244552 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80022ce9-2cbf-4de0-8b3e-1f7022d7b43a admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:53.357138 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ff4ec-396f-447a-aa60-0bfcd9a4c588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:53.357727 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ff4ec-396f-447a-aa60-0bfcd9a4c588 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:53.358014 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ff4ec-396f-447a-aa60-0bfcd9a4c588 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:53.358289 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ff4ec-396f-447a-aa60-0bfcd9a4c588 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:53.359097 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ff4ec-396f-447a-aa60-0bfcd9a4c588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:53.361019 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ff4ec-396f-447a-aa60-0bfcd9a4c588 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:53.386019 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1286/2532] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:57:53 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:57:53.387411 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb00d8f-706f-4a9a-9dbd-2d7238c7265d admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:53.398257 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb00d8f-706f-4a9a-9dbd-2d7238c7265d admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:53.403766 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfed743-2627-4cdc-b25c-a8e654e3ea60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:53.404428 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfed743-2627-4cdc-b25c-a8e654e3ea60 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:53.404714 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfed743-2627-4cdc-b25c-a8e654e3ea60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:53.404992 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfed743-2627-4cdc-b25c-a8e654e3ea60 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:53.405861 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfed743-2627-4cdc-b25c-a8e654e3ea60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:53.407506 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfed743-2627-4cdc-b25c-a8e654e3ea60 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:53.423330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1247/2533] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:57:53.424529 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ff4ec-396f-447a-aa60-0bfcd9a4c588 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:53.434698 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ff4ec-396f-447a-aa60-0bfcd9a4c588 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:53.448646 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab04bf-8579-4757-9e60-e5338fa697d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:53.449529 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab04bf-8579-4757-9e60-e5338fa697d5 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:53.450034 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab04bf-8579-4757-9e60-e5338fa697d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:53.450302 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab04bf-8579-4757-9e60-e5338fa697d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:53.451148 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab04bf-8579-4757-9e60-e5338fa697d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:53.452838 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab04bf-8579-4757-9e60-e5338fa697d5 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:53.466631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1287/2534] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:57:53.469372 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfed743-2627-4cdc-b25c-a8e654e3ea60 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:53.484960 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfed743-2627-4cdc-b25c-a8e654e3ea60 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:53.490844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07362be4-42a5-475c-a59a-87b9cf981f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:53.491742 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07362be4-42a5-475c-a59a-87b9cf981f64 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:53.492023 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07362be4-42a5-475c-a59a-87b9cf981f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:53.492299 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07362be4-42a5-475c-a59a-87b9cf981f64 admin admin] PATH_INFO: `/v3/projects/d030a630b881478d895d3ebb37c0c910/users/131af73a83e4448c8ca5dbb62af53880/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:53.509518 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07362be4-42a5-475c-a59a-87b9cf981f64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d030a630b881478d895d3ebb37c0c910, user_id=131af73a83e4448c8ca5dbb62af53880, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:53.512899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07362be4-42a5-475c-a59a-87b9cf981f64 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:53.533286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1248/2535] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:57:53 2022] PUT /identity/v3/projects/d030a630b881478d895d3ebb37c0c910/users/131af73a83e4448c8ca5dbb62af53880/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:53.544144 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809226b3-fe14-4625-99d8-0f8e95705027 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:53.544566 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809226b3-fe14-4625-99d8-0f8e95705027 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:53.544957 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809226b3-fe14-4625-99d8-0f8e95705027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:53.573503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-809226b3-fe14-4625-99d8-0f8e95705027 None None] MFA Rules not processed for user `131af73a83e4448c8ca5dbb62af53880`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:53.574882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-809226b3-fe14-4625-99d8-0f8e95705027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:53.643837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1288/2536] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:53.648001 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07362be4-42a5-475c-a59a-87b9cf981f64 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:53.712439 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07362be4-42a5-475c-a59a-87b9cf981f64 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:53.717278 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c049b9-300c-4ab8-8219-d3fec93c9873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:53.717931 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c049b9-300c-4ab8-8219-d3fec93c9873 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:53.718215 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c049b9-300c-4ab8-8219-d3fec93c9873 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:53.718493 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c049b9-300c-4ab8-8219-d3fec93c9873 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:53.719246 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c049b9-300c-4ab8-8219-d3fec93c9873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:53.721321 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c049b9-300c-4ab8-8219-d3fec93c9873 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:53.752057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1249/2537] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:57:53 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:57:53.756046 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809226b3-fe14-4625-99d8-0f8e95705027 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:53.767946 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809226b3-fe14-4625-99d8-0f8e95705027 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:53.835166 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54c3bc-2432-4e1b-ba8e-a3c5e81d20c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:53.835855 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54c3bc-2432-4e1b-ba8e-a3c5e81d20c9 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:53.836136 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54c3bc-2432-4e1b-ba8e-a3c5e81d20c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:53.836409 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54c3bc-2432-4e1b-ba8e-a3c5e81d20c9 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:53.837122 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54c3bc-2432-4e1b-ba8e-a3c5e81d20c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:53.839167 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54c3bc-2432-4e1b-ba8e-a3c5e81d20c9 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:53.866640 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1289/2538] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:57:53 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:57:53.868937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c049b9-300c-4ab8-8219-d3fec93c9873 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:53.879565 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c049b9-300c-4ab8-8219-d3fec93c9873 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:53.884256 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a1840-047e-4d51-9146-1a4828d02613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:53.884910 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a1840-047e-4d51-9146-1a4828d02613 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:53.885194 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a1840-047e-4d51-9146-1a4828d02613 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:53.885471 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a1840-047e-4d51-9146-1a4828d02613 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:53.886189 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a1840-047e-4d51-9146-1a4828d02613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:53.888343 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a1840-047e-4d51-9146-1a4828d02613 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:53.899308 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1250/2539] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:57:53.904076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54c3bc-2432-4e1b-ba8e-a3c5e81d20c9 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:53.915485 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54c3bc-2432-4e1b-ba8e-a3c5e81d20c9 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:53.920749 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd644bcd-fd16-4125-9841-7ab251481294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:53.921714 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd644bcd-fd16-4125-9841-7ab251481294 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:53.922010 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd644bcd-fd16-4125-9841-7ab251481294 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:53.922280 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd644bcd-fd16-4125-9841-7ab251481294 admin admin] PATH_INFO: `/v3/projects/e16559e9fa7044ada086f22da3cc6daa/users/94b0bd95ec514a349fd5000d97a4eec8/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:53.938699 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd644bcd-fd16-4125-9841-7ab251481294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e16559e9fa7044ada086f22da3cc6daa, user_id=94b0bd95ec514a349fd5000d97a4eec8, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:53.941347 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd644bcd-fd16-4125-9841-7ab251481294 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:53.955100 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1290/2540] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:57:53 2022] PUT /identity/v3/projects/e16559e9fa7044ada086f22da3cc6daa/users/94b0bd95ec514a349fd5000d97a4eec8/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:53.959433 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a1840-047e-4d51-9146-1a4828d02613 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:53.969568 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a1840-047e-4d51-9146-1a4828d02613 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:54.028082 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b071746-9bda-4d55-aae7-288d5bf0c9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:54.028800 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b071746-9bda-4d55-aae7-288d5bf0c9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:54.029197 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b071746-9bda-4d55-aae7-288d5bf0c9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:54.029478 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b071746-9bda-4d55-aae7-288d5bf0c9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:54.030386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b071746-9bda-4d55-aae7-288d5bf0c9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:54.032041 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b071746-9bda-4d55-aae7-288d5bf0c9f5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:54.042605 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1251/2541] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:57:53 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:57:54.046905 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd644bcd-fd16-4125-9841-7ab251481294 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:54.059049 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd644bcd-fd16-4125-9841-7ab251481294 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:54.064410 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed86fd-a8d1-449d-97e9-4e7f2bc9b685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:54.065301 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed86fd-a8d1-449d-97e9-4e7f2bc9b685 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:54.065579 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed86fd-a8d1-449d-97e9-4e7f2bc9b685 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:54.065850 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed86fd-a8d1-449d-97e9-4e7f2bc9b685 admin admin] PATH_INFO: `/v3/projects/e16559e9fa7044ada086f22da3cc6daa/users/94b0bd95ec514a349fd5000d97a4eec8/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:54.067844 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed86fd-a8d1-449d-97e9-4e7f2bc9b685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e16559e9fa7044ada086f22da3cc6daa, user_id=94b0bd95ec514a349fd5000d97a4eec8, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:54.070490 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed86fd-a8d1-449d-97e9-4e7f2bc9b685 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:54.093889 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1291/2542] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:57:54 2022] PUT /identity/v3/projects/e16559e9fa7044ada086f22da3cc6daa/users/94b0bd95ec514a349fd5000d97a4eec8/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:54.104433 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6debe-d5c8-4af8-afba-7b2c72df8996 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:54.104433 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6debe-d5c8-4af8-afba-7b2c72df8996 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:54.105019 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6debe-d5c8-4af8-afba-7b2c72df8996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:54.147930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-74f6debe-d5c8-4af8-afba-7b2c72df8996 None None] MFA Rules not processed for user `94b0bd95ec514a349fd5000d97a4eec8`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:54.149427 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-74f6debe-d5c8-4af8-afba-7b2c72df8996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:54.264594 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1252/2543] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:54.272370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed86fd-a8d1-449d-97e9-4e7f2bc9b685 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:54.274295 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-c9ed86fd-a8d1-449d-97e9-4e7f2bc9b685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:54.344269 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed86fd-a8d1-449d-97e9-4e7f2bc9b685 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:54.361786 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07804a1b-c078-40c8-a0ef-7c562f03ade2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:54.362791 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07804a1b-c078-40c8-a0ef-7c562f03ade2 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:54.363245 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07804a1b-c078-40c8-a0ef-7c562f03ade2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:54.363671 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07804a1b-c078-40c8-a0ef-7c562f03ade2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:54.382986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07804a1b-c078-40c8-a0ef-7c562f03ade2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:54.392931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07804a1b-c078-40c8-a0ef-7c562f03ade2 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:54.395203 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1292/2544] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:57:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:57:54.837455 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6debe-d5c8-4af8-afba-7b2c72df8996 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:54.849032 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6debe-d5c8-4af8-afba-7b2c72df8996 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:54.853561 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aef528-75c3-4e8e-a696-dd5983a1ebd2 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b0bd95ec514a349fd5000d97a4eec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16559e9fa7044ada086f22da3cc6daa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:54.854210 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aef528-75c3-4e8e-a696-dd5983a1ebd2 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:54.854498 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aef528-75c3-4e8e-a696-dd5983a1ebd2 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:54.854808 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aef528-75c3-4e8e-a696-dd5983a1ebd2 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:54.855589 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aef528-75c3-4e8e-a696-dd5983a1ebd2 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:57:54.855892 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aef528-75c3-4e8e-a696-dd5983a1ebd2 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:54.857475 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aef528-75c3-4e8e-a696-dd5983a1ebd2 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:54.870772 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1253/2545] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:57:54.875056 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07804a1b-c078-40c8-a0ef-7c562f03ade2 service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:54.884288 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07804a1b-c078-40c8-a0ef-7c562f03ade2 service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:54.889442 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582fb70-bbb5-4e50-8d1b-dc9d23f3b877 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b0bd95ec514a349fd5000d97a4eec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16559e9fa7044ada086f22da3cc6daa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:54.890050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582fb70-bbb5-4e50-8d1b-dc9d23f3b877 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:54.890335 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582fb70-bbb5-4e50-8d1b-dc9d23f3b877 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:54.890630 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582fb70-bbb5-4e50-8d1b-dc9d23f3b877 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:54.891323 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582fb70-bbb5-4e50-8d1b-dc9d23f3b877 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:54.893230 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7582fb70-bbb5-4e50-8d1b-dc9d23f3b877 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:54.923880 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1293/2546] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:57:54 2022] POST /identity/v3/projects => generated 353 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:57:54.925401 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aef528-75c3-4e8e-a696-dd5983a1ebd2 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:54.936004 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aef528-75c3-4e8e-a696-dd5983a1ebd2 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:55.011302 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9296fa-e274-4b40-af79-900b57b41c55 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b0bd95ec514a349fd5000d97a4eec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16559e9fa7044ada086f22da3cc6daa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:55.012530 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9296fa-e274-4b40-af79-900b57b41c55 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:55.012800 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9296fa-e274-4b40-af79-900b57b41c55 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:55.013080 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9296fa-e274-4b40-af79-900b57b41c55 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:55.013835 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9296fa-e274-4b40-af79-900b57b41c55 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:57:55.014146 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9296fa-e274-4b40-af79-900b57b41c55 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:55.015800 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9296fa-e274-4b40-af79-900b57b41c55 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:55.031202 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1254/2547] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:57:55.069475 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582fb70-bbb5-4e50-8d1b-dc9d23f3b877 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:55.079743 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7582fb70-bbb5-4e50-8d1b-dc9d23f3b877 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:55.084516 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ea3f0-9529-4515-bf66-a6ca120c64b6 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94b0bd95ec514a349fd5000d97a4eec8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e16559e9fa7044ada086f22da3cc6daa', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:55.085387 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ea3f0-9529-4515-bf66-a6ca120c64b6 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:55.085691 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ea3f0-9529-4515-bf66-a6ca120c64b6 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:55.085928 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ea3f0-9529-4515-bf66-a6ca120c64b6 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] PATH_INFO: `/v3/projects/8f49432d1e7d4b81a13a51b7e9361be0` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:55.088055 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ea3f0-9529-4515-bf66-a6ca120c64b6 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8f49432d1e7d4b81a13a51b7e9361be0)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:55.090004 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ea3f0-9529-4515-bf66-a6ca120c64b6 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:55.138175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-820ea3f0-9529-4515-bf66-a6ca120c64b6 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f49432d1e7d4b81a13a51b7e9361be0', 'request_id': 'req-820ea3f0-9529-4515-bf66-a6ca120c64b6'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:55.143848 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-820ea3f0-9529-4515-bf66-a6ca120c64b6 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f49432d1e7d4b81a13a51b7e9361be0', 'request_id': 'req-820ea3f0-9529-4515-bf66-a6ca120c64b6'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:55.150111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-820ea3f0-9529-4515-bf66-a6ca120c64b6 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f49432d1e7d4b81a13a51b7e9361be0', 'request_id': 'req-820ea3f0-9529-4515-bf66-a6ca120c64b6'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:55.162919 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-820ea3f0-9529-4515-bf66-a6ca120c64b6 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] The token cache is being invalidate because project 8f49432d1e7d4b81a13a51b7e9361be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:57:55.163208 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-820ea3f0-9529-4515-bf66-a6ca120c64b6 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:55.163866 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-820ea3f0-9529-4515-bf66-a6ca120c64b6 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:55.166641 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1294/2548] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:57:55 2022] DELETE /identity/v3/projects/8f49432d1e7d4b81a13a51b7e9361be0 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:55.374449 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9296fa-e274-4b40-af79-900b57b41c55 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:55.376374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7e9296fa-e274-4b40-af79-900b57b41c55 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:55.452561 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9296fa-e274-4b40-af79-900b57b41c55 tempest-VolumeQuotaClassesTest-388669719 tempest-VolumeQuotaClassesTest-388669719-project-admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:55.539024 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c000a44-8c2d-4bb8-aa19-ec39f62cf131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:55.545951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c000a44-8c2d-4bb8-aa19-ec39f62cf131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:55.545951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c000a44-8c2d-4bb8-aa19-ec39f62cf131 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:55.545951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c000a44-8c2d-4bb8-aa19-ec39f62cf131 admin admin] PATH_INFO: `/v3/users/131af73a83e4448c8ca5dbb62af53880` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:55.545951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c000a44-8c2d-4bb8-aa19-ec39f62cf131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=131af73a83e4448c8ca5dbb62af53880)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:55.552338 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c000a44-8c2d-4bb8-aa19-ec39f62cf131 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:55.614637 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3c000a44-8c2d-4bb8-aa19-ec39f62cf131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131af73a83e4448c8ca5dbb62af53880'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:55.625130 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3c000a44-8c2d-4bb8-aa19-ec39f62cf131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131af73a83e4448c8ca5dbb62af53880'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:55.625835 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3c000a44-8c2d-4bb8-aa19-ec39f62cf131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131af73a83e4448c8ca5dbb62af53880'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:55.648773 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3c000a44-8c2d-4bb8-aa19-ec39f62cf131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131af73a83e4448c8ca5dbb62af53880'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:55.672178 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3c000a44-8c2d-4bb8-aa19-ec39f62cf131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131af73a83e4448c8ca5dbb62af53880'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:55.680943 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1255/2549] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:57:55 2022] DELETE /identity/v3/users/131af73a83e4448c8ca5dbb62af53880 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:55.690574 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f9abf-b95a-4abf-a441-639807cede83 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:55.690908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f9abf-b95a-4abf-a441-639807cede83 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:55.691162 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f9abf-b95a-4abf-a441-639807cede83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:55.712435 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-263f9abf-b95a-4abf-a441-639807cede83 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:55.713884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-263f9abf-b95a-4abf-a441-639807cede83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:55.789716 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1295/2550] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:55.799862 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c000a44-8c2d-4bb8-aa19-ec39f62cf131 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:55.801951 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3c000a44-8c2d-4bb8-aa19-ec39f62cf131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:55.873628 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c000a44-8c2d-4bb8-aa19-ec39f62cf131 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:55.877357 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62da42-e0ac-4125-8b99-316e38c382ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:55.877999 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62da42-e0ac-4125-8b99-316e38c382ea service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:55.878284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62da42-e0ac-4125-8b99-316e38c382ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:55.878558 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62da42-e0ac-4125-8b99-316e38c382ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:55.889051 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62da42-e0ac-4125-8b99-316e38c382ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:55.890489 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62da42-e0ac-4125-8b99-316e38c382ea service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:55.903595 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1256/2551] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:57:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:57:56.203430 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f9abf-b95a-4abf-a441-639807cede83 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:56.204868 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-263f9abf-b95a-4abf-a441-639807cede83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:56.226178 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f9abf-b95a-4abf-a441-639807cede83 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:56.240980 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88795f87-ae7b-474f-bd08-49cb7562d348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:56.242085 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88795f87-ae7b-474f-bd08-49cb7562d348 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:56.242365 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88795f87-ae7b-474f-bd08-49cb7562d348 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:56.242670 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88795f87-ae7b-474f-bd08-49cb7562d348 admin admin] PATH_INFO: `/v3/projects/d030a630b881478d895d3ebb37c0c910` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:56.244001 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88795f87-ae7b-474f-bd08-49cb7562d348 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d030a630b881478d895d3ebb37c0c910)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:56.246458 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88795f87-ae7b-474f-bd08-49cb7562d348 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:56.296910 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-88795f87-ae7b-474f-bd08-49cb7562d348 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd030a630b881478d895d3ebb37c0c910', 'request_id': 'req-88795f87-ae7b-474f-bd08-49cb7562d348'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:56.303035 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-88795f87-ae7b-474f-bd08-49cb7562d348 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd030a630b881478d895d3ebb37c0c910', 'request_id': 'req-88795f87-ae7b-474f-bd08-49cb7562d348'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:56.310823 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-88795f87-ae7b-474f-bd08-49cb7562d348 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd030a630b881478d895d3ebb37c0c910', 'request_id': 'req-88795f87-ae7b-474f-bd08-49cb7562d348'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:56.323581 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-88795f87-ae7b-474f-bd08-49cb7562d348 admin admin] The token cache is being invalidate because project d030a630b881478d895d3ebb37c0c910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:57:56.324524 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-88795f87-ae7b-474f-bd08-49cb7562d348 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:56.325242 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-88795f87-ae7b-474f-bd08-49cb7562d348 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:56.327219 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1296/2552] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:57:56 2022] DELETE /identity/v3/projects/d030a630b881478d895d3ebb37c0c910 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:56.331056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62da42-e0ac-4125-8b99-316e38c382ea service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:56.340629 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62da42-e0ac-4125-8b99-316e38c382ea service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:56.397901 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976a8f7-6919-491b-894e-4464ba2c52a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:56.398710 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976a8f7-6919-491b-894e-4464ba2c52a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:56.398990 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976a8f7-6919-491b-894e-4464ba2c52a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:56.399259 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976a8f7-6919-491b-894e-4464ba2c52a5 admin admin] PATH_INFO: `/v3/users/94b0bd95ec514a349fd5000d97a4eec8` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:56.400415 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976a8f7-6919-491b-894e-4464ba2c52a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94b0bd95ec514a349fd5000d97a4eec8)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:56.402339 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976a8f7-6919-491b-894e-4464ba2c52a5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:56.448198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a976a8f7-6919-491b-894e-4464ba2c52a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94b0bd95ec514a349fd5000d97a4eec8'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:56.455491 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a976a8f7-6919-491b-894e-4464ba2c52a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94b0bd95ec514a349fd5000d97a4eec8'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:56.456095 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a976a8f7-6919-491b-894e-4464ba2c52a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94b0bd95ec514a349fd5000d97a4eec8'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:56.462612 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a976a8f7-6919-491b-894e-4464ba2c52a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94b0bd95ec514a349fd5000d97a4eec8'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:56.474693 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a976a8f7-6919-491b-894e-4464ba2c52a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94b0bd95ec514a349fd5000d97a4eec8'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:56.480656 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1257/2553] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:57:56 2022] DELETE /identity/v3/users/94b0bd95ec514a349fd5000d97a4eec8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:56.754026 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88795f87-ae7b-474f-bd08-49cb7562d348 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:56.755575 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-88795f87-ae7b-474f-bd08-49cb7562d348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:56.769483 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88795f87-ae7b-474f-bd08-49cb7562d348 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:56.827146 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44124b79-f9f1-4207-bd85-4fd0176a068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:56.828003 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44124b79-f9f1-4207-bd85-4fd0176a068d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:56.828283 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44124b79-f9f1-4207-bd85-4fd0176a068d admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:56.828552 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44124b79-f9f1-4207-bd85-4fd0176a068d admin admin] PATH_INFO: `/v3/projects/e16559e9fa7044ada086f22da3cc6daa` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:56.829730 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44124b79-f9f1-4207-bd85-4fd0176a068d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e16559e9fa7044ada086f22da3cc6daa)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:56.831708 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44124b79-f9f1-4207-bd85-4fd0176a068d admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:56.877871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-44124b79-f9f1-4207-bd85-4fd0176a068d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e16559e9fa7044ada086f22da3cc6daa', 'request_id': 'req-44124b79-f9f1-4207-bd85-4fd0176a068d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:56.885581 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-44124b79-f9f1-4207-bd85-4fd0176a068d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e16559e9fa7044ada086f22da3cc6daa', 'request_id': 'req-44124b79-f9f1-4207-bd85-4fd0176a068d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:56.892059 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-44124b79-f9f1-4207-bd85-4fd0176a068d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e16559e9fa7044ada086f22da3cc6daa', 'request_id': 'req-44124b79-f9f1-4207-bd85-4fd0176a068d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:56.912292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-44124b79-f9f1-4207-bd85-4fd0176a068d admin admin] The token cache is being invalidate because project e16559e9fa7044ada086f22da3cc6daa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:57:56.912811 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-44124b79-f9f1-4207-bd85-4fd0176a068d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:56.914130 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-44124b79-f9f1-4207-bd85-4fd0176a068d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:57:56.918673 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1297/2554] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:57:56 2022] DELETE /identity/v3/projects/e16559e9fa7044ada086f22da3cc6daa => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:56.922046 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71b218-a453-4775-9c44-9e63a66a113d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:56.922347 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71b218-a453-4775-9c44-9e63a66a113d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:56.922635 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c71b218-a453-4775-9c44-9e63a66a113d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:56.941501 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-3c71b218-a453-4775-9c44-9e63a66a113d None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:56.942633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3c71b218-a453-4775-9c44-9e63a66a113d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:57.013473 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1258/2555] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:57.021585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34722c13-bda7-41ff-817a-eecc3034bc58 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:57.021877 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34722c13-bda7-41ff-817a-eecc3034bc58 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:57.022153 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34722c13-bda7-41ff-817a-eecc3034bc58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:57.040622 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-34722c13-bda7-41ff-817a-eecc3034bc58 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:57.041832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-34722c13-bda7-41ff-817a-eecc3034bc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:57.050359 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1298/2556] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:57.054560 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71b218-a453-4775-9c44-9e63a66a113d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:57.064531 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c71b218-a453-4775-9c44-9e63a66a113d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:57.069200 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984ab18-10c2-415f-8e1f-270f6edd1b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:57.069848 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984ab18-10c2-415f-8e1f-270f6edd1b7e admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:57.070131 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984ab18-10c2-415f-8e1f-270f6edd1b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:57.070409 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984ab18-10c2-415f-8e1f-270f6edd1b7e admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:57.071194 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984ab18-10c2-415f-8e1f-270f6edd1b7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:57:57.071505 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984ab18-10c2-415f-8e1f-270f6edd1b7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:57.073167 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984ab18-10c2-415f-8e1f-270f6edd1b7e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:57.084540 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1259/2557] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:57:57.088828 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34722c13-bda7-41ff-817a-eecc3034bc58 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:57.098536 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34722c13-bda7-41ff-817a-eecc3034bc58 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:57.103265 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c4f71-1a34-45d7-ab33-f07794111cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:57.104746 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c4f71-1a34-45d7-ab33-f07794111cc0 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:57.105044 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c4f71-1a34-45d7-ab33-f07794111cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:57.105966 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c4f71-1a34-45d7-ab33-f07794111cc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:57.106717 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c4f71-1a34-45d7-ab33-f07794111cc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:57.108726 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c4f71-1a34-45d7-ab33-f07794111cc0 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:57.137820 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1299/2558] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:57:57 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:57:57.139113 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984ab18-10c2-415f-8e1f-270f6edd1b7e admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:57.149159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984ab18-10c2-415f-8e1f-270f6edd1b7e admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:57.210454 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ce7c5-b5e3-4d05-b072-44ed8030d4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:57.211215 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ce7c5-b5e3-4d05-b072-44ed8030d4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:57.211504 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ce7c5-b5e3-4d05-b072-44ed8030d4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:57.211768 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104ce7c5-b5e3-4d05-b072-44ed8030d4c1 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:57.212480 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ce7c5-b5e3-4d05-b072-44ed8030d4c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:57.214987 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104ce7c5-b5e3-4d05-b072-44ed8030d4c1 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:57.235299 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1260/2559] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:57:57 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:57:57.239511 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c4f71-1a34-45d7-ab33-f07794111cc0 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:57.250107 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c4f71-1a34-45d7-ab33-f07794111cc0 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:57.255073 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c523503-990d-4da7-a028-e6966d68a546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:57.255772 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c523503-990d-4da7-a028-e6966d68a546 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:57.256075 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c523503-990d-4da7-a028-e6966d68a546 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:57.256351 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c523503-990d-4da7-a028-e6966d68a546 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:57.257150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c523503-990d-4da7-a028-e6966d68a546 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:57.258837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c523503-990d-4da7-a028-e6966d68a546 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:57.269658 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1300/2560] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:57:57.273498 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ce7c5-b5e3-4d05-b072-44ed8030d4c1 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:57.283347 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104ce7c5-b5e3-4d05-b072-44ed8030d4c1 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:57.287991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6cc4e-e09a-42e9-a6af-28441655242e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:57.288634 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6cc4e-e09a-42e9-a6af-28441655242e admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:57.288922 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6cc4e-e09a-42e9-a6af-28441655242e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:57.289198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6cc4e-e09a-42e9-a6af-28441655242e admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:57.289915 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6cc4e-e09a-42e9-a6af-28441655242e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:57.291517 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6cc4e-e09a-42e9-a6af-28441655242e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:57.301568 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1261/2561] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:57:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:57:57.305747 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c523503-990d-4da7-a028-e6966d68a546 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:57.316075 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c523503-990d-4da7-a028-e6966d68a546 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:57.320675 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2c72f-3746-4e6b-9b6c-ed0399ddc8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:57.321536 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2c72f-3746-4e6b-9b6c-ed0399ddc8af admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:57.321821 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2c72f-3746-4e6b-9b6c-ed0399ddc8af admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:57.322100 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2c72f-3746-4e6b-9b6c-ed0399ddc8af admin admin] PATH_INFO: `/v3/projects/fec184e18d28432aa1f12deb263cb36d/users/cd3cffd5c7d34183bb8379d9c63a921e/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:57.336040 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2c72f-3746-4e6b-9b6c-ed0399ddc8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec184e18d28432aa1f12deb263cb36d, user_id=cd3cffd5c7d34183bb8379d9c63a921e, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:57.338701 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2c72f-3746-4e6b-9b6c-ed0399ddc8af admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:57.350562 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1301/2562] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:57:57 2022] PUT /identity/v3/projects/fec184e18d28432aa1f12deb263cb36d/users/cd3cffd5c7d34183bb8379d9c63a921e/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:57:57.361006 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8a9e4-9e1e-4ba7-9127-b29dce3408c0 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:57.361494 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8a9e4-9e1e-4ba7-9127-b29dce3408c0 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:57.361589 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f8a9e4-9e1e-4ba7-9127-b29dce3408c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:57.387636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c4f8a9e4-9e1e-4ba7-9127-b29dce3408c0 None None] MFA Rules not processed for user `cd3cffd5c7d34183bb8379d9c63a921e`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:57:57.388855 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c4f8a9e4-9e1e-4ba7-9127-b29dce3408c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:57.450451 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1262/2563] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:57:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:57:57.460980 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2c72f-3746-4e6b-9b6c-ed0399ddc8af admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:57:57.462629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4fb2c72f-3746-4e6b-9b6c-ed0399ddc8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:57:57.516865 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2c72f-3746-4e6b-9b6c-ed0399ddc8af admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:57:57.520529 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28896fd8-e72b-4c85-8019-8b97a605c11c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:57:57.521173 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28896fd8-e72b-4c85-8019-8b97a605c11c service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:57:57.521455 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28896fd8-e72b-4c85-8019-8b97a605c11c service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:57:57.521731 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28896fd8-e72b-4c85-8019-8b97a605c11c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:57:57.529868 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28896fd8-e72b-4c85-8019-8b97a605c11c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:57:57.531330 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28896fd8-e72b-4c85-8019-8b97a605c11c service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:57:57.539851 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1302/2564] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:57:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:58:04.907729 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8a9e4-9e1e-4ba7-9127-b29dce3408c0 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:04.971493 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f8a9e4-9e1e-4ba7-9127-b29dce3408c0 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:04.976341 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17618d-cd3b-4bb1-ba96-8dc4d5d55d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:04.977239 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17618d-cd3b-4bb1-ba96-8dc4d5d55d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:04.977526 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17618d-cd3b-4bb1-ba96-8dc4d5d55d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:04.977831 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17618d-cd3b-4bb1-ba96-8dc4d5d55d4d admin admin] PATH_INFO: `/v3/users/cd3cffd5c7d34183bb8379d9c63a921e` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:04.979324 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17618d-cd3b-4bb1-ba96-8dc4d5d55d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3cffd5c7d34183bb8379d9c63a921e)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:04.981622 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17618d-cd3b-4bb1-ba96-8dc4d5d55d4d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:05.028826 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5c17618d-cd3b-4bb1-ba96-8dc4d5d55d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3cffd5c7d34183bb8379d9c63a921e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:05.036761 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5c17618d-cd3b-4bb1-ba96-8dc4d5d55d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3cffd5c7d34183bb8379d9c63a921e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:05.037387 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5c17618d-cd3b-4bb1-ba96-8dc4d5d55d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3cffd5c7d34183bb8379d9c63a921e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:05.044800 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5c17618d-cd3b-4bb1-ba96-8dc4d5d55d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3cffd5c7d34183bb8379d9c63a921e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:05.056234 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5c17618d-cd3b-4bb1-ba96-8dc4d5d55d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3cffd5c7d34183bb8379d9c63a921e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:05.062201 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1263/2565] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:58:04 2022] DELETE /identity/v3/users/cd3cffd5c7d34183bb8379d9c63a921e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:05.067087 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d507f-469c-4c1b-b783-262d8edb8059 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:05.067562 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d507f-469c-4c1b-b783-262d8edb8059 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:05.067764 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469d507f-469c-4c1b-b783-262d8edb8059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:05.086135 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-469d507f-469c-4c1b-b783-262d8edb8059 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:05.087431 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-469d507f-469c-4c1b-b783-262d8edb8059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:05.168985 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1303/2566] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:05.180809 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17618d-cd3b-4bb1-ba96-8dc4d5d55d4d admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:05.182738 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5c17618d-cd3b-4bb1-ba96-8dc4d5d55d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:05.246585 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17618d-cd3b-4bb1-ba96-8dc4d5d55d4d admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:05.250705 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3d84b-674b-4481-9926-ef9a18fc6f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:05.251566 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3d84b-674b-4481-9926-ef9a18fc6f3d service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:05.251988 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3d84b-674b-4481-9926-ef9a18fc6f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:05.252420 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3d84b-674b-4481-9926-ef9a18fc6f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:05.266689 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3d84b-674b-4481-9926-ef9a18fc6f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:05.268219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3d84b-674b-4481-9926-ef9a18fc6f3d service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:05.281029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1264/2567] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:58:05.361375 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe7786-3aa4-44b0-bcdd-a27a205572da None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:05.361833 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe7786-3aa4-44b0-bcdd-a27a205572da None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:05.362185 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe7786-3aa4-44b0-bcdd-a27a205572da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:05.395702 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-62fe7786-3aa4-44b0-bcdd-a27a205572da None None] MFA Rules not processed for user `e0653575c0a24603bb9287e6222313de`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:05.402173 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-62fe7786-3aa4-44b0-bcdd-a27a205572da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:05.517376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1304/2568] 10.222.0.73 () {58 vars in 967 bytes} [Mon Apr 11 16:58:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:05.532455 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3d84b-674b-4481-9926-ef9a18fc6f3d service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:05.533935 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3bf3d84b-674b-4481-9926-ef9a18fc6f3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:05.615754 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3d84b-674b-4481-9926-ef9a18fc6f3d service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:05.625042 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace8c53-e7ea-472d-94eb-f276a17ea95a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6659c6661840a79ba9ff1c3c9e93c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:05.626158 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace8c53-e7ea-472d-94eb-f276a17ea95a service swift] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:05.626158 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace8c53-e7ea-472d-94eb-f276a17ea95a service swift] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:05.626363 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace8c53-e7ea-472d-94eb-f276a17ea95a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:05.635872 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace8c53-e7ea-472d-94eb-f276a17ea95a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:05.637467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace8c53-e7ea-472d-94eb-f276a17ea95a service swift] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:05.648645 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1265/2569] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Apr 11 16:58:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 16:58:05.753972 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe7786-3aa4-44b0-bcdd-a27a205572da None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:05.755667 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-62fe7786-3aa4-44b0-bcdd-a27a205572da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:05.780986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe7786-3aa4-44b0-bcdd-a27a205572da None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:05.786649 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b947f42-3418-4cc0-9415-51989a83f522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:05.787814 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b947f42-3418-4cc0-9415-51989a83f522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:05.788160 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b947f42-3418-4cc0-9415-51989a83f522 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:05.788665 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b947f42-3418-4cc0-9415-51989a83f522 admin admin] PATH_INFO: `/v3/projects/fec184e18d28432aa1f12deb263cb36d` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:05.790473 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b947f42-3418-4cc0-9415-51989a83f522 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec184e18d28432aa1f12deb263cb36d)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:05.793302 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b947f42-3418-4cc0-9415-51989a83f522 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:05.909336 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6b947f42-3418-4cc0-9415-51989a83f522 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec184e18d28432aa1f12deb263cb36d', 'request_id': 'req-6b947f42-3418-4cc0-9415-51989a83f522'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:05.916107 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6b947f42-3418-4cc0-9415-51989a83f522 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec184e18d28432aa1f12deb263cb36d', 'request_id': 'req-6b947f42-3418-4cc0-9415-51989a83f522'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:05.927464 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6b947f42-3418-4cc0-9415-51989a83f522 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec184e18d28432aa1f12deb263cb36d', 'request_id': 'req-6b947f42-3418-4cc0-9415-51989a83f522'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:05.947192 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6b947f42-3418-4cc0-9415-51989a83f522 admin admin] The token cache is being invalidate because project fec184e18d28432aa1f12deb263cb36d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:58:05.947519 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6b947f42-3418-4cc0-9415-51989a83f522 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:05.949129 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6b947f42-3418-4cc0-9415-51989a83f522 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:05.951718 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1305/2570] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:58:05 2022] DELETE /identity/v3/projects/fec184e18d28432aa1f12deb263cb36d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:05.956445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c71c6-1800-4982-b2bb-1609d4ad7141 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:05.957220 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c71c6-1800-4982-b2bb-1609d4ad7141 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:05.957624 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c71c6-1800-4982-b2bb-1609d4ad7141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:05.985458 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b00c71c6-1800-4982-b2bb-1609d4ad7141 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:05.987261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b00c71c6-1800-4982-b2bb-1609d4ad7141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:06.071107 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1266/2571] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:58:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:06.079677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c3c47-11ca-4c51-a441-86b6f8c169bd None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:06.081070 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c3c47-11ca-4c51-a441-86b6f8c169bd None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:06.081794 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c3c47-11ca-4c51-a441-86b6f8c169bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:06.107795 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-b36c3c47-11ca-4c51-a441-86b6f8c169bd None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:06.109299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b36c3c47-11ca-4c51-a441-86b6f8c169bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:06.121440 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1306/2572] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:06.125415 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c71c6-1800-4982-b2bb-1609d4ad7141 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:06.136528 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c71c6-1800-4982-b2bb-1609d4ad7141 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:06.141405 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d9fb7-1308-4137-91d0-bb5df6fd35ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:06.142071 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d9fb7-1308-4137-91d0-bb5df6fd35ae admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:06.142352 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d9fb7-1308-4137-91d0-bb5df6fd35ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:06.142708 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d9fb7-1308-4137-91d0-bb5df6fd35ae admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:06.143441 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d9fb7-1308-4137-91d0-bb5df6fd35ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:58:06.143748 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d9fb7-1308-4137-91d0-bb5df6fd35ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:06.145407 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d9fb7-1308-4137-91d0-bb5df6fd35ae admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:06.163048 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1267/2573] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:58:06.165158 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c3c47-11ca-4c51-a441-86b6f8c169bd None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:06.177476 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c3c47-11ca-4c51-a441-86b6f8c169bd None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:06.184272 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044df4c-f269-4f67-920c-9aad3b3a6b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:06.188689 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044df4c-f269-4f67-920c-9aad3b3a6b4d admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:06.189578 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044df4c-f269-4f67-920c-9aad3b3a6b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:06.190015 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044df4c-f269-4f67-920c-9aad3b3a6b4d admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:06.191588 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044df4c-f269-4f67-920c-9aad3b3a6b4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:06.193571 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a044df4c-f269-4f67-920c-9aad3b3a6b4d admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:06.254229 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1307/2574] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:58:06 2022] POST /identity/v3/projects => generated 359 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:58:06.255782 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d9fb7-1308-4137-91d0-bb5df6fd35ae admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:06.269082 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d9fb7-1308-4137-91d0-bb5df6fd35ae admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:06.341637 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229cfaf-0c8f-431a-a3a8-c4609119b378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:06.342327 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229cfaf-0c8f-431a-a3a8-c4609119b378 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:06.342683 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229cfaf-0c8f-431a-a3a8-c4609119b378 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:06.342963 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229cfaf-0c8f-431a-a3a8-c4609119b378 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:06.344554 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229cfaf-0c8f-431a-a3a8-c4609119b378 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:06.347280 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8229cfaf-0c8f-431a-a3a8-c4609119b378 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:06.376892 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1268/2575] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:58:06 2022] POST /identity/v3/users => generated 280 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:58:06.378840 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044df4c-f269-4f67-920c-9aad3b3a6b4d admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:06.391643 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044df4c-f269-4f67-920c-9aad3b3a6b4d admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:06.397845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178c487-0c6a-4070-803f-6619b65e9209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:06.398743 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178c487-0c6a-4070-803f-6619b65e9209 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:06.399164 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178c487-0c6a-4070-803f-6619b65e9209 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:06.399812 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178c487-0c6a-4070-803f-6619b65e9209 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:06.400537 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178c487-0c6a-4070-803f-6619b65e9209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:06.403459 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178c487-0c6a-4070-803f-6619b65e9209 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:06.417942 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1308/2576] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:58:06.422538 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229cfaf-0c8f-431a-a3a8-c4609119b378 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:06.434351 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229cfaf-0c8f-431a-a3a8-c4609119b378 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:06.440627 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7906b3-a7da-4826-a1f2-6368203e7f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:06.441586 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7906b3-a7da-4826-a1f2-6368203e7f2e admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:06.441938 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7906b3-a7da-4826-a1f2-6368203e7f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:06.442219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7906b3-a7da-4826-a1f2-6368203e7f2e admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:06.443068 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7906b3-a7da-4826-a1f2-6368203e7f2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:06.444712 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7906b3-a7da-4826-a1f2-6368203e7f2e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:06.460069 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1269/2577] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:58:06.462209 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178c487-0c6a-4070-803f-6619b65e9209 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:06.474750 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178c487-0c6a-4070-803f-6619b65e9209 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:06.481135 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76733f-3335-432c-8781-f5d909565a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:06.482126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76733f-3335-432c-8781-f5d909565a6a admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:06.482412 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76733f-3335-432c-8781-f5d909565a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:06.482796 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76733f-3335-432c-8781-f5d909565a6a admin admin] PATH_INFO: `/v3/projects/80884bebb113474799992dc115deb4df/users/58f2344f59ba4e3784e1092917d9462f/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:06.505544 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76733f-3335-432c-8781-f5d909565a6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80884bebb113474799992dc115deb4df, user_id=58f2344f59ba4e3784e1092917d9462f, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:06.510022 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76733f-3335-432c-8781-f5d909565a6a admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:06.539349 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1309/2578] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:58:06 2022] PUT /identity/v3/projects/80884bebb113474799992dc115deb4df/users/58f2344f59ba4e3784e1092917d9462f/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:58:06.544321 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a951c7f-065e-4f48-a305-62d33242e186 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:06.544613 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a951c7f-065e-4f48-a305-62d33242e186 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:06.544897 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a951c7f-065e-4f48-a305-62d33242e186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:06.573736 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-9a951c7f-065e-4f48-a305-62d33242e186 None None] MFA Rules not processed for user `58f2344f59ba4e3784e1092917d9462f`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:06.575502 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9a951c7f-065e-4f48-a305-62d33242e186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:06.645720 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1270/2579] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:58:06 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:06.684752 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76733f-3335-432c-8781-f5d909565a6a admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:06.686823 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-9e76733f-3335-432c-8781-f5d909565a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:06.763108 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76733f-3335-432c-8781-f5d909565a6a admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:06.766875 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1b8a3b-08ad-40a7-9b64-dde23906588d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:06.767533 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b8a3b-08ad-40a7-9b64-dde23906588d service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:06.767820 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b8a3b-08ad-40a7-9b64-dde23906588d service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:06.768099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1b8a3b-08ad-40a7-9b64-dde23906588d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:06.777338 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b8a3b-08ad-40a7-9b64-dde23906588d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:06.778518 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1b8a3b-08ad-40a7-9b64-dde23906588d service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:06.787881 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1310/2580] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:58:06 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:58:06.803844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a951c7f-065e-4f48-a305-62d33242e186 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:06.868106 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a951c7f-065e-4f48-a305-62d33242e186 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:06.873242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d6026-1651-4446-a2c0-f937fd78e079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:06.874159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d6026-1651-4446-a2c0-f937fd78e079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:06.874426 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d6026-1651-4446-a2c0-f937fd78e079 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:06.874754 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d6026-1651-4446-a2c0-f937fd78e079 admin admin] PATH_INFO: `/v3/users/58f2344f59ba4e3784e1092917d9462f` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:06.875966 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d6026-1651-4446-a2c0-f937fd78e079 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f2344f59ba4e3784e1092917d9462f)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:06.877887 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d6026-1651-4446-a2c0-f937fd78e079 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:06.928852 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-721d6026-1651-4446-a2c0-f937fd78e079 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f2344f59ba4e3784e1092917d9462f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:06.935786 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-721d6026-1651-4446-a2c0-f937fd78e079 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f2344f59ba4e3784e1092917d9462f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:06.936387 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-721d6026-1651-4446-a2c0-f937fd78e079 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f2344f59ba4e3784e1092917d9462f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:06.947368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-721d6026-1651-4446-a2c0-f937fd78e079 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f2344f59ba4e3784e1092917d9462f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:06.962111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-721d6026-1651-4446-a2c0-f937fd78e079 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f2344f59ba4e3784e1092917d9462f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:06.969563 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1271/2581] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:58:06 2022] DELETE /identity/v3/users/58f2344f59ba4e3784e1092917d9462f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:06.974092 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd9405-23ad-4ebe-9e5b-5c7cdd760ba5 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:06.974380 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd9405-23ad-4ebe-9e5b-5c7cdd760ba5 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:06.974701 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd9405-23ad-4ebe-9e5b-5c7cdd760ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:06.992266 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-4bbd9405-23ad-4ebe-9e5b-5c7cdd760ba5 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:06.993461 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4bbd9405-23ad-4ebe-9e5b-5c7cdd760ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:07.055818 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1311/2582] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:58:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:07.065767 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d6026-1651-4446-a2c0-f937fd78e079 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:07.067234 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-721d6026-1651-4446-a2c0-f937fd78e079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:07.130417 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d6026-1651-4446-a2c0-f937fd78e079 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:07.134027 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ed0a2b-add4-46c3-a125-8419eff62d04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:07.134867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed0a2b-add4-46c3-a125-8419eff62d04 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:07.135160 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed0a2b-add4-46c3-a125-8419eff62d04 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:07.135599 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ed0a2b-add4-46c3-a125-8419eff62d04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:07.145421 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed0a2b-add4-46c3-a125-8419eff62d04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:07.146884 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ed0a2b-add4-46c3-a125-8419eff62d04 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:07.156728 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1272/2583] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:58:07.562198 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd9405-23ad-4ebe-9e5b-5c7cdd760ba5 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:07.564196 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4bbd9405-23ad-4ebe-9e5b-5c7cdd760ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:07.577800 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd9405-23ad-4ebe-9e5b-5c7cdd760ba5 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:07.584416 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6389864-c295-46f1-b241-278917194d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:07.585474 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6389864-c295-46f1-b241-278917194d06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:07.585820 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6389864-c295-46f1-b241-278917194d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:07.586316 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6389864-c295-46f1-b241-278917194d06 admin admin] PATH_INFO: `/v3/projects/80884bebb113474799992dc115deb4df` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:07.588084 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6389864-c295-46f1-b241-278917194d06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80884bebb113474799992dc115deb4df)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:07.591221 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6389864-c295-46f1-b241-278917194d06 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:07.640258 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a6389864-c295-46f1-b241-278917194d06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80884bebb113474799992dc115deb4df', 'request_id': 'req-a6389864-c295-46f1-b241-278917194d06'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:07.645775 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a6389864-c295-46f1-b241-278917194d06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80884bebb113474799992dc115deb4df', 'request_id': 'req-a6389864-c295-46f1-b241-278917194d06'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:07.652420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a6389864-c295-46f1-b241-278917194d06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80884bebb113474799992dc115deb4df', 'request_id': 'req-a6389864-c295-46f1-b241-278917194d06'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:07.664498 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a6389864-c295-46f1-b241-278917194d06 admin admin] The token cache is being invalidate because project 80884bebb113474799992dc115deb4df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:58:07.664796 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a6389864-c295-46f1-b241-278917194d06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:07.665380 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a6389864-c295-46f1-b241-278917194d06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:07.666979 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1312/2584] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:58:07 2022] DELETE /identity/v3/projects/80884bebb113474799992dc115deb4df => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:07.672188 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1909a-46b2-4c27-9103-5983c30c45ae None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:07.672573 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1909a-46b2-4c27-9103-5983c30c45ae None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:07.672912 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae1909a-46b2-4c27-9103-5983c30c45ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:07.690844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-0ae1909a-46b2-4c27-9103-5983c30c45ae None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:07.692078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0ae1909a-46b2-4c27-9103-5983c30c45ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:07.752526 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1273/2585] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:07.760436 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0128ad7-9540-4433-818a-3b90e0cd6d7d None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:07.761244 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0128ad7-9540-4433-818a-3b90e0cd6d7d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:07.761523 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0128ad7-9540-4433-818a-3b90e0cd6d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:07.780637 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-d0128ad7-9540-4433-818a-3b90e0cd6d7d None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:07.781914 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d0128ad7-9540-4433-818a-3b90e0cd6d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:07.790272 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1313/2586] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:07.794298 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1909a-46b2-4c27-9103-5983c30c45ae None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:07.803876 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae1909a-46b2-4c27-9103-5983c30c45ae None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:07.809016 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5a71b-f612-4b52-aa90-3ee082a57cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:07.809701 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5a71b-f612-4b52-aa90-3ee082a57cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:07.809991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5a71b-f612-4b52-aa90-3ee082a57cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:07.810271 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5a71b-f612-4b52-aa90-3ee082a57cd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:07.811045 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5a71b-f612-4b52-aa90-3ee082a57cd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:58:07.811351 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5a71b-f612-4b52-aa90-3ee082a57cd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:07.812954 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5a71b-f612-4b52-aa90-3ee082a57cd5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:07.828356 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1274/2587] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:58:07.829469 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0128ad7-9540-4433-818a-3b90e0cd6d7d None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:07.838682 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0128ad7-9540-4433-818a-3b90e0cd6d7d None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:07.843413 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285601eb-412d-460c-b121-c3096f9547f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:07.844050 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285601eb-412d-460c-b121-c3096f9547f6 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:07.844328 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285601eb-412d-460c-b121-c3096f9547f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:07.844605 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285601eb-412d-460c-b121-c3096f9547f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:07.845290 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285601eb-412d-460c-b121-c3096f9547f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:07.847242 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285601eb-412d-460c-b121-c3096f9547f6 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:07.874619 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1314/2588] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:58:07 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:58:07.876815 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5a71b-f612-4b52-aa90-3ee082a57cd5 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:07.888086 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5a71b-f612-4b52-aa90-3ee082a57cd5 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:07.942319 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41add360-6b59-4f1b-9589-f7e26c2ef3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:07.943010 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41add360-6b59-4f1b-9589-f7e26c2ef3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:07.943291 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41add360-6b59-4f1b-9589-f7e26c2ef3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:07.944241 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41add360-6b59-4f1b-9589-f7e26c2ef3b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:07.944368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41add360-6b59-4f1b-9589-f7e26c2ef3b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:07.946165 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41add360-6b59-4f1b-9589-f7e26c2ef3b0 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:07.965598 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1275/2589] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:58:07 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:58:07.969697 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285601eb-412d-460c-b121-c3096f9547f6 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:07.980028 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285601eb-412d-460c-b121-c3096f9547f6 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:07.984664 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fde60-1598-4f42-a0b1-c4f33cd98b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:07.985339 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fde60-1598-4f42-a0b1-c4f33cd98b2f admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:07.985622 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fde60-1598-4f42-a0b1-c4f33cd98b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:07.985899 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4fde60-1598-4f42-a0b1-c4f33cd98b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:07.986655 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fde60-1598-4f42-a0b1-c4f33cd98b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:07.988251 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4fde60-1598-4f42-a0b1-c4f33cd98b2f admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:07.998819 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1315/2590] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:58:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:58:08.003219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41add360-6b59-4f1b-9589-f7e26c2ef3b0 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:08.013639 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41add360-6b59-4f1b-9589-f7e26c2ef3b0 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:08.018566 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7a317-5d5d-48cc-adbe-7728b4f38187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:08.019198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7a317-5d5d-48cc-adbe-7728b4f38187 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:08.019477 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7a317-5d5d-48cc-adbe-7728b4f38187 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:08.019748 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7a317-5d5d-48cc-adbe-7728b4f38187 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:08.020464 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7a317-5d5d-48cc-adbe-7728b4f38187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:08.022048 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7a317-5d5d-48cc-adbe-7728b4f38187 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:08.032802 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1276/2591] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:58:08.036975 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fde60-1598-4f42-a0b1-c4f33cd98b2f admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:08.046728 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4fde60-1598-4f42-a0b1-c4f33cd98b2f admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:08.051292 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74135b26-fcd7-435f-bd8f-8273f21e3e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:08.052157 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74135b26-fcd7-435f-bd8f-8273f21e3e0f admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:08.052432 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74135b26-fcd7-435f-bd8f-8273f21e3e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:08.052701 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74135b26-fcd7-435f-bd8f-8273f21e3e0f admin admin] PATH_INFO: `/v3/projects/8445152ce80348128b56155c1bb5a4c1/users/5f459606283447b39ccbc1296ef7124a/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:08.067065 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74135b26-fcd7-435f-bd8f-8273f21e3e0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8445152ce80348128b56155c1bb5a4c1, user_id=5f459606283447b39ccbc1296ef7124a, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:08.069699 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74135b26-fcd7-435f-bd8f-8273f21e3e0f admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:08.083022 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1316/2592] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:58:08 2022] PUT /identity/v3/projects/8445152ce80348128b56155c1bb5a4c1/users/5f459606283447b39ccbc1296ef7124a/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:08.093173 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37aea7-17b4-4614-b67b-19b5de0f4551 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:08.093527 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37aea7-17b4-4614-b67b-19b5de0f4551 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:08.093808 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37aea7-17b4-4614-b67b-19b5de0f4551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:08.120797 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-4e37aea7-17b4-4614-b67b-19b5de0f4551 None None] MFA Rules not processed for user `5f459606283447b39ccbc1296ef7124a`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:08.122223 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4e37aea7-17b4-4614-b67b-19b5de0f4551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:08.185267 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1277/2593] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:58:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:08.195752 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74135b26-fcd7-435f-bd8f-8273f21e3e0f admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:08.197414 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-74135b26-fcd7-435f-bd8f-8273f21e3e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:08.253083 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74135b26-fcd7-435f-bd8f-8273f21e3e0f admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:08.256981 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b7087-28d5-444b-b015-88cd4ed3a1d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:08.257549 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b7087-28d5-444b-b015-88cd4ed3a1d6 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:08.257832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b7087-28d5-444b-b015-88cd4ed3a1d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:08.258104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b7087-28d5-444b-b015-88cd4ed3a1d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:08.266099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b7087-28d5-444b-b015-88cd4ed3a1d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:08.267561 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b7087-28d5-444b-b015-88cd4ed3a1d6 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:08.276078 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1317/2594] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:58:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:58:11.216286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37aea7-17b4-4614-b67b-19b5de0f4551 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:11.274256 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37aea7-17b4-4614-b67b-19b5de0f4551 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:11.279286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4649f-be9f-4cee-9286-14021f919cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:11.280130 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4649f-be9f-4cee-9286-14021f919cb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:11.280406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4649f-be9f-4cee-9286-14021f919cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:11.280675 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d4649f-be9f-4cee-9286-14021f919cb0 admin admin] PATH_INFO: `/v3/users/5f459606283447b39ccbc1296ef7124a` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:11.281825 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4649f-be9f-4cee-9286-14021f919cb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f459606283447b39ccbc1296ef7124a)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:11.283758 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d4649f-be9f-4cee-9286-14021f919cb0 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:11.327818 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f9d4649f-be9f-4cee-9286-14021f919cb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f459606283447b39ccbc1296ef7124a'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:11.334621 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f9d4649f-be9f-4cee-9286-14021f919cb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f459606283447b39ccbc1296ef7124a'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:11.335271 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f9d4649f-be9f-4cee-9286-14021f919cb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f459606283447b39ccbc1296ef7124a'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:11.342376 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f9d4649f-be9f-4cee-9286-14021f919cb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f459606283447b39ccbc1296ef7124a'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:11.353166 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f9d4649f-be9f-4cee-9286-14021f919cb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f459606283447b39ccbc1296ef7124a'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:11.358803 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1278/2595] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:58:11 2022] DELETE /identity/v3/users/5f459606283447b39ccbc1296ef7124a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:11.363353 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baa5ea-fe96-48d8-9378-8e92ad54109d None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:11.363810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baa5ea-fe96-48d8-9378-8e92ad54109d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:11.363922 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21baa5ea-fe96-48d8-9378-8e92ad54109d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:11.380915 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-21baa5ea-fe96-48d8-9378-8e92ad54109d None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:11.382098 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-21baa5ea-fe96-48d8-9378-8e92ad54109d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:11.437193 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1318/2596] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:11.446759 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4649f-be9f-4cee-9286-14021f919cb0 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:11.448611 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f9d4649f-be9f-4cee-9286-14021f919cb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:11.502775 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d4649f-be9f-4cee-9286-14021f919cb0 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:11.506666 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416f66f-1326-4d3e-9f59-878ce30aeae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:11.507299 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416f66f-1326-4d3e-9f59-878ce30aeae0 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:11.507583 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416f66f-1326-4d3e-9f59-878ce30aeae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:11.507861 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416f66f-1326-4d3e-9f59-878ce30aeae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:11.517094 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416f66f-1326-4d3e-9f59-878ce30aeae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:11.518504 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416f66f-1326-4d3e-9f59-878ce30aeae0 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:11.528580 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1279/2597] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:58:11.788008 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baa5ea-fe96-48d8-9378-8e92ad54109d None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:11.789468 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-21baa5ea-fe96-48d8-9378-8e92ad54109d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:11.803216 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21baa5ea-fe96-48d8-9378-8e92ad54109d None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:11.808296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cccf880-cc38-4ae1-bc18-1f9438e0136b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:11.809144 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccf880-cc38-4ae1-bc18-1f9438e0136b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:11.809417 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccf880-cc38-4ae1-bc18-1f9438e0136b admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:11.810155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cccf880-cc38-4ae1-bc18-1f9438e0136b admin admin] PATH_INFO: `/v3/projects/8445152ce80348128b56155c1bb5a4c1` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:11.811514 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cccf880-cc38-4ae1-bc18-1f9438e0136b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8445152ce80348128b56155c1bb5a4c1)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:11.813438 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cccf880-cc38-4ae1-bc18-1f9438e0136b admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:11.857898 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6cccf880-cc38-4ae1-bc18-1f9438e0136b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8445152ce80348128b56155c1bb5a4c1', 'request_id': 'req-6cccf880-cc38-4ae1-bc18-1f9438e0136b'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:11.863004 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6cccf880-cc38-4ae1-bc18-1f9438e0136b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8445152ce80348128b56155c1bb5a4c1', 'request_id': 'req-6cccf880-cc38-4ae1-bc18-1f9438e0136b'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:11.868758 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6cccf880-cc38-4ae1-bc18-1f9438e0136b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8445152ce80348128b56155c1bb5a4c1', 'request_id': 'req-6cccf880-cc38-4ae1-bc18-1f9438e0136b'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:11.881009 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6cccf880-cc38-4ae1-bc18-1f9438e0136b admin admin] The token cache is being invalidate because project 8445152ce80348128b56155c1bb5a4c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:58:11.881296 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6cccf880-cc38-4ae1-bc18-1f9438e0136b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:11.881913 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6cccf880-cc38-4ae1-bc18-1f9438e0136b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:11.883489 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1319/2598] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:58:11 2022] DELETE /identity/v3/projects/8445152ce80348128b56155c1bb5a4c1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:11.889056 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28b7ee-91b2-4ae3-b8e3-b7f89ef24b50 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:11.889372 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28b7ee-91b2-4ae3-b8e3-b7f89ef24b50 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:11.889647 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e28b7ee-91b2-4ae3-b8e3-b7f89ef24b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:11.907213 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-7e28b7ee-91b2-4ae3-b8e3-b7f89ef24b50 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:11.908384 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7e28b7ee-91b2-4ae3-b8e3-b7f89ef24b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:11.966988 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1280/2599] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:11.975505 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a690eaf-1f9d-49e5-aafe-1fb8e27a0e2a None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:11.975796 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a690eaf-1f9d-49e5-aafe-1fb8e27a0e2a None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:11.976109 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a690eaf-1f9d-49e5-aafe-1fb8e27a0e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:11.993977 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-0a690eaf-1f9d-49e5-aafe-1fb8e27a0e2a None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:11.995188 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-0a690eaf-1f9d-49e5-aafe-1fb8e27a0e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:12.004412 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1320/2600] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:12.008476 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28b7ee-91b2-4ae3-b8e3-b7f89ef24b50 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:12.018315 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e28b7ee-91b2-4ae3-b8e3-b7f89ef24b50 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:12.022817 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8f1d1-1298-4f25-819e-05f75e48b715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:12.023462 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8f1d1-1298-4f25-819e-05f75e48b715 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:12.023743 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8f1d1-1298-4f25-819e-05f75e48b715 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:12.024017 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8f1d1-1298-4f25-819e-05f75e48b715 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:12.024728 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8f1d1-1298-4f25-819e-05f75e48b715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:58:12.025031 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8f1d1-1298-4f25-819e-05f75e48b715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:12.027198 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8f1d1-1298-4f25-819e-05f75e48b715 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:12.038226 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1281/2601] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:58:12.042448 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a690eaf-1f9d-49e5-aafe-1fb8e27a0e2a None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:12.051457 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a690eaf-1f9d-49e5-aafe-1fb8e27a0e2a None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:12.055992 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adcd009-26f3-4f97-bc6c-571d5255e0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:12.056616 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcd009-26f3-4f97-bc6c-571d5255e0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:12.056893 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcd009-26f3-4f97-bc6c-571d5255e0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:12.057163 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adcd009-26f3-4f97-bc6c-571d5255e0f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:12.057902 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adcd009-26f3-4f97-bc6c-571d5255e0f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:12.059837 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adcd009-26f3-4f97-bc6c-571d5255e0f3 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:12.084430 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1321/2602] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:58:12 2022] POST /identity/v3/projects => generated 373 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:58:12.088390 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8f1d1-1298-4f25-819e-05f75e48b715 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:12.098055 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8f1d1-1298-4f25-819e-05f75e48b715 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:12.151391 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085398f5-e255-4158-9e61-009aed17327c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:12.152048 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085398f5-e255-4158-9e61-009aed17327c admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:12.152332 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085398f5-e255-4158-9e61-009aed17327c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:12.152633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085398f5-e255-4158-9e61-009aed17327c admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:12.153311 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085398f5-e255-4158-9e61-009aed17327c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:12.155273 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085398f5-e255-4158-9e61-009aed17327c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:12.176471 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1282/2603] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:58:12 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:58:12.180707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adcd009-26f3-4f97-bc6c-571d5255e0f3 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:12.191272 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adcd009-26f3-4f97-bc6c-571d5255e0f3 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:12.195826 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64819e46-776d-4f3b-b940-0503adf3e315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:12.196518 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64819e46-776d-4f3b-b940-0503adf3e315 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:12.196805 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64819e46-776d-4f3b-b940-0503adf3e315 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:12.197083 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64819e46-776d-4f3b-b940-0503adf3e315 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:12.197803 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64819e46-776d-4f3b-b940-0503adf3e315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:12.199552 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64819e46-776d-4f3b-b940-0503adf3e315 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:12.209524 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1322/2604] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:58:12.213192 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085398f5-e255-4158-9e61-009aed17327c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:12.224328 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085398f5-e255-4158-9e61-009aed17327c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:12.228952 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aa7f3a-e2e6-425f-86f5-4b9df5359f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:12.230116 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa7f3a-e2e6-425f-86f5-4b9df5359f5d admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:12.230396 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa7f3a-e2e6-425f-86f5-4b9df5359f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:12.230706 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aa7f3a-e2e6-425f-86f5-4b9df5359f5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:12.231432 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa7f3a-e2e6-425f-86f5-4b9df5359f5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:12.233029 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aa7f3a-e2e6-425f-86f5-4b9df5359f5d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:12.242939 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1283/2605] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:58:12.247527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64819e46-776d-4f3b-b940-0503adf3e315 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:12.257391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64819e46-776d-4f3b-b940-0503adf3e315 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:12.261964 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73241ebe-190f-4bb4-86c9-56274d3965ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:12.262872 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73241ebe-190f-4bb4-86c9-56274d3965ef admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:12.263155 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73241ebe-190f-4bb4-86c9-56274d3965ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:12.263434 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73241ebe-190f-4bb4-86c9-56274d3965ef admin admin] PATH_INFO: `/v3/projects/20bface610d6452782aaaf9dc9c9e2e1/users/87dd41e13d9e41ecb6391e551de47665/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:12.277862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73241ebe-190f-4bb4-86c9-56274d3965ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=20bface610d6452782aaaf9dc9c9e2e1, user_id=87dd41e13d9e41ecb6391e551de47665, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:12.280540 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73241ebe-190f-4bb4-86c9-56274d3965ef admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:12.293187 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1323/2606] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:58:12 2022] PUT /identity/v3/projects/20bface610d6452782aaaf9dc9c9e2e1/users/87dd41e13d9e41ecb6391e551de47665/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:12.303349 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06a870-d8a3-4d6e-a41f-50ac8fedf536 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:12.303634 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06a870-d8a3-4d6e-a41f-50ac8fedf536 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:12.303904 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06a870-d8a3-4d6e-a41f-50ac8fedf536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:12.329592 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-fe06a870-d8a3-4d6e-a41f-50ac8fedf536 None None] MFA Rules not processed for user `87dd41e13d9e41ecb6391e551de47665`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:12.330808 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-fe06a870-d8a3-4d6e-a41f-50ac8fedf536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:12.393840 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1284/2607] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:58:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:12.405621 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73241ebe-190f-4bb4-86c9-56274d3965ef admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:12.407636 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-73241ebe-190f-4bb4-86c9-56274d3965ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:12.462780 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73241ebe-190f-4bb4-86c9-56274d3965ef admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:12.470568 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f9aad9-7b99-46b1-83f4-053e3377523b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:12.471237 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9aad9-7b99-46b1-83f4-053e3377523b service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:12.471517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9aad9-7b99-46b1-83f4-053e3377523b service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:12.471792 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f9aad9-7b99-46b1-83f4-053e3377523b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:12.480821 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9aad9-7b99-46b1-83f4-053e3377523b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:12.482194 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f9aad9-7b99-46b1-83f4-053e3377523b service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:12.490890 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1324/2608] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:58:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:58:22.071931 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06a870-d8a3-4d6e-a41f-50ac8fedf536 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:22.131289 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06a870-d8a3-4d6e-a41f-50ac8fedf536 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:22.135740 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce4815-10ab-472f-9b05-2d1aec5c2c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:22.136599 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce4815-10ab-472f-9b05-2d1aec5c2c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:22.136879 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce4815-10ab-472f-9b05-2d1aec5c2c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:22.137149 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce4815-10ab-472f-9b05-2d1aec5c2c62 admin admin] PATH_INFO: `/v3/users/87dd41e13d9e41ecb6391e551de47665` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:22.138315 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce4815-10ab-472f-9b05-2d1aec5c2c62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87dd41e13d9e41ecb6391e551de47665)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:22.140251 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce4815-10ab-472f-9b05-2d1aec5c2c62 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:22.183531 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0dce4815-10ab-472f-9b05-2d1aec5c2c62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87dd41e13d9e41ecb6391e551de47665'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:22.190488 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0dce4815-10ab-472f-9b05-2d1aec5c2c62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87dd41e13d9e41ecb6391e551de47665'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:22.191133 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0dce4815-10ab-472f-9b05-2d1aec5c2c62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87dd41e13d9e41ecb6391e551de47665'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:22.197910 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0dce4815-10ab-472f-9b05-2d1aec5c2c62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87dd41e13d9e41ecb6391e551de47665'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:22.208750 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-0dce4815-10ab-472f-9b05-2d1aec5c2c62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87dd41e13d9e41ecb6391e551de47665'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:22.214992 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1285/2609] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:58:22 2022] DELETE /identity/v3/users/87dd41e13d9e41ecb6391e551de47665 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:22.219352 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025fe51-efa6-4124-a039-9ea1bf84d690 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:22.219832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025fe51-efa6-4124-a039-9ea1bf84d690 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:22.219941 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025fe51-efa6-4124-a039-9ea1bf84d690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:22.237306 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-0025fe51-efa6-4124-a039-9ea1bf84d690 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:22.238478 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-0025fe51-efa6-4124-a039-9ea1bf84d690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:22.294918 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1325/2610] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:58:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:22.304474 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce4815-10ab-472f-9b05-2d1aec5c2c62 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:22.305895 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0dce4815-10ab-472f-9b05-2d1aec5c2c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:22.361473 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce4815-10ab-472f-9b05-2d1aec5c2c62 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:22.365079 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537ab0b-871a-45bf-ab20-2836c5f99207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:22.365717 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537ab0b-871a-45bf-ab20-2836c5f99207 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:22.365993 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537ab0b-871a-45bf-ab20-2836c5f99207 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:22.366266 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537ab0b-871a-45bf-ab20-2836c5f99207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:22.374938 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537ab0b-871a-45bf-ab20-2836c5f99207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:22.376339 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537ab0b-871a-45bf-ab20-2836c5f99207 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:22.385715 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1286/2611] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:58:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:58:22.642138 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025fe51-efa6-4124-a039-9ea1bf84d690 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:22.643651 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-0025fe51-efa6-4124-a039-9ea1bf84d690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:22.655739 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025fe51-efa6-4124-a039-9ea1bf84d690 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:22.660317 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4894c4c-ed40-4a11-ac9b-23783898af2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:22.661162 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4894c4c-ed40-4a11-ac9b-23783898af2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:22.661442 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4894c4c-ed40-4a11-ac9b-23783898af2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:22.661714 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4894c4c-ed40-4a11-ac9b-23783898af2f admin admin] PATH_INFO: `/v3/projects/20bface610d6452782aaaf9dc9c9e2e1` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:22.662922 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4894c4c-ed40-4a11-ac9b-23783898af2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=20bface610d6452782aaaf9dc9c9e2e1)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:22.664811 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4894c4c-ed40-4a11-ac9b-23783898af2f admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:22.709488 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c4894c4c-ed40-4a11-ac9b-23783898af2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20bface610d6452782aaaf9dc9c9e2e1', 'request_id': 'req-c4894c4c-ed40-4a11-ac9b-23783898af2f'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:22.715380 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c4894c4c-ed40-4a11-ac9b-23783898af2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20bface610d6452782aaaf9dc9c9e2e1', 'request_id': 'req-c4894c4c-ed40-4a11-ac9b-23783898af2f'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:22.721497 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c4894c4c-ed40-4a11-ac9b-23783898af2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20bface610d6452782aaaf9dc9c9e2e1', 'request_id': 'req-c4894c4c-ed40-4a11-ac9b-23783898af2f'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:22.734455 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c4894c4c-ed40-4a11-ac9b-23783898af2f admin admin] The token cache is being invalidate because project 20bface610d6452782aaaf9dc9c9e2e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:58:22.734704 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c4894c4c-ed40-4a11-ac9b-23783898af2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:22.735335 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c4894c4c-ed40-4a11-ac9b-23783898af2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:22.736893 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1326/2612] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:58:22 2022] DELETE /identity/v3/projects/20bface610d6452782aaaf9dc9c9e2e1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:53.128722 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537ab0b-871a-45bf-ab20-2836c5f99207 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:53.137802 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537ab0b-871a-45bf-ab20-2836c5f99207 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:53.191079 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7408cc-7a90-4d00-a15c-8eec78589634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:53.191730 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7408cc-7a90-4d00-a15c-8eec78589634 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:53.192010 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7408cc-7a90-4d00-a15c-8eec78589634 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:53.192283 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7408cc-7a90-4d00-a15c-8eec78589634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:53.194144 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-cc7408cc-7a90-4d00-a15c-8eec78589634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:53.269207 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7408cc-7a90-4d00-a15c-8eec78589634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:53.270661 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7408cc-7a90-4d00-a15c-8eec78589634 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:53.281310 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1287/2613] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:58:56.524079 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4894c4c-ed40-4a11-ac9b-23783898af2f admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:56.526096 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-c4894c4c-ed40-4a11-ac9b-23783898af2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:56.539371 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4894c4c-ed40-4a11-ac9b-23783898af2f admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:56.544039 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35919d32-3bfc-4fc9-845b-feba1b3b97d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:56.544895 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35919d32-3bfc-4fc9-845b-feba1b3b97d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:56.545178 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35919d32-3bfc-4fc9-845b-feba1b3b97d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:56.545453 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35919d32-3bfc-4fc9-845b-feba1b3b97d5 admin admin] PATH_INFO: `/v3/users/49a2fa85335f47a9adc74656ee1609ba` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:56.546643 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35919d32-3bfc-4fc9-845b-feba1b3b97d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49a2fa85335f47a9adc74656ee1609ba)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:56.548554 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35919d32-3bfc-4fc9-845b-feba1b3b97d5 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:56.596755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-35919d32-3bfc-4fc9-845b-feba1b3b97d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49a2fa85335f47a9adc74656ee1609ba'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:56.597422 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-35919d32-3bfc-4fc9-845b-feba1b3b97d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49a2fa85335f47a9adc74656ee1609ba'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:56.605848 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-35919d32-3bfc-4fc9-845b-feba1b3b97d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49a2fa85335f47a9adc74656ee1609ba'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:56.614142 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-35919d32-3bfc-4fc9-845b-feba1b3b97d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49a2fa85335f47a9adc74656ee1609ba'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:56.628638 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-35919d32-3bfc-4fc9-845b-feba1b3b97d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49a2fa85335f47a9adc74656ee1609ba'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:56.635523 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1327/2614] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:58:56 2022] DELETE /identity/v3/users/49a2fa85335f47a9adc74656ee1609ba => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:56.882058 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7408cc-7a90-4d00-a15c-8eec78589634 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:56.892436 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7408cc-7a90-4d00-a15c-8eec78589634 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:56.949325 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b468e0d-6934-485e-aa5c-2625b15dfac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:56.950177 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b468e0d-6934-485e-aa5c-2625b15dfac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:56.950462 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b468e0d-6934-485e-aa5c-2625b15dfac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:56.950774 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b468e0d-6934-485e-aa5c-2625b15dfac5 admin admin] PATH_INFO: `/v3/projects/8dd57077e3604d8c8fb3ca58dbb64a1c` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:56.951943 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b468e0d-6934-485e-aa5c-2625b15dfac5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd57077e3604d8c8fb3ca58dbb64a1c)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:56.953815 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b468e0d-6934-485e-aa5c-2625b15dfac5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:56.997434 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5b468e0d-6934-485e-aa5c-2625b15dfac5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd57077e3604d8c8fb3ca58dbb64a1c', 'request_id': 'req-5b468e0d-6934-485e-aa5c-2625b15dfac5'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:57.002965 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5b468e0d-6934-485e-aa5c-2625b15dfac5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd57077e3604d8c8fb3ca58dbb64a1c', 'request_id': 'req-5b468e0d-6934-485e-aa5c-2625b15dfac5'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:57.010232 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5b468e0d-6934-485e-aa5c-2625b15dfac5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd57077e3604d8c8fb3ca58dbb64a1c', 'request_id': 'req-5b468e0d-6934-485e-aa5c-2625b15dfac5'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:57.021535 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5b468e0d-6934-485e-aa5c-2625b15dfac5 admin admin] The token cache is being invalidate because project 8dd57077e3604d8c8fb3ca58dbb64a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:58:57.021817 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5b468e0d-6934-485e-aa5c-2625b15dfac5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:57.022436 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5b468e0d-6934-485e-aa5c-2625b15dfac5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:58:57.023995 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1288/2615] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:58:56 2022] DELETE /identity/v3/projects/8dd57077e3604d8c8fb3ca58dbb64a1c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:57.029412 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44098ae-942c-4a39-8227-bf7294e217fb None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:57.029692 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44098ae-942c-4a39-8227-bf7294e217fb None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:57.029970 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44098ae-942c-4a39-8227-bf7294e217fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:57.047476 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-d44098ae-942c-4a39-8227-bf7294e217fb None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:57.048662 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d44098ae-942c-4a39-8227-bf7294e217fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:57.105688 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1328/2616] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:57.114143 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dccd8d-7c63-44b8-9c96-dc6d7cfba396 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:57.114467 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dccd8d-7c63-44b8-9c96-dc6d7cfba396 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:57.114778 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dccd8d-7c63-44b8-9c96-dc6d7cfba396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:57.132801 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-68dccd8d-7c63-44b8-9c96-dc6d7cfba396 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:57.134496 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-68dccd8d-7c63-44b8-9c96-dc6d7cfba396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:57.142356 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1289/2617] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:58:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:57.146552 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44098ae-942c-4a39-8227-bf7294e217fb None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:57.156498 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44098ae-942c-4a39-8227-bf7294e217fb None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:57.161004 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e828aa9-4ce6-46e1-91dc-dae31fc5f4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:57.161638 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e828aa9-4ce6-46e1-91dc-dae31fc5f4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:57.161914 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e828aa9-4ce6-46e1-91dc-dae31fc5f4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:57.162185 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e828aa9-4ce6-46e1-91dc-dae31fc5f4a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:57.162952 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e828aa9-4ce6-46e1-91dc-dae31fc5f4a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:58:57.163251 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e828aa9-4ce6-46e1-91dc-dae31fc5f4a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:57.164829 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e828aa9-4ce6-46e1-91dc-dae31fc5f4a4 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:57.175814 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1329/2618] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:58:57.179979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dccd8d-7c63-44b8-9c96-dc6d7cfba396 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:57.189118 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dccd8d-7c63-44b8-9c96-dc6d7cfba396 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:57.194197 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ff1ca-8c1a-4d1d-afb1-f07f18a44b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:57.194893 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ff1ca-8c1a-4d1d-afb1-f07f18a44b0c admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:57.195256 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ff1ca-8c1a-4d1d-afb1-f07f18a44b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:57.195463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ff1ca-8c1a-4d1d-afb1-f07f18a44b0c admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:57.196178 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ff1ca-8c1a-4d1d-afb1-f07f18a44b0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:57.198569 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372ff1ca-8c1a-4d1d-afb1-f07f18a44b0c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:57.226100 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1290/2619] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:58:57 2022] POST /identity/v3/projects => generated 355 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:58:57.230046 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e828aa9-4ce6-46e1-91dc-dae31fc5f4a4 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:57.239937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e828aa9-4ce6-46e1-91dc-dae31fc5f4a4 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:57.305884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5938f-9123-4f1f-8397-882f414ae9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:57.306980 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5938f-9123-4f1f-8397-882f414ae9e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:57.307327 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5938f-9123-4f1f-8397-882f414ae9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:57.307663 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5938f-9123-4f1f-8397-882f414ae9e3 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:57.308411 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5938f-9123-4f1f-8397-882f414ae9e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:57.310679 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc5938f-9123-4f1f-8397-882f414ae9e3 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:57.333780 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1330/2620] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:58:57 2022] POST /identity/v3/users => generated 278 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:58:57.338396 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ff1ca-8c1a-4d1d-afb1-f07f18a44b0c admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:57.348572 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ff1ca-8c1a-4d1d-afb1-f07f18a44b0c admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:57.353229 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e4e5c-6357-4f4d-94c1-d7ca58df51a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:57.353887 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e4e5c-6357-4f4d-94c1-d7ca58df51a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:57.354174 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e4e5c-6357-4f4d-94c1-d7ca58df51a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:57.354458 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e4e5c-6357-4f4d-94c1-d7ca58df51a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:57.355225 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e4e5c-6357-4f4d-94c1-d7ca58df51a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:57.356877 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e4e5c-6357-4f4d-94c1-d7ca58df51a1 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:57.368016 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1291/2621] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:58:57.372591 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5938f-9123-4f1f-8397-882f414ae9e3 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:57.382774 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc5938f-9123-4f1f-8397-882f414ae9e3 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:57.388406 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5256fe8c-31da-4043-89ac-5221dde8503f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:57.389067 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256fe8c-31da-4043-89ac-5221dde8503f admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:57.389346 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256fe8c-31da-4043-89ac-5221dde8503f admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:57.389619 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256fe8c-31da-4043-89ac-5221dde8503f admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:57.390331 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256fe8c-31da-4043-89ac-5221dde8503f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:57.391999 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5256fe8c-31da-4043-89ac-5221dde8503f admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:57.401878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1331/2622] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:58:57.405978 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e4e5c-6357-4f4d-94c1-d7ca58df51a1 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:57.416208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e4e5c-6357-4f4d-94c1-d7ca58df51a1 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:57.420992 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2529fb-d163-4d20-ab02-126f91c181be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:57.421936 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2529fb-d163-4d20-ab02-126f91c181be admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:57.422284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2529fb-d163-4d20-ab02-126f91c181be admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:57.422663 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2529fb-d163-4d20-ab02-126f91c181be admin admin] PATH_INFO: `/v3/projects/395d358259384ee691ca07380fd10fef/users/5ce914fdc34f40b69a33b895594d14aa/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:57.437546 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2529fb-d163-4d20-ab02-126f91c181be admin admin] RBAC: Authorizing `identity:create_grant(project_id=395d358259384ee691ca07380fd10fef, user_id=5ce914fdc34f40b69a33b895594d14aa, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:57.440201 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2529fb-d163-4d20-ab02-126f91c181be admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:57.454435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1292/2623] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:58:57 2022] PUT /identity/v3/projects/395d358259384ee691ca07380fd10fef/users/5ce914fdc34f40b69a33b895594d14aa/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:57.464998 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae033167-85ac-4f4d-a9e8-fec02a8543db None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:57.465383 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae033167-85ac-4f4d-a9e8-fec02a8543db None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:57.465726 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae033167-85ac-4f4d-a9e8-fec02a8543db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:57.491673 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-ae033167-85ac-4f4d-a9e8-fec02a8543db None None] MFA Rules not processed for user `5ce914fdc34f40b69a33b895594d14aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:57.492977 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-ae033167-85ac-4f4d-a9e8-fec02a8543db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:57.555168 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1332/2624] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:58:57 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:57.560553 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2529fb-d163-4d20-ab02-126f91c181be admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:57.619572 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2529fb-d163-4d20-ab02-126f91c181be admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:57.625636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9c3c6-8f12-4146-94d1-b3186ce8be14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:57.626463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9c3c6-8f12-4146-94d1-b3186ce8be14 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:57.626777 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9c3c6-8f12-4146-94d1-b3186ce8be14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:57.627055 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9c3c6-8f12-4146-94d1-b3186ce8be14 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:57.627744 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9c3c6-8f12-4146-94d1-b3186ce8be14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:57.629902 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9c3c6-8f12-4146-94d1-b3186ce8be14 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:57.655504 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1293/2625] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:58:57 2022] POST /identity/v3/projects => generated 357 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:58:57.659491 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae033167-85ac-4f4d-a9e8-fec02a8543db None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:57.670704 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae033167-85ac-4f4d-a9e8-fec02a8543db None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:57.725494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be117e08-5b14-4b13-9624-fdcb81847870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:57.726168 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be117e08-5b14-4b13-9624-fdcb81847870 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:57.726446 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be117e08-5b14-4b13-9624-fdcb81847870 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:57.726757 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be117e08-5b14-4b13-9624-fdcb81847870 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:57.727448 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be117e08-5b14-4b13-9624-fdcb81847870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:57.729926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be117e08-5b14-4b13-9624-fdcb81847870 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:57.750066 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1333/2626] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:58:57 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:58:57.755027 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9c3c6-8f12-4146-94d1-b3186ce8be14 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:57.765474 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9c3c6-8f12-4146-94d1-b3186ce8be14 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:57.770225 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7e36f-572f-4422-a054-88cba861b996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:57.770920 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7e36f-572f-4422-a054-88cba861b996 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:57.771204 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7e36f-572f-4422-a054-88cba861b996 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:57.771493 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7e36f-572f-4422-a054-88cba861b996 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:57.772210 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7e36f-572f-4422-a054-88cba861b996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:57.773789 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7e36f-572f-4422-a054-88cba861b996 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:57.784580 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1294/2627] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:58:57.788926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be117e08-5b14-4b13-9624-fdcb81847870 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:57.799382 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be117e08-5b14-4b13-9624-fdcb81847870 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:57.804860 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc07d6-9648-439e-a449-d795bede9a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:57.805612 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc07d6-9648-439e-a449-d795bede9a24 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:57.806475 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc07d6-9648-439e-a449-d795bede9a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:57.806892 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc07d6-9648-439e-a449-d795bede9a24 admin admin] PATH_INFO: `/v3/projects/60c92bab6610459fbdec43687db25600/users/8ab79f8b8c7f456ea7290041848240bc/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:57.821510 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc07d6-9648-439e-a449-d795bede9a24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c92bab6610459fbdec43687db25600, user_id=8ab79f8b8c7f456ea7290041848240bc, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:57.824277 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc07d6-9648-439e-a449-d795bede9a24 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:57.838695 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1334/2628] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:58:57 2022] PUT /identity/v3/projects/60c92bab6610459fbdec43687db25600/users/8ab79f8b8c7f456ea7290041848240bc/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:57.842791 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7e36f-572f-4422-a054-88cba861b996 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:57.853996 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7e36f-572f-4422-a054-88cba861b996 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:57.921401 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91744714-fa7e-46c5-adcf-8a676f90dfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:57.922756 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91744714-fa7e-46c5-adcf-8a676f90dfaf admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:57.923094 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91744714-fa7e-46c5-adcf-8a676f90dfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:57.923375 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91744714-fa7e-46c5-adcf-8a676f90dfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:57.924103 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91744714-fa7e-46c5-adcf-8a676f90dfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:57.925697 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91744714-fa7e-46c5-adcf-8a676f90dfaf admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:57.936390 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1295/2629] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:58:57.942552 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc07d6-9648-439e-a449-d795bede9a24 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:57.952851 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc07d6-9648-439e-a449-d795bede9a24 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:57.957429 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda775f-eb2b-46b7-8255-93e268aa3609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:57.958295 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda775f-eb2b-46b7-8255-93e268aa3609 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:57.958574 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda775f-eb2b-46b7-8255-93e268aa3609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:57.958870 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda775f-eb2b-46b7-8255-93e268aa3609 admin admin] PATH_INFO: `/v3/projects/60c92bab6610459fbdec43687db25600/users/8ab79f8b8c7f456ea7290041848240bc/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:57.960831 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda775f-eb2b-46b7-8255-93e268aa3609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c92bab6610459fbdec43687db25600, user_id=8ab79f8b8c7f456ea7290041848240bc, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:57.963573 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda775f-eb2b-46b7-8255-93e268aa3609 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:57.973541 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1335/2630] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:58:57 2022] PUT /identity/v3/projects/60c92bab6610459fbdec43687db25600/users/8ab79f8b8c7f456ea7290041848240bc/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:58:57.983998 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c1c9e-d918-42ea-ac40-73aa7f18938f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:57.984287 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c1c9e-d918-42ea-ac40-73aa7f18938f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:57.984567 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c1c9e-d918-42ea-ac40-73aa7f18938f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:58.013183 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6f2c1c9e-d918-42ea-ac40-73aa7f18938f None None] MFA Rules not processed for user `8ab79f8b8c7f456ea7290041848240bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:58:58.014420 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6f2c1c9e-d918-42ea-ac40-73aa7f18938f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:58.088996 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1296/2631] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:58:57 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:58:58.103763 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda775f-eb2b-46b7-8255-93e268aa3609 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:58.105696 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-0bda775f-eb2b-46b7-8255-93e268aa3609 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:58:58.187439 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda775f-eb2b-46b7-8255-93e268aa3609 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:58.191359 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289db602-8d7d-4eb7-8f76-92f2d562f03c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:58.192085 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289db602-8d7d-4eb7-8f76-92f2d562f03c service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:58.192439 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289db602-8d7d-4eb7-8f76-92f2d562f03c service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:58.192786 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289db602-8d7d-4eb7-8f76-92f2d562f03c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:58.204117 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289db602-8d7d-4eb7-8f76-92f2d562f03c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:58.206143 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289db602-8d7d-4eb7-8f76-92f2d562f03c service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:58.219106 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1336/2632] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:58:58 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:58:58.305103 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c1c9e-d918-42ea-ac40-73aa7f18938f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:58:58.316428 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c1c9e-d918-42ea-ac40-73aa7f18938f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:58:58.320248 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dbda1-1465-42c9-86c2-7df16c69f27a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:58:58.320961 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dbda1-1465-42c9-86c2-7df16c69f27a service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:58:58.321344 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dbda1-1465-42c9-86c2-7df16c69f27a service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:58:58.321682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0dbda1-1465-42c9-86c2-7df16c69f27a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:58:58.380367 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dbda1-1465-42c9-86c2-7df16c69f27a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:58:58.381989 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0dbda1-1465-42c9-86c2-7df16c69f27a service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:58:58.391380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1297/2633] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:58:58 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:59:00.885858 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6319db8-fb6f-47e3-bbec-15a206e0c650 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:00.886376 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6319db8-fb6f-47e3-bbec-15a206e0c650 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:00.886474 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6319db8-fb6f-47e3-bbec-15a206e0c650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:00.904724 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-d6319db8-fb6f-47e3-bbec-15a206e0c650 None None] MFA Rules not processed for user `cca858d4c5454a5ea7577b6f78b19d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:00.905921 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d6319db8-fb6f-47e3-bbec-15a206e0c650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:00.966231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1337/2634] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:59:12.999391 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dbda1-1465-42c9-86c2-7df16c69f27a service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:13.067341 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0dbda1-1465-42c9-86c2-7df16c69f27a service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:13.072427 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49ff45-5106-4f57-b417-95229a99cd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:13.073354 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49ff45-5106-4f57-b417-95229a99cd19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:13.073633 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49ff45-5106-4f57-b417-95229a99cd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:13.073906 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49ff45-5106-4f57-b417-95229a99cd19 admin admin] PATH_INFO: `/v3/users/5ce914fdc34f40b69a33b895594d14aa` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:13.075144 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49ff45-5106-4f57-b417-95229a99cd19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce914fdc34f40b69a33b895594d14aa)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:13.077062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49ff45-5106-4f57-b417-95229a99cd19 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:13.126813 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7e49ff45-5106-4f57-b417-95229a99cd19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce914fdc34f40b69a33b895594d14aa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:13.135689 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7e49ff45-5106-4f57-b417-95229a99cd19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce914fdc34f40b69a33b895594d14aa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:13.136304 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7e49ff45-5106-4f57-b417-95229a99cd19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce914fdc34f40b69a33b895594d14aa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:13.143139 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7e49ff45-5106-4f57-b417-95229a99cd19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce914fdc34f40b69a33b895594d14aa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:13.154623 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7e49ff45-5106-4f57-b417-95229a99cd19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce914fdc34f40b69a33b895594d14aa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:13.160590 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1298/2635] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:59:12 2022] DELETE /identity/v3/users/5ce914fdc34f40b69a33b895594d14aa => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:13.165153 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330f2f0-3757-479c-92a4-844e55a9bfa4 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:13.165629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330f2f0-3757-479c-92a4-844e55a9bfa4 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:13.165726 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c330f2f0-3757-479c-92a4-844e55a9bfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:13.183150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-c330f2f0-3757-479c-92a4-844e55a9bfa4 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:13.184374 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-c330f2f0-3757-479c-92a4-844e55a9bfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:13.241005 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1338/2636] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:59:13.251850 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49ff45-5106-4f57-b417-95229a99cd19 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:13.253279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7e49ff45-5106-4f57-b417-95229a99cd19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:13.312169 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49ff45-5106-4f57-b417-95229a99cd19 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:13.315852 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f4c2d-69c2-402c-8103-78d35298c9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:13.316440 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f4c2d-69c2-402c-8103-78d35298c9dc service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:13.316724 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f4c2d-69c2-402c-8103-78d35298c9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:13.317001 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f4c2d-69c2-402c-8103-78d35298c9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:13.326772 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f4c2d-69c2-402c-8103-78d35298c9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:13.328227 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f4c2d-69c2-402c-8103-78d35298c9dc service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:13.337471 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1299/2637] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:59:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:59:13.598642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330f2f0-3757-479c-92a4-844e55a9bfa4 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:13.600247 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-c330f2f0-3757-479c-92a4-844e55a9bfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:13.614846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c330f2f0-3757-479c-92a4-844e55a9bfa4 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:13.619978 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a7f79-e440-4e85-a96c-481b2e57f253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:13.621923 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a7f79-e440-4e85-a96c-481b2e57f253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:13.622212 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a7f79-e440-4e85-a96c-481b2e57f253 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:13.622487 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a7f79-e440-4e85-a96c-481b2e57f253 admin admin] PATH_INFO: `/v3/projects/395d358259384ee691ca07380fd10fef` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:13.623717 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a7f79-e440-4e85-a96c-481b2e57f253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=395d358259384ee691ca07380fd10fef)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:13.625632 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a7f79-e440-4e85-a96c-481b2e57f253 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:13.669878 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a08a7f79-e440-4e85-a96c-481b2e57f253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395d358259384ee691ca07380fd10fef', 'request_id': 'req-a08a7f79-e440-4e85-a96c-481b2e57f253'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:13.675032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a08a7f79-e440-4e85-a96c-481b2e57f253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395d358259384ee691ca07380fd10fef', 'request_id': 'req-a08a7f79-e440-4e85-a96c-481b2e57f253'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:13.681523 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a08a7f79-e440-4e85-a96c-481b2e57f253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395d358259384ee691ca07380fd10fef', 'request_id': 'req-a08a7f79-e440-4e85-a96c-481b2e57f253'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:13.692612 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a08a7f79-e440-4e85-a96c-481b2e57f253 admin admin] The token cache is being invalidate because project 395d358259384ee691ca07380fd10fef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:59:13.692893 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a08a7f79-e440-4e85-a96c-481b2e57f253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:13.693507 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a08a7f79-e440-4e85-a96c-481b2e57f253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:13.695054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1339/2638] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:59:13 2022] DELETE /identity/v3/projects/395d358259384ee691ca07380fd10fef => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:13.698948 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f4c2d-69c2-402c-8103-78d35298c9dc service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:13.708357 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f4c2d-69c2-402c-8103-78d35298c9dc service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:13.762636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a054e-f965-476c-881a-d82e4575c067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:13.763493 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a054e-f965-476c-881a-d82e4575c067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:13.763770 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a054e-f965-476c-881a-d82e4575c067 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:13.764039 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a054e-f965-476c-881a-d82e4575c067 admin admin] PATH_INFO: `/v3/users/8ab79f8b8c7f456ea7290041848240bc` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:13.765190 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a054e-f965-476c-881a-d82e4575c067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab79f8b8c7f456ea7290041848240bc)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:13.767123 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a054e-f965-476c-881a-d82e4575c067 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:13.809045 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-204a054e-f965-476c-881a-d82e4575c067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab79f8b8c7f456ea7290041848240bc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:13.815262 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-204a054e-f965-476c-881a-d82e4575c067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab79f8b8c7f456ea7290041848240bc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:13.816021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-204a054e-f965-476c-881a-d82e4575c067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab79f8b8c7f456ea7290041848240bc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:13.822561 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-204a054e-f965-476c-881a-d82e4575c067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab79f8b8c7f456ea7290041848240bc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:13.833800 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-204a054e-f965-476c-881a-d82e4575c067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab79f8b8c7f456ea7290041848240bc'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:13.840084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1300/2639] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:59:13 2022] DELETE /identity/v3/users/8ab79f8b8c7f456ea7290041848240bc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:14.106046 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a7f79-e440-4e85-a96c-481b2e57f253 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:14.107498 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a08a7f79-e440-4e85-a96c-481b2e57f253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:14.121385 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a7f79-e440-4e85-a96c-481b2e57f253 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:14.176190 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421709a-30b1-4684-81c3-da32eb910dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:14.177085 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421709a-30b1-4684-81c3-da32eb910dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:14.177368 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421709a-30b1-4684-81c3-da32eb910dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:14.177645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421709a-30b1-4684-81c3-da32eb910dc0 admin admin] PATH_INFO: `/v3/projects/60c92bab6610459fbdec43687db25600` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:14.178963 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421709a-30b1-4684-81c3-da32eb910dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60c92bab6610459fbdec43687db25600)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:14.181424 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0421709a-30b1-4684-81c3-da32eb910dc0 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:14.224702 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-0421709a-30b1-4684-81c3-da32eb910dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60c92bab6610459fbdec43687db25600', 'request_id': 'req-0421709a-30b1-4684-81c3-da32eb910dc0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:14.230388 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-0421709a-30b1-4684-81c3-da32eb910dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60c92bab6610459fbdec43687db25600', 'request_id': 'req-0421709a-30b1-4684-81c3-da32eb910dc0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:14.236249 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-0421709a-30b1-4684-81c3-da32eb910dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60c92bab6610459fbdec43687db25600', 'request_id': 'req-0421709a-30b1-4684-81c3-da32eb910dc0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:14.248170 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-0421709a-30b1-4684-81c3-da32eb910dc0 admin admin] The token cache is being invalidate because project 60c92bab6610459fbdec43687db25600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:59:14.248455 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-0421709a-30b1-4684-81c3-da32eb910dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:14.249069 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-0421709a-30b1-4684-81c3-da32eb910dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:14.250594 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1340/2640] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:59:14 2022] DELETE /identity/v3/projects/60c92bab6610459fbdec43687db25600 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:14.255836 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e9fbd-82bf-4cd8-a5cb-9aef0ed4e42d None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:14.256320 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e9fbd-82bf-4cd8-a5cb-9aef0ed4e42d None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:14.256419 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e9fbd-82bf-4cd8-a5cb-9aef0ed4e42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:14.274277 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-aa3e9fbd-82bf-4cd8-a5cb-9aef0ed4e42d None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:14.275506 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-aa3e9fbd-82bf-4cd8-a5cb-9aef0ed4e42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:14.331912 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1301/2641] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:59:14.339765 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95bf2d-dfd7-4987-a663-68a4bebe9125 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:14.340051 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95bf2d-dfd7-4987-a663-68a4bebe9125 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:14.340329 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95bf2d-dfd7-4987-a663-68a4bebe9125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:14.358409 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-4c95bf2d-dfd7-4987-a663-68a4bebe9125 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:14.359551 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4c95bf2d-dfd7-4987-a663-68a4bebe9125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:14.367236 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1341/2642] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:59:14.371987 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e9fbd-82bf-4cd8-a5cb-9aef0ed4e42d None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:14.381675 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e9fbd-82bf-4cd8-a5cb-9aef0ed4e42d None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:14.386399 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787925b4-851f-4147-a2fe-c686f4144fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:14.387081 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787925b4-851f-4147-a2fe-c686f4144fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:14.387366 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787925b4-851f-4147-a2fe-c686f4144fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:14.387646 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787925b4-851f-4147-a2fe-c686f4144fe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:14.388362 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787925b4-851f-4147-a2fe-c686f4144fe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:59:14.388675 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787925b4-851f-4147-a2fe-c686f4144fe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:14.390273 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787925b4-851f-4147-a2fe-c686f4144fe7 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:14.401481 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1302/2643] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:59:14.405524 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95bf2d-dfd7-4987-a663-68a4bebe9125 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:14.414486 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95bf2d-dfd7-4987-a663-68a4bebe9125 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:14.419628 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d1ed0-7505-43ee-a33d-1544f74cae1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:14.420263 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d1ed0-7505-43ee-a33d-1544f74cae1a admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:14.420542 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d1ed0-7505-43ee-a33d-1544f74cae1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:14.420812 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d1ed0-7505-43ee-a33d-1544f74cae1a admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:14.421492 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d1ed0-7505-43ee-a33d-1544f74cae1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:14.423417 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d1ed0-7505-43ee-a33d-1544f74cae1a admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:14.447900 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1342/2644] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:59:14 2022] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:59:14.451766 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787925b4-851f-4147-a2fe-c686f4144fe7 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:14.461213 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787925b4-851f-4147-a2fe-c686f4144fe7 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:14.517279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c296f-8083-4c83-8ff2-9c8ead3aea41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:14.517952 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c296f-8083-4c83-8ff2-9c8ead3aea41 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:14.518225 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c296f-8083-4c83-8ff2-9c8ead3aea41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:14.518503 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c296f-8083-4c83-8ff2-9c8ead3aea41 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:14.519210 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c296f-8083-4c83-8ff2-9c8ead3aea41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:14.521103 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c296f-8083-4c83-8ff2-9c8ead3aea41 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:14.540786 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1303/2645] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:59:14 2022] POST /identity/v3/users => generated 286 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:59:14.544802 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d1ed0-7505-43ee-a33d-1544f74cae1a admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:14.554631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d1ed0-7505-43ee-a33d-1544f74cae1a admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:14.559738 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961bd86-3eb6-44c2-abb6-4e3264340cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:14.560384 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961bd86-3eb6-44c2-abb6-4e3264340cac admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:14.560664 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961bd86-3eb6-44c2-abb6-4e3264340cac admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:14.560937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961bd86-3eb6-44c2-abb6-4e3264340cac admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:14.561650 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961bd86-3eb6-44c2-abb6-4e3264340cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:14.563275 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961bd86-3eb6-44c2-abb6-4e3264340cac admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:14.573323 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1343/2646] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:59:14.577009 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c296f-8083-4c83-8ff2-9c8ead3aea41 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:14.586648 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c296f-8083-4c83-8ff2-9c8ead3aea41 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:14.591737 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b4bc3-59e4-45f9-a971-8bae9005089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:14.592377 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b4bc3-59e4-45f9-a971-8bae9005089b admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:14.592657 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b4bc3-59e4-45f9-a971-8bae9005089b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:14.592929 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b4bc3-59e4-45f9-a971-8bae9005089b admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:14.593638 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b4bc3-59e4-45f9-a971-8bae9005089b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:14.595246 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b4bc3-59e4-45f9-a971-8bae9005089b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:14.605354 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1304/2647] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:59:14.609502 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961bd86-3eb6-44c2-abb6-4e3264340cac admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:14.619702 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961bd86-3eb6-44c2-abb6-4e3264340cac admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:14.624304 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f317f-8a8a-403b-922f-1634ad1c86a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:14.625167 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f317f-8a8a-403b-922f-1634ad1c86a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:14.625447 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f317f-8a8a-403b-922f-1634ad1c86a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:14.625722 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f317f-8a8a-403b-922f-1634ad1c86a0 admin admin] PATH_INFO: `/v3/projects/14a14cc6271941649a3531896f376192/users/f44682a063f44730bed1067ca7b955fd/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:14.640206 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f317f-8a8a-403b-922f-1634ad1c86a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a14cc6271941649a3531896f376192, user_id=f44682a063f44730bed1067ca7b955fd, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:14.642871 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f317f-8a8a-403b-922f-1634ad1c86a0 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:14.655805 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1344/2648] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:59:14 2022] PUT /identity/v3/projects/14a14cc6271941649a3531896f376192/users/f44682a063f44730bed1067ca7b955fd/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:14.660876 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a34d7-0991-46cd-a518-ba446691a886 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:14.661160 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a34d7-0991-46cd-a518-ba446691a886 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:14.661433 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a34d7-0991-46cd-a518-ba446691a886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:14.678840 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a24a34d7-0991-46cd-a518-ba446691a886 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:14.679997 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a24a34d7-0991-46cd-a518-ba446691a886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:14.735523 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1305/2649] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:59:14.744921 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f317f-8a8a-403b-922f-1634ad1c86a0 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:14.746648 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-214f317f-8a8a-403b-922f-1634ad1c86a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:14.801597 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f317f-8a8a-403b-922f-1634ad1c86a0 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:14.805209 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66710b-b281-4f54-88c9-7f351c52b67d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:14.805842 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66710b-b281-4f54-88c9-7f351c52b67d service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:14.806124 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66710b-b281-4f54-88c9-7f351c52b67d service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:14.806399 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66710b-b281-4f54-88c9-7f351c52b67d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:14.815280 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66710b-b281-4f54-88c9-7f351c52b67d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:14.816704 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66710b-b281-4f54-88c9-7f351c52b67d service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:14.825870 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1345/2650] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:59:15.396470 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39a442-138d-4d66-a182-5bf2c981c820 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:15.396991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39a442-138d-4d66-a182-5bf2c981c820 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:15.397078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39a442-138d-4d66-a182-5bf2c981c820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:15.423448 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ed39a442-138d-4d66-a182-5bf2c981c820 None None] MFA Rules not processed for user `f44682a063f44730bed1067ca7b955fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:15.424650 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ed39a442-138d-4d66-a182-5bf2c981c820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:15.491534 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1306/2651] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:59:15.496712 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66710b-b281-4f54-88c9-7f351c52b67d service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:15.507334 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66710b-b281-4f54-88c9-7f351c52b67d service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:15.512126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f37b4-853b-42e8-942c-21f232b27774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:15.512876 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f37b4-853b-42e8-942c-21f232b27774 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:15.513250 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f37b4-853b-42e8-942c-21f232b27774 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:15.513616 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9f37b4-853b-42e8-942c-21f232b27774 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:15.514392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f37b4-853b-42e8-942c-21f232b27774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:15.516425 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9f37b4-853b-42e8-942c-21f232b27774 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:15.547517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1346/2652] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:59:15 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:59:15.548618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39a442-138d-4d66-a182-5bf2c981c820 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:15.559447 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39a442-138d-4d66-a182-5bf2c981c820 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:15.614801 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e8060-b0d2-4fe3-bc68-70eaa2032a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:15.615480 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e8060-b0d2-4fe3-bc68-70eaa2032a8a admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:15.615888 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e8060-b0d2-4fe3-bc68-70eaa2032a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:15.616174 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e8060-b0d2-4fe3-bc68-70eaa2032a8a admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:15.616920 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e8060-b0d2-4fe3-bc68-70eaa2032a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:15.618855 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68e8060-b0d2-4fe3-bc68-70eaa2032a8a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:15.641370 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1307/2653] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:59:15 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:59:15.642563 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f37b4-853b-42e8-942c-21f232b27774 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:15.653233 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9f37b4-853b-42e8-942c-21f232b27774 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:15.657755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39836b0-8bdf-416d-b5ae-68b64c3cf704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:15.658407 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39836b0-8bdf-416d-b5ae-68b64c3cf704 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:15.659263 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39836b0-8bdf-416d-b5ae-68b64c3cf704 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:15.659263 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39836b0-8bdf-416d-b5ae-68b64c3cf704 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:15.659717 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39836b0-8bdf-416d-b5ae-68b64c3cf704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:15.661311 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39836b0-8bdf-416d-b5ae-68b64c3cf704 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:15.675329 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1347/2654] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:59:15.676860 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e8060-b0d2-4fe3-bc68-70eaa2032a8a admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:15.687483 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e8060-b0d2-4fe3-bc68-70eaa2032a8a admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:15.692237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9beb5aa-b7a7-4e15-b2a7-89a323e6dd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:15.693175 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9beb5aa-b7a7-4e15-b2a7-89a323e6dd77 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:15.693524 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9beb5aa-b7a7-4e15-b2a7-89a323e6dd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:15.693883 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9beb5aa-b7a7-4e15-b2a7-89a323e6dd77 admin admin] PATH_INFO: `/v3/projects/d30685c996054c58a78c608cb174b471/users/e9e450bf1f98495f883ec4da462d1874/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:15.709365 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9beb5aa-b7a7-4e15-b2a7-89a323e6dd77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30685c996054c58a78c608cb174b471, user_id=e9e450bf1f98495f883ec4da462d1874, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:15.712703 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9beb5aa-b7a7-4e15-b2a7-89a323e6dd77 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:15.725313 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1308/2655] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:59:15 2022] PUT /identity/v3/projects/d30685c996054c58a78c608cb174b471/users/e9e450bf1f98495f883ec4da462d1874/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:15.729360 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39836b0-8bdf-416d-b5ae-68b64c3cf704 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:15.739142 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39836b0-8bdf-416d-b5ae-68b64c3cf704 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:15.793638 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42ff946-a6bb-401e-8eaf-8f9829d68a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:15.794290 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ff946-a6bb-401e-8eaf-8f9829d68a98 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:15.794568 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ff946-a6bb-401e-8eaf-8f9829d68a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:15.794876 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42ff946-a6bb-401e-8eaf-8f9829d68a98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:15.795619 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ff946-a6bb-401e-8eaf-8f9829d68a98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:15.797194 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42ff946-a6bb-401e-8eaf-8f9829d68a98 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:15.806690 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1348/2656] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:59:15.810856 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9beb5aa-b7a7-4e15-b2a7-89a323e6dd77 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:15.820654 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9beb5aa-b7a7-4e15-b2a7-89a323e6dd77 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:15.825718 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed33f3-371f-4d0e-90ca-1bbc2d72ba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:15.826571 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed33f3-371f-4d0e-90ca-1bbc2d72ba73 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:15.826874 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed33f3-371f-4d0e-90ca-1bbc2d72ba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:15.827145 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ed33f3-371f-4d0e-90ca-1bbc2d72ba73 admin admin] PATH_INFO: `/v3/projects/d30685c996054c58a78c608cb174b471/users/e9e450bf1f98495f883ec4da462d1874/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:15.829085 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed33f3-371f-4d0e-90ca-1bbc2d72ba73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30685c996054c58a78c608cb174b471, user_id=e9e450bf1f98495f883ec4da462d1874, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:15.831701 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ed33f3-371f-4d0e-90ca-1bbc2d72ba73 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:15.841861 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1309/2657] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:59:15 2022] PUT /identity/v3/projects/d30685c996054c58a78c608cb174b471/users/e9e450bf1f98495f883ec4da462d1874/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:16.458015 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ae574-d269-4f41-9ffd-f0d49b295995 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:16.458299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ae574-d269-4f41-9ffd-f0d49b295995 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:16.458577 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ae574-d269-4f41-9ffd-f0d49b295995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:16.484042 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-328ae574-d269-4f41-9ffd-f0d49b295995 None None] MFA Rules not processed for user `e9e450bf1f98495f883ec4da462d1874`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:16.485247 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-328ae574-d269-4f41-9ffd-f0d49b295995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:16.552370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1349/2658] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:16 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:59:16.563931 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed33f3-371f-4d0e-90ca-1bbc2d72ba73 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:16.565733 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-25ed33f3-371f-4d0e-90ca-1bbc2d72ba73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:16.624211 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ed33f3-371f-4d0e-90ca-1bbc2d72ba73 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:16.627872 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3ff60-fc65-4e1f-9c36-e7eb6808ce1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:16.628519 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3ff60-fc65-4e1f-9c36-e7eb6808ce1d service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:16.628802 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3ff60-fc65-4e1f-9c36-e7eb6808ce1d service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:16.629079 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3ff60-fc65-4e1f-9c36-e7eb6808ce1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:16.682994 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3ff60-fc65-4e1f-9c36-e7eb6808ce1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:16.684408 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3ff60-fc65-4e1f-9c36-e7eb6808ce1d service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:16.693036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1310/2659] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:59:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:59:18.019139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ae574-d269-4f41-9ffd-f0d49b295995 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:18.021189 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-328ae574-d269-4f41-9ffd-f0d49b295995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:18.033452 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ae574-d269-4f41-9ffd-f0d49b295995 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:18.037131 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a79176-38f0-4a32-90a3-67b52052f018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:18.037764 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a79176-38f0-4a32-90a3-67b52052f018 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:18.038042 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a79176-38f0-4a32-90a3-67b52052f018 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:18.038311 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a79176-38f0-4a32-90a3-67b52052f018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:18.047682 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a79176-38f0-4a32-90a3-67b52052f018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:18.049093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a79176-38f0-4a32-90a3-67b52052f018 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:18.058796 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1350/2660] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:59:18 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:59:24.985573 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3ff60-fc65-4e1f-9c36-e7eb6808ce1d service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:24.987055 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f2d3ff60-fc65-4e1f-9c36-e7eb6808ce1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:25.059561 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3ff60-fc65-4e1f-9c36-e7eb6808ce1d service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:25.064960 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623fb56d-2ce3-4e56-9423-ddeccea01bed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:25.065595 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fb56d-2ce3-4e56-9423-ddeccea01bed service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:25.065879 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fb56d-2ce3-4e56-9423-ddeccea01bed service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:25.066155 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623fb56d-2ce3-4e56-9423-ddeccea01bed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:25.067918 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-623fb56d-2ce3-4e56-9423-ddeccea01bed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:25.122879 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623fb56d-2ce3-4e56-9423-ddeccea01bed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:25.124444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623fb56d-2ce3-4e56-9423-ddeccea01bed service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:25.133388 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1311/2661] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:59:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:59:29.296460 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a79176-38f0-4a32-90a3-67b52052f018 service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:29.297889 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f6a79176-38f0-4a32-90a3-67b52052f018 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:29.363921 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a79176-38f0-4a32-90a3-67b52052f018 service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:29.368868 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943718d9-6bff-46eb-89c8-21dcf8dac1d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f5ef8708f54401af7e8defa8d13141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:29.370134 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943718d9-6bff-46eb-89c8-21dcf8dac1d0 service placement] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:29.370417 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943718d9-6bff-46eb-89c8-21dcf8dac1d0 service placement] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:29.370715 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943718d9-6bff-46eb-89c8-21dcf8dac1d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:29.372576 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-943718d9-6bff-46eb-89c8-21dcf8dac1d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:29.383884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943718d9-6bff-46eb-89c8-21dcf8dac1d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:29.385453 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943718d9-6bff-46eb-89c8-21dcf8dac1d0 service placement] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:29.395328 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1351/2662] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:59:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:59:30.834334 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623fb56d-2ce3-4e56-9423-ddeccea01bed service nova] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:30.900967 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623fb56d-2ce3-4e56-9423-ddeccea01bed service nova] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:30.910523 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a5e1f-eb69-4d57-885b-346ed69ce550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:30.911519 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a5e1f-eb69-4d57-885b-346ed69ce550 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:30.911971 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a5e1f-eb69-4d57-885b-346ed69ce550 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:30.912898 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a5e1f-eb69-4d57-885b-346ed69ce550 admin admin] PATH_INFO: `/v3/users/f44682a063f44730bed1067ca7b955fd` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:30.914110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a5e1f-eb69-4d57-885b-346ed69ce550 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f44682a063f44730bed1067ca7b955fd)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:30.916423 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a5e1f-eb69-4d57-885b-346ed69ce550 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:30.967957 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3f2a5e1f-eb69-4d57-885b-346ed69ce550 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f44682a063f44730bed1067ca7b955fd'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:30.975765 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3f2a5e1f-eb69-4d57-885b-346ed69ce550 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f44682a063f44730bed1067ca7b955fd'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:30.976406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3f2a5e1f-eb69-4d57-885b-346ed69ce550 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f44682a063f44730bed1067ca7b955fd'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:30.983363 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3f2a5e1f-eb69-4d57-885b-346ed69ce550 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f44682a063f44730bed1067ca7b955fd'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:30.995288 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3f2a5e1f-eb69-4d57-885b-346ed69ce550 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f44682a063f44730bed1067ca7b955fd'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:31.002107 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1312/2663] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:59:30 2022] DELETE /identity/v3/users/f44682a063f44730bed1067ca7b955fd => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:31.076636 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943718d9-6bff-46eb-89c8-21dcf8dac1d0 service placement] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:31.078175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-943718d9-6bff-46eb-89c8-21dcf8dac1d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:31.133608 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943718d9-6bff-46eb-89c8-21dcf8dac1d0 service placement] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:31.183124 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33125cd0-cd66-4722-8edc-ca8dc3fa04aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:31.183810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33125cd0-cd66-4722-8edc-ca8dc3fa04aa service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:31.184093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33125cd0-cd66-4722-8edc-ca8dc3fa04aa service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:31.184369 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33125cd0-cd66-4722-8edc-ca8dc3fa04aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:31.186392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-33125cd0-cd66-4722-8edc-ca8dc3fa04aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:31.193077 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a5e1f-eb69-4d57-885b-346ed69ce550 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:31.194751 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-3f2a5e1f-eb69-4d57-885b-346ed69ce550 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:31.250185 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33125cd0-cd66-4722-8edc-ca8dc3fa04aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:31.251667 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33125cd0-cd66-4722-8edc-ca8dc3fa04aa service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:31.262606 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1352/2664] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:59:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:59:31.280215 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a5e1f-eb69-4d57-885b-346ed69ce550 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:31.284795 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453559b-f197-4ef2-88c9-eb38462fd99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:31.285672 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453559b-f197-4ef2-88c9-eb38462fd99a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:31.285948 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453559b-f197-4ef2-88c9-eb38462fd99a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:31.286216 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5453559b-f197-4ef2-88c9-eb38462fd99a admin admin] PATH_INFO: `/v3/projects/14a14cc6271941649a3531896f376192` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:31.287470 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453559b-f197-4ef2-88c9-eb38462fd99a admin admin] RBAC: Authorizing `identity:delete_project(project_id=14a14cc6271941649a3531896f376192)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:31.289371 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5453559b-f197-4ef2-88c9-eb38462fd99a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:31.336137 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5453559b-f197-4ef2-88c9-eb38462fd99a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14a14cc6271941649a3531896f376192', 'request_id': 'req-5453559b-f197-4ef2-88c9-eb38462fd99a'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:31.341781 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5453559b-f197-4ef2-88c9-eb38462fd99a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14a14cc6271941649a3531896f376192', 'request_id': 'req-5453559b-f197-4ef2-88c9-eb38462fd99a'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:31.347981 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5453559b-f197-4ef2-88c9-eb38462fd99a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14a14cc6271941649a3531896f376192', 'request_id': 'req-5453559b-f197-4ef2-88c9-eb38462fd99a'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:31.360394 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5453559b-f197-4ef2-88c9-eb38462fd99a admin admin] The token cache is being invalidate because project 14a14cc6271941649a3531896f376192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:59:31.360679 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5453559b-f197-4ef2-88c9-eb38462fd99a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:31.361301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-5453559b-f197-4ef2-88c9-eb38462fd99a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:31.363131 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1313/2665] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:59:31 2022] DELETE /identity/v3/projects/14a14cc6271941649a3531896f376192 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:59:31.366867 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33125cd0-cd66-4722-8edc-ca8dc3fa04aa service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:31.376940 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33125cd0-cd66-4722-8edc-ca8dc3fa04aa service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:31.431465 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08cc7e5-ada5-40b1-b75b-9aa984356cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:31.432394 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cc7e5-ada5-40b1-b75b-9aa984356cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:31.432665 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cc7e5-ada5-40b1-b75b-9aa984356cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:31.432940 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08cc7e5-ada5-40b1-b75b-9aa984356cdd admin admin] PATH_INFO: `/v3/users/e9e450bf1f98495f883ec4da462d1874` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:31.434135 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cc7e5-ada5-40b1-b75b-9aa984356cdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e450bf1f98495f883ec4da462d1874)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:31.436631 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08cc7e5-ada5-40b1-b75b-9aa984356cdd admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:31.481817 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-f08cc7e5-ada5-40b1-b75b-9aa984356cdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e450bf1f98495f883ec4da462d1874'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:31.482485 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-f08cc7e5-ada5-40b1-b75b-9aa984356cdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e450bf1f98495f883ec4da462d1874'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:31.489273 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-f08cc7e5-ada5-40b1-b75b-9aa984356cdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e450bf1f98495f883ec4da462d1874'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:31.496548 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-f08cc7e5-ada5-40b1-b75b-9aa984356cdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e450bf1f98495f883ec4da462d1874'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:31.508977 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-f08cc7e5-ada5-40b1-b75b-9aa984356cdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e450bf1f98495f883ec4da462d1874'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:31.515089 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1353/2666] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:59:31 2022] DELETE /identity/v3/users/e9e450bf1f98495f883ec4da462d1874 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:31.690003 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453559b-f197-4ef2-88c9-eb38462fd99a admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:31.691736 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5453559b-f197-4ef2-88c9-eb38462fd99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:31.704969 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5453559b-f197-4ef2-88c9-eb38462fd99a admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:31.763214 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eae4e1-8255-478c-86ce-bd92d8433063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:31.764127 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eae4e1-8255-478c-86ce-bd92d8433063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:31.764416 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eae4e1-8255-478c-86ce-bd92d8433063 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:31.764694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eae4e1-8255-478c-86ce-bd92d8433063 admin admin] PATH_INFO: `/v3/projects/d30685c996054c58a78c608cb174b471` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:31.765908 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eae4e1-8255-478c-86ce-bd92d8433063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30685c996054c58a78c608cb174b471)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:31.767875 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eae4e1-8255-478c-86ce-bd92d8433063 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:31.816008 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-74eae4e1-8255-478c-86ce-bd92d8433063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30685c996054c58a78c608cb174b471', 'request_id': 'req-74eae4e1-8255-478c-86ce-bd92d8433063'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:31.821185 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-74eae4e1-8255-478c-86ce-bd92d8433063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30685c996054c58a78c608cb174b471', 'request_id': 'req-74eae4e1-8255-478c-86ce-bd92d8433063'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:31.827126 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-74eae4e1-8255-478c-86ce-bd92d8433063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30685c996054c58a78c608cb174b471', 'request_id': 'req-74eae4e1-8255-478c-86ce-bd92d8433063'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:31.840421 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-74eae4e1-8255-478c-86ce-bd92d8433063 admin admin] The token cache is being invalidate because project d30685c996054c58a78c608cb174b471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:59:31.840994 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-74eae4e1-8255-478c-86ce-bd92d8433063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:31.841491 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-74eae4e1-8255-478c-86ce-bd92d8433063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:31.843232 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1314/2667] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:59:31 2022] DELETE /identity/v3/projects/d30685c996054c58a78c608cb174b471 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:31.847991 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe171b3-9943-4385-9032-2fad5838d08c None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:31.848278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe171b3-9943-4385-9032-2fad5838d08c None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:31.848558 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe171b3-9943-4385-9032-2fad5838d08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:31.866959 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-efe171b3-9943-4385-9032-2fad5838d08c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:31.868185 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-efe171b3-9943-4385-9032-2fad5838d08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:31.927501 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1354/2668] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:59:31.935569 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cba887-ce1f-44b1-9dd1-310827289329 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:31.935854 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cba887-ce1f-44b1-9dd1-310827289329 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:31.936126 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cba887-ce1f-44b1-9dd1-310827289329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:31.954236 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-f7cba887-ce1f-44b1-9dd1-310827289329 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:31.955455 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f7cba887-ce1f-44b1-9dd1-310827289329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:31.963813 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1315/2669] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:59:31.968192 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe171b3-9943-4385-9032-2fad5838d08c None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:31.977827 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe171b3-9943-4385-9032-2fad5838d08c None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:31.983006 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fce5f7-a334-4f3e-a0ba-c3c8c7397a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:31.983679 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fce5f7-a334-4f3e-a0ba-c3c8c7397a30 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:31.983962 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fce5f7-a334-4f3e-a0ba-c3c8c7397a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:31.984238 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fce5f7-a334-4f3e-a0ba-c3c8c7397a30 admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:31.985107 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fce5f7-a334-4f3e-a0ba-c3c8c7397a30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:59:31.985413 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fce5f7-a334-4f3e-a0ba-c3c8c7397a30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:31.987046 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fce5f7-a334-4f3e-a0ba-c3c8c7397a30 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:31.998513 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1355/2670] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:59:32.002957 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cba887-ce1f-44b1-9dd1-310827289329 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:32.013081 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cba887-ce1f-44b1-9dd1-310827289329 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:32.018186 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedaf7c8-53be-463c-ad0d-d03e4bd2a5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:32.018867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaf7c8-53be-463c-ad0d-d03e4bd2a5ba admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:32.019186 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaf7c8-53be-463c-ad0d-d03e4bd2a5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:32.019456 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaf7c8-53be-463c-ad0d-d03e4bd2a5ba admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:32.020182 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedaf7c8-53be-463c-ad0d-d03e4bd2a5ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:32.022132 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedaf7c8-53be-463c-ad0d-d03e4bd2a5ba admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:32.051749 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1316/2671] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:59:32 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:59:32.052984 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fce5f7-a334-4f3e-a0ba-c3c8c7397a30 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:32.063761 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fce5f7-a334-4f3e-a0ba-c3c8c7397a30 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:32.121529 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e6d59-ffb0-4e4d-a9e5-6b867358bb81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:32.122219 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e6d59-ffb0-4e4d-a9e5-6b867358bb81 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:32.122476 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e6d59-ffb0-4e4d-a9e5-6b867358bb81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:32.122781 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e6d59-ffb0-4e4d-a9e5-6b867358bb81 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:32.123470 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e6d59-ffb0-4e4d-a9e5-6b867358bb81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:32.125483 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e6d59-ffb0-4e4d-a9e5-6b867358bb81 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:32.151596 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1356/2672] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:59:32 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:59:32.156324 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedaf7c8-53be-463c-ad0d-d03e4bd2a5ba admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:32.166233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedaf7c8-53be-463c-ad0d-d03e4bd2a5ba admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:32.172175 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae383f-c60e-458c-8830-3606b6d49672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:32.172870 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae383f-c60e-458c-8830-3606b6d49672 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:32.173159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae383f-c60e-458c-8830-3606b6d49672 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:32.173439 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae383f-c60e-458c-8830-3606b6d49672 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:32.174171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae383f-c60e-458c-8830-3606b6d49672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:32.175899 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae383f-c60e-458c-8830-3606b6d49672 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:32.190010 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1317/2673] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:59:32.191238 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e6d59-ffb0-4e4d-a9e5-6b867358bb81 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:32.202880 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e6d59-ffb0-4e4d-a9e5-6b867358bb81 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:32.208767 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2ac9eb-e09a-4578-b3ee-d53a4294a4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:32.209542 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ac9eb-e09a-4578-b3ee-d53a4294a4ea admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:32.210046 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ac9eb-e09a-4578-b3ee-d53a4294a4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:32.210387 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2ac9eb-e09a-4578-b3ee-d53a4294a4ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:32.211322 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ac9eb-e09a-4578-b3ee-d53a4294a4ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:32.212946 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2ac9eb-e09a-4578-b3ee-d53a4294a4ea admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:32.228522 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1357/2674] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:59:32.229827 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae383f-c60e-458c-8830-3606b6d49672 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:32.240437 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae383f-c60e-458c-8830-3606b6d49672 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:32.246237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b763025-29a7-4703-a393-ada885f29220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:32.247503 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b763025-29a7-4703-a393-ada885f29220 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:32.247879 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b763025-29a7-4703-a393-ada885f29220 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:32.248235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b763025-29a7-4703-a393-ada885f29220 admin admin] PATH_INFO: `/v3/projects/67d6b6ea41e24a26844f3ab771df06f3/users/c71bc84081184b15a87e613b646ea096/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:32.264263 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b763025-29a7-4703-a393-ada885f29220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67d6b6ea41e24a26844f3ab771df06f3, user_id=c71bc84081184b15a87e613b646ea096, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:32.267304 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b763025-29a7-4703-a393-ada885f29220 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:32.283033 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1318/2675] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:59:32 2022] PUT /identity/v3/projects/67d6b6ea41e24a26844f3ab771df06f3/users/c71bc84081184b15a87e613b646ea096/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:59:32.294611 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1de9f7-e9fe-464a-9224-1a14d9f7fc0d None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:32.294931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1de9f7-e9fe-464a-9224-1a14d9f7fc0d None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:32.295406 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1de9f7-e9fe-464a-9224-1a14d9f7fc0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:32.327445 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-4e1de9f7-e9fe-464a-9224-1a14d9f7fc0d None None] MFA Rules not processed for user `c71bc84081184b15a87e613b646ea096`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:32.328796 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4e1de9f7-e9fe-464a-9224-1a14d9f7fc0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:32.395596 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1358/2676] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:59:32.407688 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b763025-29a7-4703-a393-ada885f29220 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:32.409342 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2b763025-29a7-4703-a393-ada885f29220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:32.467073 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b763025-29a7-4703-a393-ada885f29220 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:32.470801 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1846ff4-7410-444d-8f52-8408cd2752e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:32.471448 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1846ff4-7410-444d-8f52-8408cd2752e6 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:32.471737 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1846ff4-7410-444d-8f52-8408cd2752e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:32.472012 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1846ff4-7410-444d-8f52-8408cd2752e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:32.480424 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1846ff4-7410-444d-8f52-8408cd2752e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:32.481853 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1846ff4-7410-444d-8f52-8408cd2752e6 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:32.490554 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1319/2677] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:59:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:59:32.511091 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1de9f7-e9fe-464a-9224-1a14d9f7fc0d None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:32.574777 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1de9f7-e9fe-464a-9224-1a14d9f7fc0d None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:32.579371 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a3aca-b49b-40a4-a982-0aaf910b3d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:32.580258 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3aca-b49b-40a4-a982-0aaf910b3d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:32.580539 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3aca-b49b-40a4-a982-0aaf910b3d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:32.580811 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a3aca-b49b-40a4-a982-0aaf910b3d6c admin admin] PATH_INFO: `/v3/users/c71bc84081184b15a87e613b646ea096` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:32.582043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a3aca-b49b-40a4-a982-0aaf910b3d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71bc84081184b15a87e613b646ea096)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:32.584026 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a3aca-b49b-40a4-a982-0aaf910b3d6c admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:32.633854 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-939a3aca-b49b-40a4-a982-0aaf910b3d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71bc84081184b15a87e613b646ea096'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:32.634577 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-939a3aca-b49b-40a4-a982-0aaf910b3d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71bc84081184b15a87e613b646ea096'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:32.643131 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-939a3aca-b49b-40a4-a982-0aaf910b3d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71bc84081184b15a87e613b646ea096'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:32.650700 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-939a3aca-b49b-40a4-a982-0aaf910b3d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71bc84081184b15a87e613b646ea096'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:32.662384 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-939a3aca-b49b-40a4-a982-0aaf910b3d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71bc84081184b15a87e613b646ea096'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:32.668655 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1359/2678] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:59:32 2022] DELETE /identity/v3/users/c71bc84081184b15a87e613b646ea096 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:32.673266 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a11cfd-723a-462c-9925-d7515b162cbd None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:32.673643 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a11cfd-723a-462c-9925-d7515b162cbd None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:32.673844 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a11cfd-723a-462c-9925-d7515b162cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:32.692332 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-04a11cfd-723a-462c-9925-d7515b162cbd None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:32.693544 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-04a11cfd-723a-462c-9925-d7515b162cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:32.753392 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1320/2679] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:59:32.763957 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a3aca-b49b-40a4-a982-0aaf910b3d6c admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:32.765353 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-939a3aca-b49b-40a4-a982-0aaf910b3d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:32.820609 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a3aca-b49b-40a4-a982-0aaf910b3d6c admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:32.824884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17813723-e77a-4be3-be57-27423467397b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:32.825517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17813723-e77a-4be3-be57-27423467397b service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:32.825794 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17813723-e77a-4be3-be57-27423467397b service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:32.826067 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17813723-e77a-4be3-be57-27423467397b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:32.834976 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17813723-e77a-4be3-be57-27423467397b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:32.836398 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17813723-e77a-4be3-be57-27423467397b service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:32.845750 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1360/2680] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:59:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:59:33.133500 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a11cfd-723a-462c-9925-d7515b162cbd None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:33.136553 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-04a11cfd-723a-462c-9925-d7515b162cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:33.174389 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a11cfd-723a-462c-9925-d7515b162cbd None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:33.179575 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60479a5b-54d5-4ca8-862b-7417093efb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:33.180457 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60479a5b-54d5-4ca8-862b-7417093efb7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:33.180742 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60479a5b-54d5-4ca8-862b-7417093efb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:33.181019 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60479a5b-54d5-4ca8-862b-7417093efb7e admin admin] PATH_INFO: `/v3/projects/67d6b6ea41e24a26844f3ab771df06f3` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:33.182827 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60479a5b-54d5-4ca8-862b-7417093efb7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=67d6b6ea41e24a26844f3ab771df06f3)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:33.184867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60479a5b-54d5-4ca8-862b-7417093efb7e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:33.238349 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-60479a5b-54d5-4ca8-862b-7417093efb7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67d6b6ea41e24a26844f3ab771df06f3', 'request_id': 'req-60479a5b-54d5-4ca8-862b-7417093efb7e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:33.247453 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-60479a5b-54d5-4ca8-862b-7417093efb7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67d6b6ea41e24a26844f3ab771df06f3', 'request_id': 'req-60479a5b-54d5-4ca8-862b-7417093efb7e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:33.254110 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-60479a5b-54d5-4ca8-862b-7417093efb7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67d6b6ea41e24a26844f3ab771df06f3', 'request_id': 'req-60479a5b-54d5-4ca8-862b-7417093efb7e'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:33.283711 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-60479a5b-54d5-4ca8-862b-7417093efb7e admin admin] The token cache is being invalidate because project 67d6b6ea41e24a26844f3ab771df06f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:59:33.284008 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-60479a5b-54d5-4ca8-862b-7417093efb7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:33.284687 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-60479a5b-54d5-4ca8-862b-7417093efb7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:33.287032 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1321/2681] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:59:33 2022] DELETE /identity/v3/projects/67d6b6ea41e24a26844f3ab771df06f3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:33.292479 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb52b4c-184a-43c4-8b90-48bf2056b383 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:33.292982 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb52b4c-184a-43c4-8b90-48bf2056b383 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:33.293064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb52b4c-184a-43c4-8b90-48bf2056b383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:33.313091 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-3fb52b4c-184a-43c4-8b90-48bf2056b383 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:33.314358 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3fb52b4c-184a-43c4-8b90-48bf2056b383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:33.383022 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1361/2682] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:59:33.384765 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51751d0c-7cc0-45eb-afa7-6c1adc82ad66 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:33.385087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51751d0c-7cc0-45eb-afa7-6c1adc82ad66 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:33.385374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51751d0c-7cc0-45eb-afa7-6c1adc82ad66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:33.404593 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-51751d0c-7cc0-45eb-afa7-6c1adc82ad66 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:33.405917 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-51751d0c-7cc0-45eb-afa7-6c1adc82ad66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:33.415139 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1322/2683] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:59:33.421606 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb52b4c-184a-43c4-8b90-48bf2056b383 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:33.433242 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb52b4c-184a-43c4-8b90-48bf2056b383 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:33.438574 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b6dda-d27a-4536-bc03-e861e345aeaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:33.439361 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b6dda-d27a-4536-bc03-e861e345aeaf admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:33.439708 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b6dda-d27a-4536-bc03-e861e345aeaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:33.440054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2b6dda-d27a-4536-bc03-e861e345aeaf admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:33.440783 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b6dda-d27a-4536-bc03-e861e345aeaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:59:33.441086 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b6dda-d27a-4536-bc03-e861e345aeaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:33.442720 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2b6dda-d27a-4536-bc03-e861e345aeaf admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:33.455218 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1362/2684] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:59:33.459365 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51751d0c-7cc0-45eb-afa7-6c1adc82ad66 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:33.470542 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51751d0c-7cc0-45eb-afa7-6c1adc82ad66 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:33.476184 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf3e09-5bf2-4535-b7f1-88fd8b8fd82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:33.477189 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf3e09-5bf2-4535-b7f1-88fd8b8fd82e admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:33.477517 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf3e09-5bf2-4535-b7f1-88fd8b8fd82e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:33.477799 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf3e09-5bf2-4535-b7f1-88fd8b8fd82e admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:33.478501 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf3e09-5bf2-4535-b7f1-88fd8b8fd82e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:33.481352 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf3e09-5bf2-4535-b7f1-88fd8b8fd82e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:33.509579 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1323/2685] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:59:33 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:59:33.514064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b6dda-d27a-4536-bc03-e861e345aeaf admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:33.524514 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2b6dda-d27a-4536-bc03-e861e345aeaf admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:33.593359 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a57e70-c95d-4201-917d-add7688ad938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:33.594176 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a57e70-c95d-4201-917d-add7688ad938 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:33.594462 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a57e70-c95d-4201-917d-add7688ad938 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:33.594766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a57e70-c95d-4201-917d-add7688ad938 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:33.595449 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a57e70-c95d-4201-917d-add7688ad938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:33.597432 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a57e70-c95d-4201-917d-add7688ad938 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:33.618798 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1363/2686] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:59:33 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:59:33.622934 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf3e09-5bf2-4535-b7f1-88fd8b8fd82e admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:33.633281 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf3e09-5bf2-4535-b7f1-88fd8b8fd82e admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:33.638072 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567e882-d699-48a6-b75e-5597e0cf6faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:33.638760 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567e882-d699-48a6-b75e-5597e0cf6faa admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:33.639043 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567e882-d699-48a6-b75e-5597e0cf6faa admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:33.639318 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567e882-d699-48a6-b75e-5597e0cf6faa admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:33.640036 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567e882-d699-48a6-b75e-5597e0cf6faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:33.641626 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567e882-d699-48a6-b75e-5597e0cf6faa admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:33.652322 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1324/2687] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:59:33.656399 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a57e70-c95d-4201-917d-add7688ad938 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:33.666081 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a57e70-c95d-4201-917d-add7688ad938 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:33.671135 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b6d065-c3b0-4026-a8a6-ede3e3325519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:33.671782 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6d065-c3b0-4026-a8a6-ede3e3325519 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:33.672057 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6d065-c3b0-4026-a8a6-ede3e3325519 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:33.672326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b6d065-c3b0-4026-a8a6-ede3e3325519 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:33.673032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6d065-c3b0-4026-a8a6-ede3e3325519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:33.674624 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b6d065-c3b0-4026-a8a6-ede3e3325519 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:33.688227 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1364/2688] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:59:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:59:33.690189 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567e882-d699-48a6-b75e-5597e0cf6faa admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:33.700572 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567e882-d699-48a6-b75e-5597e0cf6faa admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:33.705678 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bc1cb-db0d-4f8b-bfa6-a9b52d375f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:33.706502 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bc1cb-db0d-4f8b-bfa6-a9b52d375f9b admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:33.706814 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bc1cb-db0d-4f8b-bfa6-a9b52d375f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:33.707088 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bc1cb-db0d-4f8b-bfa6-a9b52d375f9b admin admin] PATH_INFO: `/v3/projects/2b3c1c9aafa845d682c98cf4055c8862/users/769045f1e49940d7a5b8e6b26f9687f6/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:33.721991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bc1cb-db0d-4f8b-bfa6-a9b52d375f9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3c1c9aafa845d682c98cf4055c8862, user_id=769045f1e49940d7a5b8e6b26f9687f6, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:33.724632 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bc1cb-db0d-4f8b-bfa6-a9b52d375f9b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:33.737841 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1325/2689] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:59:33 2022] PUT /identity/v3/projects/2b3c1c9aafa845d682c98cf4055c8862/users/769045f1e49940d7a5b8e6b26f9687f6/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:59:33.748250 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e035d-46e7-4dcd-b9ed-158a5fc54eda None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:33.748629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e035d-46e7-4dcd-b9ed-158a5fc54eda None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:33.748986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e035d-46e7-4dcd-b9ed-158a5fc54eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:33.778052 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-8f8e035d-46e7-4dcd-b9ed-158a5fc54eda None None] MFA Rules not processed for user `769045f1e49940d7a5b8e6b26f9687f6`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:33.779266 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-8f8e035d-46e7-4dcd-b9ed-158a5fc54eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:33.846237 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1365/2690] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:59:33.857306 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bc1cb-db0d-4f8b-bfa6-a9b52d375f9b admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:33.859258 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a98bc1cb-db0d-4f8b-bfa6-a9b52d375f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:33.926181 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bc1cb-db0d-4f8b-bfa6-a9b52d375f9b admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:33.930437 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b41bcb-209c-4124-802c-24756de002af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:33.931272 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b41bcb-209c-4124-802c-24756de002af service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:33.931563 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b41bcb-209c-4124-802c-24756de002af service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:33.931838 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b41bcb-209c-4124-802c-24756de002af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:33.948149 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b41bcb-209c-4124-802c-24756de002af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:33.949609 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b41bcb-209c-4124-802c-24756de002af service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:33.960164 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1326/2691] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:59:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:59:36.518311 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e035d-46e7-4dcd-b9ed-158a5fc54eda None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:36.581290 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e035d-46e7-4dcd-b9ed-158a5fc54eda None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:36.585887 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaad59e-53f3-4b3b-8950-fb255e4a3f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:36.586819 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaad59e-53f3-4b3b-8950-fb255e4a3f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:36.587101 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaad59e-53f3-4b3b-8950-fb255e4a3f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:36.587381 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaad59e-53f3-4b3b-8950-fb255e4a3f94 admin admin] PATH_INFO: `/v3/users/769045f1e49940d7a5b8e6b26f9687f6` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:36.589132 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaad59e-53f3-4b3b-8950-fb255e4a3f94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=769045f1e49940d7a5b8e6b26f9687f6)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:36.592371 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaad59e-53f3-4b3b-8950-fb255e4a3f94 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:36.645797 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-bdaad59e-53f3-4b3b-8950-fb255e4a3f94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '769045f1e49940d7a5b8e6b26f9687f6'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:36.646569 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-bdaad59e-53f3-4b3b-8950-fb255e4a3f94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '769045f1e49940d7a5b8e6b26f9687f6'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:36.656503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-bdaad59e-53f3-4b3b-8950-fb255e4a3f94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '769045f1e49940d7a5b8e6b26f9687f6'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:36.663422 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-bdaad59e-53f3-4b3b-8950-fb255e4a3f94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '769045f1e49940d7a5b8e6b26f9687f6'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:36.677088 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-bdaad59e-53f3-4b3b-8950-fb255e4a3f94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '769045f1e49940d7a5b8e6b26f9687f6'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:36.683964 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1366/2692] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:59:36 2022] DELETE /identity/v3/users/769045f1e49940d7a5b8e6b26f9687f6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:36.688330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b7917-4d29-4682-b813-3e37414d773c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:36.688808 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b7917-4d29-4682-b813-3e37414d773c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:36.688993 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b7917-4d29-4682-b813-3e37414d773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:36.706288 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-809b7917-4d29-4682-b813-3e37414d773c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:36.707665 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-809b7917-4d29-4682-b813-3e37414d773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:36.778084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1327/2693] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:59:36.787813 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaad59e-53f3-4b3b-8950-fb255e4a3f94 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:36.789249 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-bdaad59e-53f3-4b3b-8950-fb255e4a3f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:36.846321 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaad59e-53f3-4b3b-8950-fb255e4a3f94 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:36.849916 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f52c28-5256-4fce-84fd-1897e72f09f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:36.850557 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f52c28-5256-4fce-84fd-1897e72f09f0 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:36.850873 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f52c28-5256-4fce-84fd-1897e72f09f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:36.851150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f52c28-5256-4fce-84fd-1897e72f09f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:36.860506 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f52c28-5256-4fce-84fd-1897e72f09f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:36.861937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f52c28-5256-4fce-84fd-1897e72f09f0 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:36.871844 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1367/2694] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:59:37.159030 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b7917-4d29-4682-b813-3e37414d773c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:37.160523 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-809b7917-4d29-4682-b813-3e37414d773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:37.178416 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b7917-4d29-4682-b813-3e37414d773c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:37.185534 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7920f8-8193-415a-98fb-ead71f4c5a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:37.186488 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7920f8-8193-415a-98fb-ead71f4c5a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:37.186859 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7920f8-8193-415a-98fb-ead71f4c5a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:37.187197 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7920f8-8193-415a-98fb-ead71f4c5a2f admin admin] PATH_INFO: `/v3/projects/2b3c1c9aafa845d682c98cf4055c8862` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:37.188451 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7920f8-8193-415a-98fb-ead71f4c5a2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b3c1c9aafa845d682c98cf4055c8862)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:37.190703 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7920f8-8193-415a-98fb-ead71f4c5a2f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:37.237592 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7e7920f8-8193-415a-98fb-ead71f4c5a2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b3c1c9aafa845d682c98cf4055c8862', 'request_id': 'req-7e7920f8-8193-415a-98fb-ead71f4c5a2f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:37.243460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7e7920f8-8193-415a-98fb-ead71f4c5a2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b3c1c9aafa845d682c98cf4055c8862', 'request_id': 'req-7e7920f8-8193-415a-98fb-ead71f4c5a2f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:37.250839 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7e7920f8-8193-415a-98fb-ead71f4c5a2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b3c1c9aafa845d682c98cf4055c8862', 'request_id': 'req-7e7920f8-8193-415a-98fb-ead71f4c5a2f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:37.267782 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7e7920f8-8193-415a-98fb-ead71f4c5a2f admin admin] The token cache is being invalidate because project 2b3c1c9aafa845d682c98cf4055c8862 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:59:37.268309 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7e7920f8-8193-415a-98fb-ead71f4c5a2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:37.269209 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-7e7920f8-8193-415a-98fb-ead71f4c5a2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:37.272405 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1328/2695] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:59:37 2022] DELETE /identity/v3/projects/2b3c1c9aafa845d682c98cf4055c8862 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:37.277213 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb7c1e-3d6d-4e88-8948-4e46e86d6e22 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:37.277730 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb7c1e-3d6d-4e88-8948-4e46e86d6e22 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:37.278103 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb7c1e-3d6d-4e88-8948-4e46e86d6e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:37.296728 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-09eb7c1e-3d6d-4e88-8948-4e46e86d6e22 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:37.298424 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-09eb7c1e-3d6d-4e88-8948-4e46e86d6e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:37.368100 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1368/2696] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:59:37.378735 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa39c5d-fb57-4d04-a860-4846631e7c4c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:37.379028 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa39c5d-fb57-4d04-a860-4846631e7c4c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:37.379350 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa39c5d-fb57-4d04-a860-4846631e7c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:37.402074 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-0aa39c5d-fb57-4d04-a860-4846631e7c4c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:37.403383 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0aa39c5d-fb57-4d04-a860-4846631e7c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:37.411280 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1329/2697] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:59:37.415401 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb7c1e-3d6d-4e88-8948-4e46e86d6e22 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:37.425294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eb7c1e-3d6d-4e88-8948-4e46e86d6e22 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:37.429728 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b211fb-766f-494b-8c13-46ddb975b5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:37.430408 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b211fb-766f-494b-8c13-46ddb975b5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:37.430657 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b211fb-766f-494b-8c13-46ddb975b5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:37.430932 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b211fb-766f-494b-8c13-46ddb975b5d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:37.431645 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b211fb-766f-494b-8c13-46ddb975b5d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:59:37.431988 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b211fb-766f-494b-8c13-46ddb975b5d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:37.433693 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b211fb-766f-494b-8c13-46ddb975b5d4 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:37.449673 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1369/2698] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 16:59:37.450952 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa39c5d-fb57-4d04-a860-4846631e7c4c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:37.461268 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa39c5d-fb57-4d04-a860-4846631e7c4c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:37.470104 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a95a38-d985-4043-ba0f-57516c86084d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:37.470991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a95a38-d985-4043-ba0f-57516c86084d admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:37.471419 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a95a38-d985-4043-ba0f-57516c86084d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:37.471835 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a95a38-d985-4043-ba0f-57516c86084d admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:37.472680 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a95a38-d985-4043-ba0f-57516c86084d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:37.474576 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a95a38-d985-4043-ba0f-57516c86084d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:37.520900 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1330/2699] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:59:37 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:59:37.521775 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b211fb-766f-494b-8c13-46ddb975b5d4 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:37.538111 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b211fb-766f-494b-8c13-46ddb975b5d4 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:37.619879 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485e5e5-76aa-4286-9d84-cb574a828f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:37.620855 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485e5e5-76aa-4286-9d84-cb574a828f3b admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:37.621304 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485e5e5-76aa-4286-9d84-cb574a828f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:37.621870 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485e5e5-76aa-4286-9d84-cb574a828f3b admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:37.622771 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485e5e5-76aa-4286-9d84-cb574a828f3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:37.625120 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d485e5e5-76aa-4286-9d84-cb574a828f3b admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:37.658858 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1370/2700] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:59:37 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:59:37.662909 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a95a38-d985-4043-ba0f-57516c86084d admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:37.679179 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a95a38-d985-4043-ba0f-57516c86084d admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:37.690952 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b99a9-e9c5-4b59-93dd-8b8445848641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:37.692265 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b99a9-e9c5-4b59-93dd-8b8445848641 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:37.692820 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b99a9-e9c5-4b59-93dd-8b8445848641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:37.693402 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9b99a9-e9c5-4b59-93dd-8b8445848641 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:37.694326 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b99a9-e9c5-4b59-93dd-8b8445848641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:37.696385 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9b99a9-e9c5-4b59-93dd-8b8445848641 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:37.710375 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1331/2701] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:59:37.714684 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485e5e5-76aa-4286-9d84-cb574a828f3b admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:37.732085 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d485e5e5-76aa-4286-9d84-cb574a828f3b admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:37.737738 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b263bc6-b165-4332-83cc-58df421a17ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:37.738998 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b263bc6-b165-4332-83cc-58df421a17ac admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:37.739303 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b263bc6-b165-4332-83cc-58df421a17ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:37.739680 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b263bc6-b165-4332-83cc-58df421a17ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:37.740553 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b263bc6-b165-4332-83cc-58df421a17ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:37.742448 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b263bc6-b165-4332-83cc-58df421a17ac admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:37.763995 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1371/2702] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:59:37.765249 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b99a9-e9c5-4b59-93dd-8b8445848641 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:37.776589 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9b99a9-e9c5-4b59-93dd-8b8445848641 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:37.782661 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b8533-1b81-4a96-bb8c-26c0f893527b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:37.783554 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b8533-1b81-4a96-bb8c-26c0f893527b admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:37.783829 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b8533-1b81-4a96-bb8c-26c0f893527b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:37.784097 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b8533-1b81-4a96-bb8c-26c0f893527b admin admin] PATH_INFO: `/v3/projects/2067717239ba4ba98dad9abb6ea203c0/users/ed8dcc8d3d0d44be80a7385e5e8ebe9c/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:37.801746 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b8533-1b81-4a96-bb8c-26c0f893527b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2067717239ba4ba98dad9abb6ea203c0, user_id=ed8dcc8d3d0d44be80a7385e5e8ebe9c, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:37.805450 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b8533-1b81-4a96-bb8c-26c0f893527b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:37.841346 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b263bc6-b165-4332-83cc-58df421a17ac admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:37.843244 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4b263bc6-b165-4332-83cc-58df421a17ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:37.852739 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1332/2703] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:59:37 2022] PUT /identity/v3/projects/2067717239ba4ba98dad9abb6ea203c0/users/ed8dcc8d3d0d44be80a7385e5e8ebe9c/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:37.854555 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2581-e1aa-4418-b405-1c98aff7c1a2 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:37.854936 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2581-e1aa-4418-b405-1c98aff7c1a2 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:37.855166 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d2581-e1aa-4418-b405-1c98aff7c1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:37.879227 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b263bc6-b165-4332-83cc-58df421a17ac admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:37.902376 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-439d2581-e1aa-4418-b405-1c98aff7c1a2 None None] MFA Rules not processed for user `ed8dcc8d3d0d44be80a7385e5e8ebe9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:37.904770 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-439d2581-e1aa-4418-b405-1c98aff7c1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:37.941855 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903644b-ac7a-4d7e-944d-e43eff8c94cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:37.942708 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903644b-ac7a-4d7e-944d-e43eff8c94cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:37.942994 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903644b-ac7a-4d7e-944d-e43eff8c94cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:37.943288 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903644b-ac7a-4d7e-944d-e43eff8c94cf admin admin] PATH_INFO: `/v3/users/a0721ecc1e5c4953aabac3fdad59b261` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:37.944672 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903644b-ac7a-4d7e-944d-e43eff8c94cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0721ecc1e5c4953aabac3fdad59b261)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:37.946725 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903644b-ac7a-4d7e-944d-e43eff8c94cf admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:37.969942 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1333/2704] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:59:37.982089 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d2581-e1aa-4418-b405-1c98aff7c1a2 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:37.983685 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-439d2581-e1aa-4418-b405-1c98aff7c1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:37.998634 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b903644b-ac7a-4d7e-944d-e43eff8c94cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0721ecc1e5c4953aabac3fdad59b261'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:37.999443 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b903644b-ac7a-4d7e-944d-e43eff8c94cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0721ecc1e5c4953aabac3fdad59b261'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.007205 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b903644b-ac7a-4d7e-944d-e43eff8c94cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0721ecc1e5c4953aabac3fdad59b261'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.015255 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b903644b-ac7a-4d7e-944d-e43eff8c94cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0721ecc1e5c4953aabac3fdad59b261'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.030463 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b903644b-ac7a-4d7e-944d-e43eff8c94cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0721ecc1e5c4953aabac3fdad59b261'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.036651 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1372/2705] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:59:37 2022] DELETE /identity/v3/users/a0721ecc1e5c4953aabac3fdad59b261 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:38.043008 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d2581-e1aa-4418-b405-1c98aff7c1a2 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:38.089995 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b87e8-5d17-4b50-8f0f-c7fd43906089 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:38.090692 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b87e8-5d17-4b50-8f0f-c7fd43906089 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:38.090973 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b87e8-5d17-4b50-8f0f-c7fd43906089 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:38.091246 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b87e8-5d17-4b50-8f0f-c7fd43906089 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:38.092997 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bc4b87e8-5d17-4b50-8f0f-c7fd43906089 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:38.153821 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b87e8-5d17-4b50-8f0f-c7fd43906089 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:38.155281 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b87e8-5d17-4b50-8f0f-c7fd43906089 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:38.164057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1334/2706] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:59:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:59:38.189084 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903644b-ac7a-4d7e-944d-e43eff8c94cf admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:38.190583 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b903644b-ac7a-4d7e-944d-e43eff8c94cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:38.214107 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b87e8-5d17-4b50-8f0f-c7fd43906089 service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:38.215655 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bc4b87e8-5d17-4b50-8f0f-c7fd43906089 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:38.263389 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903644b-ac7a-4d7e-944d-e43eff8c94cf admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:38.268268 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acefd6-2b08-423c-bc8b-8fdf8ba4b052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:38.269149 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acefd6-2b08-423c-bc8b-8fdf8ba4b052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:38.269424 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acefd6-2b08-423c-bc8b-8fdf8ba4b052 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:38.269691 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acefd6-2b08-423c-bc8b-8fdf8ba4b052 admin admin] PATH_INFO: `/v3/users/ed8dcc8d3d0d44be80a7385e5e8ebe9c` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:38.271176 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acefd6-2b08-423c-bc8b-8fdf8ba4b052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed8dcc8d3d0d44be80a7385e5e8ebe9c)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:38.273126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acefd6-2b08-423c-bc8b-8fdf8ba4b052 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:38.292442 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b87e8-5d17-4b50-8f0f-c7fd43906089 service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:38.297378 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4567f7c-99f6-4fa9-b577-b860545cc746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:38.298422 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4567f7c-99f6-4fa9-b577-b860545cc746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:38.298737 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4567f7c-99f6-4fa9-b577-b860545cc746 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:38.299011 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4567f7c-99f6-4fa9-b577-b860545cc746 admin admin] PATH_INFO: `/v3/projects/3005863d507649d3ba7854fb41792452` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:38.300284 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4567f7c-99f6-4fa9-b577-b860545cc746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3005863d507649d3ba7854fb41792452)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:38.302473 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4567f7c-99f6-4fa9-b577-b860545cc746 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:38.328021 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-04acefd6-2b08-423c-bc8b-8fdf8ba4b052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed8dcc8d3d0d44be80a7385e5e8ebe9c'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.328967 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-04acefd6-2b08-423c-bc8b-8fdf8ba4b052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed8dcc8d3d0d44be80a7385e5e8ebe9c'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.337486 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-04acefd6-2b08-423c-bc8b-8fdf8ba4b052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed8dcc8d3d0d44be80a7385e5e8ebe9c'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.346906 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-04acefd6-2b08-423c-bc8b-8fdf8ba4b052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed8dcc8d3d0d44be80a7385e5e8ebe9c'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.353494 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c4567f7c-99f6-4fa9-b577-b860545cc746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3005863d507649d3ba7854fb41792452', 'request_id': 'req-c4567f7c-99f6-4fa9-b577-b860545cc746'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.359757 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-04acefd6-2b08-423c-bc8b-8fdf8ba4b052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed8dcc8d3d0d44be80a7385e5e8ebe9c'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.359940 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c4567f7c-99f6-4fa9-b577-b860545cc746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3005863d507649d3ba7854fb41792452', 'request_id': 'req-c4567f7c-99f6-4fa9-b577-b860545cc746'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.365882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1373/2707] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:59:38 2022] DELETE /identity/v3/users/ed8dcc8d3d0d44be80a7385e5e8ebe9c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:38.367134 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c4567f7c-99f6-4fa9-b577-b860545cc746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3005863d507649d3ba7854fb41792452', 'request_id': 'req-c4567f7c-99f6-4fa9-b577-b860545cc746'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.371267 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27d8ca-7fad-4572-b582-c3dd8c8af255 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:38.371569 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27d8ca-7fad-4572-b582-c3dd8c8af255 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:38.371809 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27d8ca-7fad-4572-b582-c3dd8c8af255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:38.382759 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c4567f7c-99f6-4fa9-b577-b860545cc746 admin admin] The token cache is being invalidate because project 3005863d507649d3ba7854fb41792452 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:59:38.383188 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c4567f7c-99f6-4fa9-b577-b860545cc746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.384219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-c4567f7c-99f6-4fa9-b577-b860545cc746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.385939 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1335/2708] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:59:38 2022] DELETE /identity/v3/projects/3005863d507649d3ba7854fb41792452 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:59:38.389982 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4567f7c-99f6-4fa9-b577-b860545cc746 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:38.391727 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c4567f7c-99f6-4fa9-b577-b860545cc746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:38.402203 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-5a27d8ca-7fad-4572-b582-c3dd8c8af255 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:38.403394 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-5a27d8ca-7fad-4572-b582-c3dd8c8af255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:38.454184 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4567f7c-99f6-4fa9-b577-b860545cc746 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:38.458846 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649312d5-df00-4a26-885f-41004b0f7bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:38.459641 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649312d5-df00-4a26-885f-41004b0f7bc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:38.459921 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649312d5-df00-4a26-885f-41004b0f7bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:38.460190 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649312d5-df00-4a26-885f-41004b0f7bc8 admin admin] PATH_INFO: `/v3/users/f8cdb68f5a8544b1a333c2413ca10bba` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:38.460740 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1374/2709] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 16:59:38.461380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649312d5-df00-4a26-885f-41004b0f7bc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8cdb68f5a8544b1a333c2413ca10bba)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:38.463342 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649312d5-df00-4a26-885f-41004b0f7bc8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:38.469921 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27d8ca-7fad-4572-b582-c3dd8c8af255 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:38.471636 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-5a27d8ca-7fad-4572-b582-c3dd8c8af255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:38.510076 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-649312d5-df00-4a26-885f-41004b0f7bc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8cdb68f5a8544b1a333c2413ca10bba'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.517637 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-649312d5-df00-4a26-885f-41004b0f7bc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8cdb68f5a8544b1a333c2413ca10bba'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.518312 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-649312d5-df00-4a26-885f-41004b0f7bc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8cdb68f5a8544b1a333c2413ca10bba'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.524980 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-649312d5-df00-4a26-885f-41004b0f7bc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8cdb68f5a8544b1a333c2413ca10bba'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.532986 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a27d8ca-7fad-4572-b582-c3dd8c8af255 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:38.537945 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-649312d5-df00-4a26-885f-41004b0f7bc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8cdb68f5a8544b1a333c2413ca10bba'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.538221 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca574a-58b4-45a9-8765-9b6352707b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:38.539094 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca574a-58b4-45a9-8765-9b6352707b78 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:38.539660 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca574a-58b4-45a9-8765-9b6352707b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:38.540101 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca574a-58b4-45a9-8765-9b6352707b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:38.542859 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a9ca574a-58b4-45a9-8765-9b6352707b78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:38.544935 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1336/2710] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 16:59:38 2022] DELETE /identity/v3/users/f8cdb68f5a8544b1a333c2413ca10bba => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:59:38.555812 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca574a-58b4-45a9-8765-9b6352707b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:38.558232 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca574a-58b4-45a9-8765-9b6352707b78 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:38.569666 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1375/2711] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:59:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 16:59:38.756698 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649312d5-df00-4a26-885f-41004b0f7bc8 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:38.758669 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-649312d5-df00-4a26-885f-41004b0f7bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:38.828252 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649312d5-df00-4a26-885f-41004b0f7bc8 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:38.833077 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa80b5e4-9e0c-4857-89e6-d3edbd1dc62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:38.834023 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b5e4-9e0c-4857-89e6-d3edbd1dc62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:38.834372 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b5e4-9e0c-4857-89e6-d3edbd1dc62d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:38.834679 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa80b5e4-9e0c-4857-89e6-d3edbd1dc62d admin admin] PATH_INFO: `/v3/projects/d0e02a55f7204ca098b4d52ac9c245c1` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:38.835887 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80b5e4-9e0c-4857-89e6-d3edbd1dc62d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0e02a55f7204ca098b4d52ac9c245c1)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:38.838171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa80b5e4-9e0c-4857-89e6-d3edbd1dc62d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:38.861516 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca574a-58b4-45a9-8765-9b6352707b78 service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:38.863094 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a9ca574a-58b4-45a9-8765-9b6352707b78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:38.881243 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca574a-58b4-45a9-8765-9b6352707b78 service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:38.890128 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-aa80b5e4-9e0c-4857-89e6-d3edbd1dc62d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0e02a55f7204ca098b4d52ac9c245c1', 'request_id': 'req-aa80b5e4-9e0c-4857-89e6-d3edbd1dc62d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.896004 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-aa80b5e4-9e0c-4857-89e6-d3edbd1dc62d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0e02a55f7204ca098b4d52ac9c245c1', 'request_id': 'req-aa80b5e4-9e0c-4857-89e6-d3edbd1dc62d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.902957 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-aa80b5e4-9e0c-4857-89e6-d3edbd1dc62d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0e02a55f7204ca098b4d52ac9c245c1', 'request_id': 'req-aa80b5e4-9e0c-4857-89e6-d3edbd1dc62d'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.916338 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-aa80b5e4-9e0c-4857-89e6-d3edbd1dc62d admin admin] The token cache is being invalidate because project d0e02a55f7204ca098b4d52ac9c245c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:59:38.917187 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-aa80b5e4-9e0c-4857-89e6-d3edbd1dc62d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.917805 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-aa80b5e4-9e0c-4857-89e6-d3edbd1dc62d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:38.919441 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1337/2712] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:59:38 2022] DELETE /identity/v3/projects/d0e02a55f7204ca098b4d52ac9c245c1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:38.954317 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf0233-81a1-4c4d-a11f-de329a219986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:38.955227 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf0233-81a1-4c4d-a11f-de329a219986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:38.955508 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf0233-81a1-4c4d-a11f-de329a219986 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:38.955781 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf0233-81a1-4c4d-a11f-de329a219986 admin admin] PATH_INFO: `/v3/projects/2067717239ba4ba98dad9abb6ea203c0` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:38.957059 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf0233-81a1-4c4d-a11f-de329a219986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2067717239ba4ba98dad9abb6ea203c0)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:38.959124 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf0233-81a1-4c4d-a11f-de329a219986 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:39.011483 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-8ccf0233-81a1-4c4d-a11f-de329a219986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2067717239ba4ba98dad9abb6ea203c0', 'request_id': 'req-8ccf0233-81a1-4c4d-a11f-de329a219986'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:39.017706 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-8ccf0233-81a1-4c4d-a11f-de329a219986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2067717239ba4ba98dad9abb6ea203c0', 'request_id': 'req-8ccf0233-81a1-4c4d-a11f-de329a219986'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:39.024558 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-8ccf0233-81a1-4c4d-a11f-de329a219986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2067717239ba4ba98dad9abb6ea203c0', 'request_id': 'req-8ccf0233-81a1-4c4d-a11f-de329a219986'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:39.039585 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-8ccf0233-81a1-4c4d-a11f-de329a219986 admin admin] The token cache is being invalidate because project 2067717239ba4ba98dad9abb6ea203c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 16:59:39.039872 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-8ccf0233-81a1-4c4d-a11f-de329a219986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:39.040553 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-8ccf0233-81a1-4c4d-a11f-de329a219986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 16:59:39.042169 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1376/2713] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 16:59:38 2022] DELETE /identity/v3/projects/2067717239ba4ba98dad9abb6ea203c0 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 16:59:39.047092 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2348f72-d81b-4f89-861d-9e29e8f52373 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:39.047408 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2348f72-d81b-4f89-861d-9e29e8f52373 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:39.047683 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2348f72-d81b-4f89-861d-9e29e8f52373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:39.067023 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-b2348f72-d81b-4f89-861d-9e29e8f52373 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:39.068378 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b2348f72-d81b-4f89-861d-9e29e8f52373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:39.129134 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1338/2714] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:59:39.137945 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f02b22-1848-4ecd-a802-3058d7a60c25 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:39.138231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f02b22-1848-4ecd-a802-3058d7a60c25 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:39.138503 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f02b22-1848-4ecd-a802-3058d7a60c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:39.157444 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-a3f02b22-1848-4ecd-a802-3058d7a60c25 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:39.158638 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a3f02b22-1848-4ecd-a802-3058d7a60c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:39.166248 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1377/2715] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:59:39.170664 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2348f72-d81b-4f89-861d-9e29e8f52373 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:39.180248 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2348f72-d81b-4f89-861d-9e29e8f52373 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:39.184875 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f34c7-d272-4859-b3d4-f73ce19a407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:39.185520 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f34c7-d272-4859-b3d4-f73ce19a407f admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:39.185807 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f34c7-d272-4859-b3d4-f73ce19a407f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:39.186081 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f34c7-d272-4859-b3d4-f73ce19a407f admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:39.186861 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f34c7-d272-4859-b3d4-f73ce19a407f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 16:59:39.187169 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f34c7-d272-4859-b3d4-f73ce19a407f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:39.188747 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f34c7-d272-4859-b3d4-f73ce19a407f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:39.200409 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1339/2716] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 16:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 16:59:39.204490 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f02b22-1848-4ecd-a802-3058d7a60c25 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:39.213893 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f02b22-1848-4ecd-a802-3058d7a60c25 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:39.218559 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae899a3-cd15-4289-95d5-06de894332d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:39.219223 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae899a3-cd15-4289-95d5-06de894332d6 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:39.219498 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae899a3-cd15-4289-95d5-06de894332d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:39.219769 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae899a3-cd15-4289-95d5-06de894332d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:39.220448 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae899a3-cd15-4289-95d5-06de894332d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:39.222328 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae899a3-cd15-4289-95d5-06de894332d6 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:39.246444 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1378/2717] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 16:59:39 2022] POST /identity/v3/projects => generated 383 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 16:59:39.250415 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f34c7-d272-4859-b3d4-f73ce19a407f admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:39.260995 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f34c7-d272-4859-b3d4-f73ce19a407f admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:39.315490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15665897-39f1-4b1d-bb68-4e8f5d8e2ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:39.316078 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15665897-39f1-4b1d-bb68-4e8f5d8e2ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:39.316369 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15665897-39f1-4b1d-bb68-4e8f5d8e2ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:39.316691 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15665897-39f1-4b1d-bb68-4e8f5d8e2ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:39.317356 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15665897-39f1-4b1d-bb68-4e8f5d8e2ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:39.319314 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15665897-39f1-4b1d-bb68-4e8f5d8e2ad9 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:39.338336 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1340/2718] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 16:59:39 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 16:59:39.342606 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae899a3-cd15-4289-95d5-06de894332d6 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:39.352620 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae899a3-cd15-4289-95d5-06de894332d6 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:39.357156 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a43e9e-3950-4c73-ae5c-79c94b9116ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:39.357798 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a43e9e-3950-4c73-ae5c-79c94b9116ca admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:39.358079 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a43e9e-3950-4c73-ae5c-79c94b9116ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:39.358352 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a43e9e-3950-4c73-ae5c-79c94b9116ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:39.359110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a43e9e-3950-4c73-ae5c-79c94b9116ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:39.360708 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a43e9e-3950-4c73-ae5c-79c94b9116ca admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:39.371199 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1379/2719] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 16:59:39.374861 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15665897-39f1-4b1d-bb68-4e8f5d8e2ad9 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:39.384860 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15665897-39f1-4b1d-bb68-4e8f5d8e2ad9 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:39.389957 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5cc8d-9220-4a38-847e-ed7846abeb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:39.390619 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5cc8d-9220-4a38-847e-ed7846abeb46 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:39.390916 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5cc8d-9220-4a38-847e-ed7846abeb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:39.391190 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5cc8d-9220-4a38-847e-ed7846abeb46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:39.391905 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5cc8d-9220-4a38-847e-ed7846abeb46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:39.393476 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5cc8d-9220-4a38-847e-ed7846abeb46 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:39.403062 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1341/2720] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 16:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 16:59:39.406731 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a43e9e-3950-4c73-ae5c-79c94b9116ca admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:39.416083 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a43e9e-3950-4c73-ae5c-79c94b9116ca admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:39.420629 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031a924-125a-4df1-8b86-12f14328dffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:39.421477 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031a924-125a-4df1-8b86-12f14328dffe admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:39.421755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031a924-125a-4df1-8b86-12f14328dffe admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:39.422025 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031a924-125a-4df1-8b86-12f14328dffe admin admin] PATH_INFO: `/v3/projects/376d25cef0b9485cac2e8520a9ecd259/users/64d4eadc9e7446a5b4a95bfed38bf787/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:39.436493 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031a924-125a-4df1-8b86-12f14328dffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=376d25cef0b9485cac2e8520a9ecd259, user_id=64d4eadc9e7446a5b4a95bfed38bf787, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:39.439158 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8031a924-125a-4df1-8b86-12f14328dffe admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:39.451395 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1380/2721] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 16:59:39 2022] PUT /identity/v3/projects/376d25cef0b9485cac2e8520a9ecd259/users/64d4eadc9e7446a5b4a95bfed38bf787/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 16:59:39.456336 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940cff7-6508-41ee-a7b1-91ac9393f22c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:39.456625 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940cff7-6508-41ee-a7b1-91ac9393f22c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:39.456904 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2940cff7-6508-41ee-a7b1-91ac9393f22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:39.473610 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-2940cff7-6508-41ee-a7b1-91ac9393f22c None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:39.474820 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-2940cff7-6508-41ee-a7b1-91ac9393f22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:39.532496 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1342/2722] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:59:39.542185 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031a924-125a-4df1-8b86-12f14328dffe admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:39.543937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-8031a924-125a-4df1-8b86-12f14328dffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:39.597823 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031a924-125a-4df1-8b86-12f14328dffe admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:39.601328 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a6b9f-ee65-4d58-ad3e-4b2b3b601c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:39.601954 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a6b9f-ee65-4d58-ad3e-4b2b3b601c11 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:39.602231 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a6b9f-ee65-4d58-ad3e-4b2b3b601c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:39.602500 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a6b9f-ee65-4d58-ad3e-4b2b3b601c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:39.611276 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a6b9f-ee65-4d58-ad3e-4b2b3b601c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:39.612706 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a6b9f-ee65-4d58-ad3e-4b2b3b601c11 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:39.622304 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1381/2723] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:59:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:59:40.198380 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aff30f-4543-4d3a-8c20-e7352bfe4c7f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:40.198934 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aff30f-4543-4d3a-8c20-e7352bfe4c7f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:40.198934 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aff30f-4543-4d3a-8c20-e7352bfe4c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:40.225035 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-57aff30f-4543-4d3a-8c20-e7352bfe4c7f None None] MFA Rules not processed for user `64d4eadc9e7446a5b4a95bfed38bf787`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:40.226235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-57aff30f-4543-4d3a-8c20-e7352bfe4c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:40.290342 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1343/2724] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:59:40.301715 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a6b9f-ee65-4d58-ad3e-4b2b3b601c11 service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:40.303134 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-758a6b9f-ee65-4d58-ad3e-4b2b3b601c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:40.358568 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a6b9f-ee65-4d58-ad3e-4b2b3b601c11 service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:40.362068 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363f1f0-1103-478c-8409-ca93aa5809b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:40.362735 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363f1f0-1103-478c-8409-ca93aa5809b2 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:40.363016 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363f1f0-1103-478c-8409-ca93aa5809b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:40.363287 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d363f1f0-1103-478c-8409-ca93aa5809b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:40.372650 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363f1f0-1103-478c-8409-ca93aa5809b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:40.374067 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d363f1f0-1103-478c-8409-ca93aa5809b2 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:40.383104 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1382/2725] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:59:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:59:41.707285 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c5cc1-703b-41ed-a0b2-e8168397098f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:41.707764 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c5cc1-703b-41ed-a0b2-e8168397098f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:41.707859 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c5cc1-703b-41ed-a0b2-e8168397098f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:41.725289 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-d40c5cc1-703b-41ed-a0b2-e8168397098f None None] MFA Rules not processed for user `64d4eadc9e7446a5b4a95bfed38bf787`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:41.726464 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d40c5cc1-703b-41ed-a0b2-e8168397098f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:41.733371 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1344/2726] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 16:59:49.264641 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363f1f0-1103-478c-8409-ca93aa5809b2 service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 16:59:49.266100 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d363f1f0-1103-478c-8409-ca93aa5809b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:49.277594 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d363f1f0-1103-478c-8409-ca93aa5809b2 service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 16:59:49.281146 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f906e30-6824-4a72-a3a2-1b204879dc83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 16:59:49.281774 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f906e30-6824-4a72-a3a2-1b204879dc83 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:49.282052 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f906e30-6824-4a72-a3a2-1b204879dc83 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:49.282324 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f906e30-6824-4a72-a3a2-1b204879dc83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:49.284021 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3f906e30-6824-4a72-a3a2-1b204879dc83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:49.340249 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f906e30-6824-4a72-a3a2-1b204879dc83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 16:59:49.341695 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f906e30-6824-4a72-a3a2-1b204879dc83 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 16:59:49.350712 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1383/2727] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 16:59:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 16:59:57.189040 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafe80d-aa5d-442b-bb9a-1c81539af33f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 16:59:57.189558 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafe80d-aa5d-442b-bb9a-1c81539af33f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 16:59:57.189558 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafe80d-aa5d-442b-bb9a-1c81539af33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 16:59:57.207091 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-0bafe80d-aa5d-442b-bb9a-1c81539af33f None None] MFA Rules not processed for user `de624ce35a9b4c2b8b0ac5301c54f799`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 16:59:57.208205 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-0bafe80d-aa5d-442b-bb9a-1c81539af33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 16:59:57.214953 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1345/2728] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 16:59:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:00:08.370396 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f1a59-83a1-4fd3-bc8a-f1bda7bd9d48 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:00:08.370862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f1a59-83a1-4fd3-bc8a-f1bda7bd9d48 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:00:08.371122 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f1a59-83a1-4fd3-bc8a-f1bda7bd9d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:00:08.388677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-5d8f1a59-83a1-4fd3-bc8a-f1bda7bd9d48 None None] MFA Rules not processed for user `cca858d4c5454a5ea7577b6f78b19d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:00:08.389903 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-5d8f1a59-83a1-4fd3-bc8a-f1bda7bd9d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:00:08.443043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1384/2729] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:00:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:00:51.373288 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3e0e5-aed6-4e91-8888-aaecb4f3f497 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:00:51.373885 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3e0e5-aed6-4e91-8888-aaecb4f3f497 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:00:51.373885 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3e0e5-aed6-4e91-8888-aaecb4f3f497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:00:51.390874 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-14d3e0e5-aed6-4e91-8888-aaecb4f3f497 None None] MFA Rules not processed for user `64d4eadc9e7446a5b4a95bfed38bf787`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:00:51.392053 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-14d3e0e5-aed6-4e91-8888-aaecb4f3f497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:00:51.398771 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1346/2730] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:00:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:00:51.433268 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f1a59-83a1-4fd3-bc8a-f1bda7bd9d48 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:00:51.434766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-5d8f1a59-83a1-4fd3-bc8a-f1bda7bd9d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:00:51.488230 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f1a59-83a1-4fd3-bc8a-f1bda7bd9d48 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:00:51.491747 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bf4b7-4194-4438-adfc-d8b092175307 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92dc1464c4b24c6c8ea5dfcc796f0279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:00:51.492425 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bf4b7-4194-4438-adfc-d8b092175307 service glance] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:00:51.492661 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bf4b7-4194-4438-adfc-d8b092175307 service glance] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:00:51.492936 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bf4b7-4194-4438-adfc-d8b092175307 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:00:51.495271 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-009bf4b7-4194-4438-adfc-d8b092175307 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:00:51.563779 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009bf4b7-4194-4438-adfc-d8b092175307 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:00:51.565210 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009bf4b7-4194-4438-adfc-d8b092175307 service glance] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:00:51.576263 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1385/2731] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:00:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:00:52.082143 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3e0e5-aed6-4e91-8888-aaecb4f3f497 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:00:52.083564 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-14d3e0e5-aed6-4e91-8888-aaecb4f3f497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:00:52.096090 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3e0e5-aed6-4e91-8888-aaecb4f3f497 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:00:52.099930 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c256e2-18a2-4607-91e0-f9bb76e36b76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:00:52.100681 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c256e2-18a2-4607-91e0-f9bb76e36b76 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:00:52.100966 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c256e2-18a2-4607-91e0-f9bb76e36b76 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:00:52.101244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c256e2-18a2-4607-91e0-f9bb76e36b76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:00:52.103096 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-b8c256e2-18a2-4607-91e0-f9bb76e36b76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:00:52.116873 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c256e2-18a2-4607-91e0-f9bb76e36b76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:00:52.118306 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c256e2-18a2-4607-91e0-f9bb76e36b76 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:00:52.129947 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1347/2732] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:00:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:01:25.508839 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bf4b7-4194-4438-adfc-d8b092175307 service glance] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:25.510471 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-009bf4b7-4194-4438-adfc-d8b092175307 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:25.544157 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bf4b7-4194-4438-adfc-d8b092175307 service glance] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:25.552901 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bce750-a71f-42bf-be8d-c12ffec2f222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:25.553736 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bce750-a71f-42bf-be8d-c12ffec2f222 service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:25.554118 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bce750-a71f-42bf-be8d-c12ffec2f222 service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:25.554686 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bce750-a71f-42bf-be8d-c12ffec2f222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:25.556649 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d4bce750-a71f-42bf-be8d-c12ffec2f222 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:25.596113 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bce750-a71f-42bf-be8d-c12ffec2f222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:25.597804 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bce750-a71f-42bf-be8d-c12ffec2f222 service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:25.624493 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1386/2733] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:01:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:01:26.827873 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c256e2-18a2-4607-91e0-f9bb76e36b76 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:26.838772 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c256e2-18a2-4607-91e0-f9bb76e36b76 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:26.844239 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb62e65-3cb0-46a2-981d-032bbef02260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:26.844867 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb62e65-3cb0-46a2-981d-032bbef02260 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:26.845149 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb62e65-3cb0-46a2-981d-032bbef02260 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:26.845425 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb62e65-3cb0-46a2-981d-032bbef02260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:26.847187 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ecb62e65-3cb0-46a2-981d-032bbef02260 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:26.857496 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb62e65-3cb0-46a2-981d-032bbef02260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:26.859087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb62e65-3cb0-46a2-981d-032bbef02260 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:26.867695 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1348/2734] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:01:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:01:34.452622 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bce750-a71f-42bf-be8d-c12ffec2f222 service nova] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:34.461594 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bce750-a71f-42bf-be8d-c12ffec2f222 service nova] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:34.465129 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7d560-1fc5-4b8f-ae10-cb93aed4abea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:34.466421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7d560-1fc5-4b8f-ae10-cb93aed4abea service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:34.466738 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7d560-1fc5-4b8f-ae10-cb93aed4abea service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:34.467013 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee7d560-1fc5-4b8f-ae10-cb93aed4abea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:34.468741 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-bee7d560-1fc5-4b8f-ae10-cb93aed4abea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:34.479916 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7d560-1fc5-4b8f-ae10-cb93aed4abea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:34.481940 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee7d560-1fc5-4b8f-ae10-cb93aed4abea service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:34.491168 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1387/2735] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:01:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:01:37.715775 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb62e65-3cb0-46a2-981d-032bbef02260 service nova] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:37.717739 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ecb62e65-3cb0-46a2-981d-032bbef02260 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:37.746314 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb62e65-3cb0-46a2-981d-032bbef02260 service nova] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:37.758237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125419a-6f01-4b6a-afea-35473775ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:37.758237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125419a-6f01-4b6a-afea-35473775ec6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:37.758237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125419a-6f01-4b6a-afea-35473775ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:37.758237 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125419a-6f01-4b6a-afea-35473775ec6e admin admin] PATH_INFO: `/v3/users/cca858d4c5454a5ea7577b6f78b19d6c` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:37.759553 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125419a-6f01-4b6a-afea-35473775ec6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca858d4c5454a5ea7577b6f78b19d6c)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:37.763837 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125419a-6f01-4b6a-afea-35473775ec6e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:37.820488 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3125419a-6f01-4b6a-afea-35473775ec6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca858d4c5454a5ea7577b6f78b19d6c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:37.826671 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3125419a-6f01-4b6a-afea-35473775ec6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca858d4c5454a5ea7577b6f78b19d6c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:37.827282 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3125419a-6f01-4b6a-afea-35473775ec6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca858d4c5454a5ea7577b6f78b19d6c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:37.834096 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3125419a-6f01-4b6a-afea-35473775ec6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca858d4c5454a5ea7577b6f78b19d6c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:37.845658 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-3125419a-6f01-4b6a-afea-35473775ec6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca858d4c5454a5ea7577b6f78b19d6c'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:37.851455 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1349/2736] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 17:01:37 2022] DELETE /identity/v3/users/cca858d4c5454a5ea7577b6f78b19d6c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 17:01:38.016651 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7d560-1fc5-4b8f-ae10-cb93aed4abea service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:38.028378 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee7d560-1fc5-4b8f-ae10-cb93aed4abea service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:38.086311 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c06c58-894d-455a-92f8-edda81a6f85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:38.087195 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c06c58-894d-455a-92f8-edda81a6f85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:38.087483 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c06c58-894d-455a-92f8-edda81a6f85d admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:38.087758 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c06c58-894d-455a-92f8-edda81a6f85d admin admin] PATH_INFO: `/v3/projects/560e37bd1eae45cea00a7d544ad73cf0` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:38.088933 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c06c58-894d-455a-92f8-edda81a6f85d admin admin] RBAC: Authorizing `identity:delete_project(project_id=560e37bd1eae45cea00a7d544ad73cf0)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:38.090873 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c06c58-894d-455a-92f8-edda81a6f85d admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:38.135280 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c0c06c58-894d-455a-92f8-edda81a6f85d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560e37bd1eae45cea00a7d544ad73cf0', 'request_id': 'req-c0c06c58-894d-455a-92f8-edda81a6f85d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:38.141218 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c0c06c58-894d-455a-92f8-edda81a6f85d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560e37bd1eae45cea00a7d544ad73cf0', 'request_id': 'req-c0c06c58-894d-455a-92f8-edda81a6f85d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:38.148529 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c0c06c58-894d-455a-92f8-edda81a6f85d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560e37bd1eae45cea00a7d544ad73cf0', 'request_id': 'req-c0c06c58-894d-455a-92f8-edda81a6f85d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:38.160327 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c0c06c58-894d-455a-92f8-edda81a6f85d admin admin] The token cache is being invalidate because project 560e37bd1eae45cea00a7d544ad73cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:01:38.160580 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c0c06c58-894d-455a-92f8-edda81a6f85d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:38.161204 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c0c06c58-894d-455a-92f8-edda81a6f85d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:38.162810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1388/2737] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 17:01:38 2022] DELETE /identity/v3/projects/560e37bd1eae45cea00a7d544ad73cf0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:01:38.167812 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b103c83-775d-4f84-94ec-a998d4813695 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:38.168292 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b103c83-775d-4f84-94ec-a998d4813695 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:38.168579 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b103c83-775d-4f84-94ec-a998d4813695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:38.186916 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-5b103c83-775d-4f84-94ec-a998d4813695 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:01:38.188298 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5b103c83-775d-4f84-94ec-a998d4813695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:38.245960 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1350/2738] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:01:38.254416 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10b09e-3acf-4fd6-87ef-d28b92f294d2 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:38.254731 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10b09e-3acf-4fd6-87ef-d28b92f294d2 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:38.255009 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10b09e-3acf-4fd6-87ef-d28b92f294d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:38.272965 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-1a10b09e-3acf-4fd6-87ef-d28b92f294d2 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:01:38.274062 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-1a10b09e-3acf-4fd6-87ef-d28b92f294d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:38.282101 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1389/2739] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:01:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:01:38.286166 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b103c83-775d-4f84-94ec-a998d4813695 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:38.296143 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b103c83-775d-4f84-94ec-a998d4813695 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:38.300796 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe2c68-626b-42e1-853b-56393a14c0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:38.301444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe2c68-626b-42e1-853b-56393a14c0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:38.301732 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe2c68-626b-42e1-853b-56393a14c0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:38.302015 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe2c68-626b-42e1-853b-56393a14c0a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:38.302775 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe2c68-626b-42e1-853b-56393a14c0a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 17:01:38.303088 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe2c68-626b-42e1-853b-56393a14c0a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:38.304682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe2c68-626b-42e1-853b-56393a14c0a5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:38.315979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1351/2740] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 17:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 17:01:38.320130 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10b09e-3acf-4fd6-87ef-d28b92f294d2 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:38.328910 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10b09e-3acf-4fd6-87ef-d28b92f294d2 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:38.333489 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c6095-2cc1-495f-b5c7-26ac9b937701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:38.334118 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c6095-2cc1-495f-b5c7-26ac9b937701 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:38.334393 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c6095-2cc1-495f-b5c7-26ac9b937701 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:38.334694 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c6095-2cc1-495f-b5c7-26ac9b937701 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:38.335359 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c6095-2cc1-495f-b5c7-26ac9b937701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:38.337234 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c6095-2cc1-495f-b5c7-26ac9b937701 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:38.363243 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1390/2741] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 17:01:38 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:01:38.367414 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe2c68-626b-42e1-853b-56393a14c0a5 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:38.377420 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe2c68-626b-42e1-853b-56393a14c0a5 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:38.430315 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2a3df-75e5-46ed-9f69-15c92eec29f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:38.430996 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2a3df-75e5-46ed-9f69-15c92eec29f7 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:38.431290 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2a3df-75e5-46ed-9f69-15c92eec29f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:38.431595 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2a3df-75e5-46ed-9f69-15c92eec29f7 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:38.432300 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2a3df-75e5-46ed-9f69-15c92eec29f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:38.434226 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2a3df-75e5-46ed-9f69-15c92eec29f7 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:38.454330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1352/2742] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 17:01:38 2022] POST /identity/v3/users => generated 284 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:01:38.458233 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c6095-2cc1-495f-b5c7-26ac9b937701 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:38.468161 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c6095-2cc1-495f-b5c7-26ac9b937701 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:38.472672 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2ad88-574a-459e-97a9-3499d712c799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:38.473297 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2ad88-574a-459e-97a9-3499d712c799 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:38.473578 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2ad88-574a-459e-97a9-3499d712c799 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:38.473852 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf2ad88-574a-459e-97a9-3499d712c799 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:38.474564 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2ad88-574a-459e-97a9-3499d712c799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:38.476178 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf2ad88-574a-459e-97a9-3499d712c799 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:38.486179 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1391/2743] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:01:38.489909 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2a3df-75e5-46ed-9f69-15c92eec29f7 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:38.499984 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2a3df-75e5-46ed-9f69-15c92eec29f7 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:38.504495 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a794f49-6bb8-4244-980c-c332cd07e57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:38.505128 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a794f49-6bb8-4244-980c-c332cd07e57d admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:38.505405 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a794f49-6bb8-4244-980c-c332cd07e57d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:38.505678 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a794f49-6bb8-4244-980c-c332cd07e57d admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:38.506385 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a794f49-6bb8-4244-980c-c332cd07e57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:38.507983 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a794f49-6bb8-4244-980c-c332cd07e57d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:38.518606 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1353/2744] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:01:38.522288 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2ad88-574a-459e-97a9-3499d712c799 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:38.531795 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf2ad88-574a-459e-97a9-3499d712c799 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:38.537607 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62f0e8-4f48-45ef-8ee4-e32b08f713b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:38.538517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62f0e8-4f48-45ef-8ee4-e32b08f713b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:38.538832 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62f0e8-4f48-45ef-8ee4-e32b08f713b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:38.539110 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62f0e8-4f48-45ef-8ee4-e32b08f713b8 admin admin] PATH_INFO: `/v3/projects/3273aabe59cf4fa49cfc2b23875e4750/users/7c984b9fae95454298d969247ddda4fe/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:38.554686 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62f0e8-4f48-45ef-8ee4-e32b08f713b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3273aabe59cf4fa49cfc2b23875e4750, user_id=7c984b9fae95454298d969247ddda4fe, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:38.557621 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62f0e8-4f48-45ef-8ee4-e32b08f713b8 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:38.571547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1392/2745] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 17:01:38 2022] PUT /identity/v3/projects/3273aabe59cf4fa49cfc2b23875e4750/users/7c984b9fae95454298d969247ddda4fe/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 17:01:38.581552 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca72af-4583-4d3f-ae7c-f25d34ec9ac8 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:38.581837 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca72af-4583-4d3f-ae7c-f25d34ec9ac8 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:38.582112 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca72af-4583-4d3f-ae7c-f25d34ec9ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:38.607953 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-8cca72af-4583-4d3f-ae7c-f25d34ec9ac8 None None] MFA Rules not processed for user `7c984b9fae95454298d969247ddda4fe`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:01:38.609158 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-8cca72af-4583-4d3f-ae7c-f25d34ec9ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:38.672308 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1354/2746] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:01:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 17:01:38.683403 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62f0e8-4f48-45ef-8ee4-e32b08f713b8 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:38.685661 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-dd62f0e8-4f48-45ef-8ee4-e32b08f713b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:38.740028 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62f0e8-4f48-45ef-8ee4-e32b08f713b8 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:38.743662 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0905e9e-5c9c-41d6-95ba-19d47ddffc4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:38.744297 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0905e9e-5c9c-41d6-95ba-19d47ddffc4b service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:38.744580 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0905e9e-5c9c-41d6-95ba-19d47ddffc4b service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:38.744858 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0905e9e-5c9c-41d6-95ba-19d47ddffc4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:38.753575 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0905e9e-5c9c-41d6-95ba-19d47ddffc4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:38.755052 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0905e9e-5c9c-41d6-95ba-19d47ddffc4b service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:38.763983 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1393/2747] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:01:38 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:01:50.324334 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca72af-4583-4d3f-ae7c-f25d34ec9ac8 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:50.387269 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca72af-4583-4d3f-ae7c-f25d34ec9ac8 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:50.391982 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb24af2-b384-4d3d-89a2-16b39b70aa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:50.392928 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb24af2-b384-4d3d-89a2-16b39b70aa9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:50.393142 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb24af2-b384-4d3d-89a2-16b39b70aa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:50.393411 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb24af2-b384-4d3d-89a2-16b39b70aa9e admin admin] PATH_INFO: `/v3/users/7c984b9fae95454298d969247ddda4fe` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:50.394615 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb24af2-b384-4d3d-89a2-16b39b70aa9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c984b9fae95454298d969247ddda4fe)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:50.396616 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb24af2-b384-4d3d-89a2-16b39b70aa9e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:50.447055 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6cb24af2-b384-4d3d-89a2-16b39b70aa9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c984b9fae95454298d969247ddda4fe'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:50.454248 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6cb24af2-b384-4d3d-89a2-16b39b70aa9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c984b9fae95454298d969247ddda4fe'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:50.454914 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6cb24af2-b384-4d3d-89a2-16b39b70aa9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c984b9fae95454298d969247ddda4fe'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:50.461726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6cb24af2-b384-4d3d-89a2-16b39b70aa9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c984b9fae95454298d969247ddda4fe'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:50.475365 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-6cb24af2-b384-4d3d-89a2-16b39b70aa9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c984b9fae95454298d969247ddda4fe'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:50.482983 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1355/2748] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 17:01:50 2022] DELETE /identity/v3/users/7c984b9fae95454298d969247ddda4fe => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:01:50.487536 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918f0d5-5f57-43c8-8d48-27c1e787c6bf None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:50.487988 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918f0d5-5f57-43c8-8d48-27c1e787c6bf None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:50.488161 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918f0d5-5f57-43c8-8d48-27c1e787c6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:50.505420 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-b918f0d5-5f57-43c8-8d48-27c1e787c6bf None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:01:50.506530 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b918f0d5-5f57-43c8-8d48-27c1e787c6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:50.521708 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb24af2-b384-4d3d-89a2-16b39b70aa9e admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:50.523171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6cb24af2-b384-4d3d-89a2-16b39b70aa9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:50.564914 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1394/2749] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:01:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:01:50.574464 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918f0d5-5f57-43c8-8d48-27c1e787c6bf None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:50.576350 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b918f0d5-5f57-43c8-8d48-27c1e787c6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:50.581719 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb24af2-b384-4d3d-89a2-16b39b70aa9e admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:50.586136 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b09583-cd34-4161-89f5-1d7ac2dfdc6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:50.586992 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b09583-cd34-4161-89f5-1d7ac2dfdc6a service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:50.587292 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b09583-cd34-4161-89f5-1d7ac2dfdc6a service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:50.587574 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b09583-cd34-4161-89f5-1d7ac2dfdc6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:50.587750 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918f0d5-5f57-43c8-8d48-27c1e787c6bf None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:50.589542 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d5b09583-cd34-4161-89f5-1d7ac2dfdc6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:50.591946 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c166fff-73b0-4724-9ce9-a96b60ac0f8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:50.592580 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c166fff-73b0-4724-9ce9-a96b60ac0f8c service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:50.592860 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c166fff-73b0-4724-9ce9-a96b60ac0f8c service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:50.593135 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c166fff-73b0-4724-9ce9-a96b60ac0f8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:50.600768 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b09583-cd34-4161-89f5-1d7ac2dfdc6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:50.602376 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b09583-cd34-4161-89f5-1d7ac2dfdc6a service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:50.604166 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c166fff-73b0-4724-9ce9-a96b60ac0f8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:50.605557 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c166fff-73b0-4724-9ce9-a96b60ac0f8c service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:50.610669 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1356/2750] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:01:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 17:01:50.615248 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1395/2751] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:01:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 17:01:51.037144 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b09583-cd34-4161-89f5-1d7ac2dfdc6a service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:51.038683 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d5b09583-cd34-4161-89f5-1d7ac2dfdc6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:51.054293 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b09583-cd34-4161-89f5-1d7ac2dfdc6a service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:51.059518 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbf547-9919-4802-b4ef-1eb31e86d8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:51.060544 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbf547-9919-4802-b4ef-1eb31e86d8c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:51.060829 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbf547-9919-4802-b4ef-1eb31e86d8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:51.061100 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbf547-9919-4802-b4ef-1eb31e86d8c1 admin admin] PATH_INFO: `/v3/projects/3273aabe59cf4fa49cfc2b23875e4750` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:51.062283 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbf547-9919-4802-b4ef-1eb31e86d8c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3273aabe59cf4fa49cfc2b23875e4750)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:51.064254 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbf547-9919-4802-b4ef-1eb31e86d8c1 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:51.112273 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-11cbf547-9919-4802-b4ef-1eb31e86d8c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3273aabe59cf4fa49cfc2b23875e4750', 'request_id': 'req-11cbf547-9919-4802-b4ef-1eb31e86d8c1'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:51.117728 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-11cbf547-9919-4802-b4ef-1eb31e86d8c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3273aabe59cf4fa49cfc2b23875e4750', 'request_id': 'req-11cbf547-9919-4802-b4ef-1eb31e86d8c1'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:51.124034 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-11cbf547-9919-4802-b4ef-1eb31e86d8c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3273aabe59cf4fa49cfc2b23875e4750', 'request_id': 'req-11cbf547-9919-4802-b4ef-1eb31e86d8c1'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:51.136835 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-11cbf547-9919-4802-b4ef-1eb31e86d8c1 admin admin] The token cache is being invalidate because project 3273aabe59cf4fa49cfc2b23875e4750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:01:51.137245 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-11cbf547-9919-4802-b4ef-1eb31e86d8c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:51.137918 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-11cbf547-9919-4802-b4ef-1eb31e86d8c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:51.139729 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1357/2752] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 17:01:51 2022] DELETE /identity/v3/projects/3273aabe59cf4fa49cfc2b23875e4750 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:01:51.144595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca854df2-060b-40c1-9523-a99a7ea35bc0 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:51.144886 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca854df2-060b-40c1-9523-a99a7ea35bc0 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:51.145167 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca854df2-060b-40c1-9523-a99a7ea35bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:51.163928 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-ca854df2-060b-40c1-9523-a99a7ea35bc0 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:01:51.165139 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-ca854df2-060b-40c1-9523-a99a7ea35bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:51.223901 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1396/2753] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 17:01:51.233302 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe98cc1-eed9-4c85-9623-03c75526dc1e None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:51.233589 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe98cc1-eed9-4c85-9623-03c75526dc1e None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:51.233866 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe98cc1-eed9-4c85-9623-03c75526dc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:51.252926 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-5fe98cc1-eed9-4c85-9623-03c75526dc1e None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:01:51.254115 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-5fe98cc1-eed9-4c85-9623-03c75526dc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:51.263027 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1358/2754] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:01:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:01:51.267163 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca854df2-060b-40c1-9523-a99a7ea35bc0 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:51.280254 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca854df2-060b-40c1-9523-a99a7ea35bc0 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:51.285011 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c93ebc-64de-4050-aa77-c46f407bee46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:51.285678 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c93ebc-64de-4050-aa77-c46f407bee46 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:51.285951 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c93ebc-64de-4050-aa77-c46f407bee46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:51.286225 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c93ebc-64de-4050-aa77-c46f407bee46 admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:51.286980 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c93ebc-64de-4050-aa77-c46f407bee46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 17:01:51.287287 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c93ebc-64de-4050-aa77-c46f407bee46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:51.288888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c93ebc-64de-4050-aa77-c46f407bee46 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:51.300932 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1397/2755] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 17:01:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 17:01:51.309704 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe98cc1-eed9-4c85-9623-03c75526dc1e None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:51.319531 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe98cc1-eed9-4c85-9623-03c75526dc1e None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:51.324219 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8777cb-1f68-4194-804d-c273063f9326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:51.325361 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8777cb-1f68-4194-804d-c273063f9326 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:51.325924 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8777cb-1f68-4194-804d-c273063f9326 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:51.325924 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8777cb-1f68-4194-804d-c273063f9326 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:51.326710 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8777cb-1f68-4194-804d-c273063f9326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:51.328630 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8777cb-1f68-4194-804d-c273063f9326 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:51.353231 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1359/2756] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 17:01:51 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:01:51.357364 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c93ebc-64de-4050-aa77-c46f407bee46 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:51.367293 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c93ebc-64de-4050-aa77-c46f407bee46 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:51.422002 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ac5b-405f-408b-9274-5c94cba1b76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:51.422716 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ac5b-405f-408b-9274-5c94cba1b76c admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:51.422993 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ac5b-405f-408b-9274-5c94cba1b76c admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:51.423265 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2691ac5b-405f-408b-9274-5c94cba1b76c admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:51.423933 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691ac5b-405f-408b-9274-5c94cba1b76c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:51.425910 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2691ac5b-405f-408b-9274-5c94cba1b76c admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:51.444786 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1398/2757] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 17:01:51 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 17:01:51.449085 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8777cb-1f68-4194-804d-c273063f9326 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:51.459630 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8777cb-1f68-4194-804d-c273063f9326 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:51.464232 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2709fb9-f418-4d61-80c5-2c9e939868d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:51.464871 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2709fb9-f418-4d61-80c5-2c9e939868d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:51.465148 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2709fb9-f418-4d61-80c5-2c9e939868d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:51.465419 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2709fb9-f418-4d61-80c5-2c9e939868d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:51.466732 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2709fb9-f418-4d61-80c5-2c9e939868d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:51.468310 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2709fb9-f418-4d61-80c5-2c9e939868d2 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:51.478216 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1360/2758] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:01:51.482004 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ac5b-405f-408b-9274-5c94cba1b76c admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:51.491862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2691ac5b-405f-408b-9274-5c94cba1b76c admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:51.496520 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23ab55-4a20-4ac7-8ab7-d65aaa70d506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:51.497178 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23ab55-4a20-4ac7-8ab7-d65aaa70d506 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:51.497443 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23ab55-4a20-4ac7-8ab7-d65aaa70d506 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:51.497718 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23ab55-4a20-4ac7-8ab7-d65aaa70d506 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:51.498513 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23ab55-4a20-4ac7-8ab7-d65aaa70d506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:51.500061 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23ab55-4a20-4ac7-8ab7-d65aaa70d506 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:51.513719 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1399/2759] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:01:51.514833 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2709fb9-f418-4d61-80c5-2c9e939868d2 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:51.524514 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2709fb9-f418-4d61-80c5-2c9e939868d2 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:51.529670 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dcb7a-94d8-48cc-bf09-55108e831471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:51.530616 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dcb7a-94d8-48cc-bf09-55108e831471 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:51.530845 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dcb7a-94d8-48cc-bf09-55108e831471 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:51.531117 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988dcb7a-94d8-48cc-bf09-55108e831471 admin admin] PATH_INFO: `/v3/projects/fc9b54a51f734b6ab9176bf4f8dc6c9e/users/8524207b2fa84eb3858a4017486faa77/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:51.545619 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dcb7a-94d8-48cc-bf09-55108e831471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc9b54a51f734b6ab9176bf4f8dc6c9e, user_id=8524207b2fa84eb3858a4017486faa77, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:51.548259 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988dcb7a-94d8-48cc-bf09-55108e831471 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:51.562475 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1361/2760] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 17:01:51 2022] PUT /identity/v3/projects/fc9b54a51f734b6ab9176bf4f8dc6c9e/users/8524207b2fa84eb3858a4017486faa77/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:01:51.573364 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53b7e8-8a5c-49ea-abf4-3c1aa034d915 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:51.573676 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53b7e8-8a5c-49ea-abf4-3c1aa034d915 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:51.574107 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53b7e8-8a5c-49ea-abf4-3c1aa034d915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:51.606876 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-bf53b7e8-8a5c-49ea-abf4-3c1aa034d915 None None] MFA Rules not processed for user `8524207b2fa84eb3858a4017486faa77`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:01:51.608218 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-bf53b7e8-8a5c-49ea-abf4-3c1aa034d915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:51.674405 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1400/2761] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:01:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:01:51.678943 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dcb7a-94d8-48cc-bf09-55108e831471 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:51.739992 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988dcb7a-94d8-48cc-bf09-55108e831471 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:51.744725 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98889c-1e81-48be-a62d-faeba7dd1bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:51.745374 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98889c-1e81-48be-a62d-faeba7dd1bcd admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:51.745677 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98889c-1e81-48be-a62d-faeba7dd1bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:51.745947 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98889c-1e81-48be-a62d-faeba7dd1bcd admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:51.747194 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98889c-1e81-48be-a62d-faeba7dd1bcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:51.749147 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98889c-1e81-48be-a62d-faeba7dd1bcd admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:51.774532 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1362/2762] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 17:01:51 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:01:51.778813 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53b7e8-8a5c-49ea-abf4-3c1aa034d915 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:51.789763 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53b7e8-8a5c-49ea-abf4-3c1aa034d915 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:51.845224 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d0e4e-c209-4368-9c5d-7fceac6b7a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:51.845945 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d0e4e-c209-4368-9c5d-7fceac6b7a7f admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:51.846221 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d0e4e-c209-4368-9c5d-7fceac6b7a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:51.846502 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d0e4e-c209-4368-9c5d-7fceac6b7a7f admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:51.847226 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d0e4e-c209-4368-9c5d-7fceac6b7a7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:51.849200 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d0e4e-c209-4368-9c5d-7fceac6b7a7f admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:51.868805 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1401/2763] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 17:01:51 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:01:51.873246 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98889c-1e81-48be-a62d-faeba7dd1bcd admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:51.883485 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98889c-1e81-48be-a62d-faeba7dd1bcd admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:51.888962 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3d3b9-0cb6-4988-83bf-49d3117d1369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:51.889610 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3d3b9-0cb6-4988-83bf-49d3117d1369 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:51.889894 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3d3b9-0cb6-4988-83bf-49d3117d1369 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:51.890247 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3d3b9-0cb6-4988-83bf-49d3117d1369 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:51.891031 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3d3b9-0cb6-4988-83bf-49d3117d1369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:51.892683 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3d3b9-0cb6-4988-83bf-49d3117d1369 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:51.903111 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1363/2764] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 17:01:51.907302 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d0e4e-c209-4368-9c5d-7fceac6b7a7f admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:51.917326 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d0e4e-c209-4368-9c5d-7fceac6b7a7f admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:51.921904 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7176e-422d-4157-a09b-813c5961c8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:51.922802 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7176e-422d-4157-a09b-813c5961c8ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:51.923083 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7176e-422d-4157-a09b-813c5961c8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:51.923355 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7176e-422d-4157-a09b-813c5961c8ab admin admin] PATH_INFO: `/v3/projects/aff6e964c6584b238b397c1a1fdf3d21/users/3f31095751b7497da99f2227ef313ef9/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:51.937972 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7176e-422d-4157-a09b-813c5961c8ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff6e964c6584b238b397c1a1fdf3d21, user_id=3f31095751b7497da99f2227ef313ef9, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:51.940713 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7176e-422d-4157-a09b-813c5961c8ab admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:51.953861 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1402/2765] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 17:01:51 2022] PUT /identity/v3/projects/aff6e964c6584b238b397c1a1fdf3d21/users/3f31095751b7497da99f2227ef313ef9/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:01:51.957798 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3d3b9-0cb6-4988-83bf-49d3117d1369 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:51.967852 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3d3b9-0cb6-4988-83bf-49d3117d1369 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:52.024568 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482caca2-b353-41eb-b777-e73e26bc0a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:52.025232 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482caca2-b353-41eb-b777-e73e26bc0a6f admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:52.025516 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482caca2-b353-41eb-b777-e73e26bc0a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:52.025798 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482caca2-b353-41eb-b777-e73e26bc0a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:52.026548 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482caca2-b353-41eb-b777-e73e26bc0a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:52.028168 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482caca2-b353-41eb-b777-e73e26bc0a6f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:52.037873 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1364/2766] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:01:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:01:52.042068 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7176e-422d-4157-a09b-813c5961c8ab admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:52.052745 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7176e-422d-4157-a09b-813c5961c8ab admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:52.057372 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6c81e-129f-40c8-830e-d8c23a94b8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:52.058240 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6c81e-129f-40c8-830e-d8c23a94b8da admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:52.058521 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6c81e-129f-40c8-830e-d8c23a94b8da admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:52.058824 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6c81e-129f-40c8-830e-d8c23a94b8da admin admin] PATH_INFO: `/v3/projects/aff6e964c6584b238b397c1a1fdf3d21/users/3f31095751b7497da99f2227ef313ef9/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:52.061542 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6c81e-129f-40c8-830e-d8c23a94b8da admin admin] RBAC: Authorizing `identity:create_grant(project_id=aff6e964c6584b238b397c1a1fdf3d21, user_id=3f31095751b7497da99f2227ef313ef9, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:52.064204 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6c81e-129f-40c8-830e-d8c23a94b8da admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:52.074128 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1403/2767] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 17:01:52 2022] PUT /identity/v3/projects/aff6e964c6584b238b397c1a1fdf3d21/users/3f31095751b7497da99f2227ef313ef9/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:01:52.084075 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bc0fd-7481-4477-9d9a-43b4c112a55c None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:52.084379 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bc0fd-7481-4477-9d9a-43b4c112a55c None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:52.084680 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7bc0fd-7481-4477-9d9a-43b4c112a55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:52.110741 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-aa7bc0fd-7481-4477-9d9a-43b4c112a55c None None] MFA Rules not processed for user `3f31095751b7497da99f2227ef313ef9`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:01:52.111948 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-aa7bc0fd-7481-4477-9d9a-43b4c112a55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:52.176908 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1365/2768] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:01:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:01:52.188350 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6c81e-129f-40c8-830e-d8c23a94b8da admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:52.190015 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-37d6c81e-129f-40c8-830e-d8c23a94b8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:52.244563 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6c81e-129f-40c8-830e-d8c23a94b8da admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:52.248760 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb5627-378b-46ff-8b11-402fa1879236 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:52.249412 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb5627-378b-46ff-8b11-402fa1879236 service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:52.249691 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb5627-378b-46ff-8b11-402fa1879236 service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:52.249963 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb5627-378b-46ff-8b11-402fa1879236 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:52.303023 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb5627-378b-46ff-8b11-402fa1879236 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:52.304384 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb5627-378b-46ff-8b11-402fa1879236 service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:52.314091 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1404/2769] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:01:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:01:53.125247 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bc0fd-7481-4477-9d9a-43b4c112a55c None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:53.126721 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-aa7bc0fd-7481-4477-9d9a-43b4c112a55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:53.191795 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7bc0fd-7481-4477-9d9a-43b4c112a55c None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:53.196274 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161db7f-a09d-4124-b737-03508d4b56e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:53.197131 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161db7f-a09d-4124-b737-03508d4b56e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:53.197412 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161db7f-a09d-4124-b737-03508d4b56e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:53.197685 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161db7f-a09d-4124-b737-03508d4b56e1 admin admin] PATH_INFO: `/v3/users/64d4eadc9e7446a5b4a95bfed38bf787` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:53.198950 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161db7f-a09d-4124-b737-03508d4b56e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64d4eadc9e7446a5b4a95bfed38bf787)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:53.201488 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161db7f-a09d-4124-b737-03508d4b56e1 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:53.244026 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a161db7f-a09d-4124-b737-03508d4b56e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64d4eadc9e7446a5b4a95bfed38bf787'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:53.251187 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a161db7f-a09d-4124-b737-03508d4b56e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64d4eadc9e7446a5b4a95bfed38bf787'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:53.251817 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a161db7f-a09d-4124-b737-03508d4b56e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64d4eadc9e7446a5b4a95bfed38bf787'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:53.258373 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a161db7f-a09d-4124-b737-03508d4b56e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64d4eadc9e7446a5b4a95bfed38bf787'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:53.270199 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-a161db7f-a09d-4124-b737-03508d4b56e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64d4eadc9e7446a5b4a95bfed38bf787'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:53.276103 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1366/2770] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 17:01:53 2022] DELETE /identity/v3/users/64d4eadc9e7446a5b4a95bfed38bf787 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:01:53.442207 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb5627-378b-46ff-8b11-402fa1879236 service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:53.453614 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb5627-378b-46ff-8b11-402fa1879236 service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:53.507370 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd7c45-95dc-4f08-9601-0eca978730bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:53.508216 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd7c45-95dc-4f08-9601-0eca978730bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:53.508494 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd7c45-95dc-4f08-9601-0eca978730bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:53.508766 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd7c45-95dc-4f08-9601-0eca978730bb admin admin] PATH_INFO: `/v3/projects/376d25cef0b9485cac2e8520a9ecd259` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:53.510169 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd7c45-95dc-4f08-9601-0eca978730bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=376d25cef0b9485cac2e8520a9ecd259)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:53.512089 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd7c45-95dc-4f08-9601-0eca978730bb admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:53.555747 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-fbbd7c45-95dc-4f08-9601-0eca978730bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '376d25cef0b9485cac2e8520a9ecd259', 'request_id': 'req-fbbd7c45-95dc-4f08-9601-0eca978730bb'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:53.561536 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-fbbd7c45-95dc-4f08-9601-0eca978730bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '376d25cef0b9485cac2e8520a9ecd259', 'request_id': 'req-fbbd7c45-95dc-4f08-9601-0eca978730bb'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:53.567373 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-fbbd7c45-95dc-4f08-9601-0eca978730bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '376d25cef0b9485cac2e8520a9ecd259', 'request_id': 'req-fbbd7c45-95dc-4f08-9601-0eca978730bb'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:53.578810 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-fbbd7c45-95dc-4f08-9601-0eca978730bb admin admin] The token cache is being invalidate because project 376d25cef0b9485cac2e8520a9ecd259 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:01:53.579106 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-fbbd7c45-95dc-4f08-9601-0eca978730bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:53.580082 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-fbbd7c45-95dc-4f08-9601-0eca978730bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:01:53.581459 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1405/2771] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 17:01:53 2022] DELETE /identity/v3/projects/376d25cef0b9485cac2e8520a9ecd259 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:01:53.586286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776c6c9-ab3e-48ea-9903-64728c10096f None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:53.586580 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776c6c9-ab3e-48ea-9903-64728c10096f None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:53.586878 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776c6c9-ab3e-48ea-9903-64728c10096f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:53.604605 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6776c6c9-ab3e-48ea-9903-64728c10096f None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:01:53.605933 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6776c6c9-ab3e-48ea-9903-64728c10096f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:53.664780 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1367/2772] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:01:53.673284 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060dfd8-4b45-47df-adb0-6a5c08e891ca None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:53.673679 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060dfd8-4b45-47df-adb0-6a5c08e891ca None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:53.674025 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060dfd8-4b45-47df-adb0-6a5c08e891ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:53.692446 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-0060dfd8-4b45-47df-adb0-6a5c08e891ca None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:01:53.693732 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-0060dfd8-4b45-47df-adb0-6a5c08e891ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:53.703035 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1406/2773] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:01:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:01:53.707594 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776c6c9-ab3e-48ea-9903-64728c10096f None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:53.717826 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776c6c9-ab3e-48ea-9903-64728c10096f None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:53.722570 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc47ea7-fe8e-4a91-834d-dfa9b8f50812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:53.723247 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc47ea7-fe8e-4a91-834d-dfa9b8f50812 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:53.723554 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc47ea7-fe8e-4a91-834d-dfa9b8f50812 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:53.723823 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc47ea7-fe8e-4a91-834d-dfa9b8f50812 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:53.724535 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc47ea7-fe8e-4a91-834d-dfa9b8f50812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 17:01:53.724835 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc47ea7-fe8e-4a91-834d-dfa9b8f50812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:53.726412 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc47ea7-fe8e-4a91-834d-dfa9b8f50812 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:53.738334 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1368/2774] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 17:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 17:01:53.743457 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060dfd8-4b45-47df-adb0-6a5c08e891ca None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:53.754760 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060dfd8-4b45-47df-adb0-6a5c08e891ca None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:53.762815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a8da2-7f6b-4aef-b43f-85f887e02841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:53.763521 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a8da2-7f6b-4aef-b43f-85f887e02841 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:53.763802 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a8da2-7f6b-4aef-b43f-85f887e02841 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:53.764077 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a8da2-7f6b-4aef-b43f-85f887e02841 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:53.764771 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a8da2-7f6b-4aef-b43f-85f887e02841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:53.766779 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a8da2-7f6b-4aef-b43f-85f887e02841 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:53.794299 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1407/2775] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 17:01:53 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:01:53.799019 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc47ea7-fe8e-4a91-834d-dfa9b8f50812 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:53.810243 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc47ea7-fe8e-4a91-834d-dfa9b8f50812 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:53.863731 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a03c2-0da4-4a3d-8b48-3a8a7d6af8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:53.864386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a03c2-0da4-4a3d-8b48-3a8a7d6af8fd admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:53.864665 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a03c2-0da4-4a3d-8b48-3a8a7d6af8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:53.864937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a03c2-0da4-4a3d-8b48-3a8a7d6af8fd admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:53.865605 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a03c2-0da4-4a3d-8b48-3a8a7d6af8fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:53.867529 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a03c2-0da4-4a3d-8b48-3a8a7d6af8fd admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:53.886461 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1369/2776] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 17:01:53 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:01:53.890451 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a8da2-7f6b-4aef-b43f-85f887e02841 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:53.900358 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a8da2-7f6b-4aef-b43f-85f887e02841 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:53.905543 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10d29c-93cc-4f99-b977-5661d948832f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:53.906193 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10d29c-93cc-4f99-b977-5661d948832f admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:53.906468 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10d29c-93cc-4f99-b977-5661d948832f admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:53.906771 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10d29c-93cc-4f99-b977-5661d948832f admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:53.907520 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10d29c-93cc-4f99-b977-5661d948832f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:53.909099 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10d29c-93cc-4f99-b977-5661d948832f admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:53.919889 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1408/2777] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:01:53.923752 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a03c2-0da4-4a3d-8b48-3a8a7d6af8fd admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:53.933435 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a03c2-0da4-4a3d-8b48-3a8a7d6af8fd admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:53.938080 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e20f3-735d-4cbe-9d08-33a7dffa9515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:53.938765 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e20f3-735d-4cbe-9d08-33a7dffa9515 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:53.939049 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e20f3-735d-4cbe-9d08-33a7dffa9515 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:53.939322 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e20f3-735d-4cbe-9d08-33a7dffa9515 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:53.940038 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e20f3-735d-4cbe-9d08-33a7dffa9515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:53.941617 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e20f3-735d-4cbe-9d08-33a7dffa9515 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:53.951571 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1370/2778] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:01:53.955535 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10d29c-93cc-4f99-b977-5661d948832f admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:53.965267 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10d29c-93cc-4f99-b977-5661d948832f admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:53.970425 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58f6b8-8a14-48cd-8bab-81081000d0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:53.971315 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58f6b8-8a14-48cd-8bab-81081000d0a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:53.971593 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58f6b8-8a14-48cd-8bab-81081000d0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:53.971862 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58f6b8-8a14-48cd-8bab-81081000d0a3 admin admin] PATH_INFO: `/v3/projects/c7994d24146849ada7ff0333c09e7f82/users/fcc4ebdac7fb437da89a7fd19cbe6ca8/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:53.986129 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58f6b8-8a14-48cd-8bab-81081000d0a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7994d24146849ada7ff0333c09e7f82, user_id=fcc4ebdac7fb437da89a7fd19cbe6ca8, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:53.988789 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58f6b8-8a14-48cd-8bab-81081000d0a3 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:54.000787 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1409/2779] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 17:01:53 2022] PUT /identity/v3/projects/c7994d24146849ada7ff0333c09e7f82/users/fcc4ebdac7fb437da89a7fd19cbe6ca8/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:01:54.007761 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21cb0b-cec8-498a-bdd4-2929f16e4986 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:54.008147 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21cb0b-cec8-498a-bdd4-2929f16e4986 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:54.008498 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21cb0b-cec8-498a-bdd4-2929f16e4986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:54.027108 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6d21cb0b-cec8-498a-bdd4-2929f16e4986 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:01:54.028787 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6d21cb0b-cec8-498a-bdd4-2929f16e4986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:54.084359 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1371/2780] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:01:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 17:01:54.094363 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58f6b8-8a14-48cd-8bab-81081000d0a3 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:54.096062 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-6e58f6b8-8a14-48cd-8bab-81081000d0a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:54.151555 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58f6b8-8a14-48cd-8bab-81081000d0a3 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:54.155054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196e0b01-2595-43d7-a258-6a4cc055b4a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:54.155683 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e0b01-2595-43d7-a258-6a4cc055b4a7 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:54.155961 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e0b01-2595-43d7-a258-6a4cc055b4a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:54.156236 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196e0b01-2595-43d7-a258-6a4cc055b4a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:54.164925 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e0b01-2595-43d7-a258-6a4cc055b4a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:54.166364 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196e0b01-2595-43d7-a258-6a4cc055b4a7 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:54.175682 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1410/2781] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:01:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:01:57.918464 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21cb0b-cec8-498a-bdd4-2929f16e4986 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:57.920686 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6d21cb0b-cec8-498a-bdd4-2929f16e4986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:57.994505 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21cb0b-cec8-498a-bdd4-2929f16e4986 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:57.998950 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9b546-260f-469a-a9bc-58fd8c130203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:57.999696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9b546-260f-469a-a9bc-58fd8c130203 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:58.000054 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9b546-260f-469a-a9bc-58fd8c130203 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:58.000398 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9b546-260f-469a-a9bc-58fd8c130203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:58.002324 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d1e9b546-260f-469a-a9bc-58fd8c130203 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:58.080604 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9b546-260f-469a-a9bc-58fd8c130203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:58.082128 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9b546-260f-469a-a9bc-58fd8c130203 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:58.092100 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1372/2782] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:01:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:01:58.267264 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c1b67-1d4b-4a1b-b5a1-c866a1ea91bb None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:58.267707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c1b67-1d4b-4a1b-b5a1-c866a1ea91bb None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:58.267822 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c1b67-1d4b-4a1b-b5a1-c866a1ea91bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:58.301577 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-6f4c1b67-1d4b-4a1b-b5a1-c866a1ea91bb None None] MFA Rules not processed for user `fcc4ebdac7fb437da89a7fd19cbe6ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:01:58.302885 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-6f4c1b67-1d4b-4a1b-b5a1-c866a1ea91bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:01:58.373043 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1411/2783] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:01:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:01:58.377657 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9b546-260f-469a-a9bc-58fd8c130203 service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:58.389868 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9b546-260f-469a-a9bc-58fd8c130203 service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:58.395565 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7ac52-e922-4352-bbbd-773508c34ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:58.396151 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7ac52-e922-4352-bbbd-773508c34ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:58.396437 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7ac52-e922-4352-bbbd-773508c34ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:58.396734 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced7ac52-e922-4352-bbbd-773508c34ae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:58.397590 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7ac52-e922-4352-bbbd-773508c34ae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:58.400571 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced7ac52-e922-4352-bbbd-773508c34ae5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:58.466696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1373/2784] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 17:01:58 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:01:58.468949 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c1b67-1d4b-4a1b-b5a1-c866a1ea91bb None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:58.480712 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c1b67-1d4b-4a1b-b5a1-c866a1ea91bb None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:58.545360 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703a234-aec5-4c72-a66b-623570cbbb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:58.546150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703a234-aec5-4c72-a66b-623570cbbb88 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:58.546501 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703a234-aec5-4c72-a66b-623570cbbb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:58.546941 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703a234-aec5-4c72-a66b-623570cbbb88 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:58.547736 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703a234-aec5-4c72-a66b-623570cbbb88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:58.549887 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703a234-aec5-4c72-a66b-623570cbbb88 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:58.575901 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1412/2785] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 17:01:58 2022] POST /identity/v3/users => generated 299 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 17:01:58.577412 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7ac52-e922-4352-bbbd-773508c34ae5 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:58.587981 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced7ac52-e922-4352-bbbd-773508c34ae5 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:58.593238 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323554e6-57ce-4ba6-bfe0-229a9a659b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:58.593912 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323554e6-57ce-4ba6-bfe0-229a9a659b4e admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:58.594197 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323554e6-57ce-4ba6-bfe0-229a9a659b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:58.594474 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323554e6-57ce-4ba6-bfe0-229a9a659b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:58.595248 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323554e6-57ce-4ba6-bfe0-229a9a659b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:58.596855 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323554e6-57ce-4ba6-bfe0-229a9a659b4e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:58.608675 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1374/2786] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:01:58.612931 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703a234-aec5-4c72-a66b-623570cbbb88 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:58.622955 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703a234-aec5-4c72-a66b-623570cbbb88 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:58.627761 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e939f5-436c-4489-9258-5f992c2ec4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:58.628754 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e939f5-436c-4489-9258-5f992c2ec4af admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:58.629114 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e939f5-436c-4489-9258-5f992c2ec4af admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:58.629449 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e939f5-436c-4489-9258-5f992c2ec4af admin admin] PATH_INFO: `/v3/projects/8e93d4be3f5e4f57ab92462022ff48dd/users/de152c199730454d9435353957088987/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:58.645382 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e939f5-436c-4489-9258-5f992c2ec4af admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e93d4be3f5e4f57ab92462022ff48dd, user_id=de152c199730454d9435353957088987, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:58.648137 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e939f5-436c-4489-9258-5f992c2ec4af admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:58.662422 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1413/2787] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 17:01:58 2022] PUT /identity/v3/projects/8e93d4be3f5e4f57ab92462022ff48dd/users/de152c199730454d9435353957088987/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:01:58.666455 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323554e6-57ce-4ba6-bfe0-229a9a659b4e admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:58.677718 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323554e6-57ce-4ba6-bfe0-229a9a659b4e admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:58.733830 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366f658-8ebb-4aeb-80d7-06055ffc4f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:58.734716 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366f658-8ebb-4aeb-80d7-06055ffc4f4a admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:58.735076 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366f658-8ebb-4aeb-80d7-06055ffc4f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:58.735348 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366f658-8ebb-4aeb-80d7-06055ffc4f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:58.736066 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366f658-8ebb-4aeb-80d7-06055ffc4f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:58.737669 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366f658-8ebb-4aeb-80d7-06055ffc4f4a admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:58.748387 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1375/2788] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:01:58.752316 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e939f5-436c-4489-9258-5f992c2ec4af admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:01:58.763278 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e939f5-436c-4489-9258-5f992c2ec4af admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:01:58.767894 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453570b-0821-4da9-a9a4-0f0357f40891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:01:58.768782 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453570b-0821-4da9-a9a4-0f0357f40891 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:01:58.769055 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453570b-0821-4da9-a9a4-0f0357f40891 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:01:58.769328 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453570b-0821-4da9-a9a4-0f0357f40891 admin admin] PATH_INFO: `/v3/projects/8e93d4be3f5e4f57ab92462022ff48dd/users/de152c199730454d9435353957088987/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:01:58.771309 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453570b-0821-4da9-a9a4-0f0357f40891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e93d4be3f5e4f57ab92462022ff48dd, user_id=de152c199730454d9435353957088987, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:01:58.773938 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453570b-0821-4da9-a9a4-0f0357f40891 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:01:58.785552 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1414/2789] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 17:01:58 2022] PUT /identity/v3/projects/8e93d4be3f5e4f57ab92462022ff48dd/users/de152c199730454d9435353957088987/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:03.164655 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e58642-d401-424f-ba22-f1bdc47fd8a9 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:03.165640 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e58642-d401-424f-ba22-f1bdc47fd8a9 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:03.165949 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e58642-d401-424f-ba22-f1bdc47fd8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:03.193626 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-06e58642-d401-424f-ba22-f1bdc47fd8a9 None None] MFA Rules not processed for user `de152c199730454d9435353957088987`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:03.195070 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-06e58642-d401-424f-ba22-f1bdc47fd8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:03.263700 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1376/2790] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:02:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:03.276030 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453570b-0821-4da9-a9a4-0f0357f40891 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:03.277902 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-c453570b-0821-4da9-a9a4-0f0357f40891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:03.342989 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453570b-0821-4da9-a9a4-0f0357f40891 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:03.346647 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078f266-bd98-41b7-b8a0-6bd25824ad61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92dc1464c4b24c6c8ea5dfcc796f0279', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:03.347294 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078f266-bd98-41b7-b8a0-6bd25824ad61 service glance] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:03.347703 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078f266-bd98-41b7-b8a0-6bd25824ad61 service glance] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:03.347991 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078f266-bd98-41b7-b8a0-6bd25824ad61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:03.409347 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078f266-bd98-41b7-b8a0-6bd25824ad61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:03.410845 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3078f266-bd98-41b7-b8a0-6bd25824ad61 service glance] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:03.420527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1415/2791] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:02:03.533940 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bee54-d68a-4a7f-b8af-59f3d613c4df None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:03.534235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bee54-d68a-4a7f-b8af-59f3d613c4df None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:03.534513 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71bee54-d68a-4a7f-b8af-59f3d613c4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:03.568893 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-c71bee54-d68a-4a7f-b8af-59f3d613c4df None None] MFA Rules not processed for user `e0653575c0a24603bb9287e6222313de`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:03.570624 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-c71bee54-d68a-4a7f-b8af-59f3d613c4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:03.649021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1377/2792] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Apr 11 17:02:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:03.699724 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078f266-bd98-41b7-b8a0-6bd25824ad61 service glance] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:03.701725 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-3078f266-bd98-41b7-b8a0-6bd25824ad61 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:03.781134 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078f266-bd98-41b7-b8a0-6bd25824ad61 service glance] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:03.788539 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da886b89-c20d-46e9-8f47-532aaa0d1214 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6659c6661840a79ba9ff1c3c9e93c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:03.789225 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da886b89-c20d-46e9-8f47-532aaa0d1214 service swift] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:03.789464 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da886b89-c20d-46e9-8f47-532aaa0d1214 service swift] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:03.789740 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da886b89-c20d-46e9-8f47-532aaa0d1214 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:03.800319 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da886b89-c20d-46e9-8f47-532aaa0d1214 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:03.803707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da886b89-c20d-46e9-8f47-532aaa0d1214 service swift] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:03.815947 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1416/2793] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Apr 11 17:02:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 17:02:13.205129 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a31e08-99df-45a0-b398-a6c0352ff4ff None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:13.205690 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a31e08-99df-45a0-b398-a6c0352ff4ff None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:13.205800 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a31e08-99df-45a0-b398-a6c0352ff4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:13.223781 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-97a31e08-99df-45a0-b398-a6c0352ff4ff None None] MFA Rules not processed for user `fcc4ebdac7fb437da89a7fd19cbe6ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:13.225054 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-97a31e08-99df-45a0-b398-a6c0352ff4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:13.232983 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1378/2794] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:02:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:13.488882 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da886b89-c20d-46e9-8f47-532aaa0d1214 service swift] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:13.490401 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-da886b89-c20d-46e9-8f47-532aaa0d1214 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:13.565148 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da886b89-c20d-46e9-8f47-532aaa0d1214 service swift] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:13.569599 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b373a7ef-645b-4aa2-a7dd-f16a324cc96f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:13.570391 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373a7ef-645b-4aa2-a7dd-f16a324cc96f service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:13.570708 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373a7ef-645b-4aa2-a7dd-f16a324cc96f service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:13.571045 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b373a7ef-645b-4aa2-a7dd-f16a324cc96f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:13.573090 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-b373a7ef-645b-4aa2-a7dd-f16a324cc96f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:13.583915 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373a7ef-645b-4aa2-a7dd-f16a324cc96f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:13.585344 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b373a7ef-645b-4aa2-a7dd-f16a324cc96f service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:13.593366 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1417/2795] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:02:13.913969 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a31e08-99df-45a0-b398-a6c0352ff4ff None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:13.915537 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-97a31e08-99df-45a0-b398-a6c0352ff4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:14.003378 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a31e08-99df-45a0-b398-a6c0352ff4ff None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:14.011044 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af930ab-0493-42ec-ad32-81df38fe1f40 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f5ef8708f54401af7e8defa8d13141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:14.011726 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af930ab-0493-42ec-ad32-81df38fe1f40 service placement] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:14.012121 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af930ab-0493-42ec-ad32-81df38fe1f40 service placement] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:14.012309 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af930ab-0493-42ec-ad32-81df38fe1f40 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:14.014149 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7af930ab-0493-42ec-ad32-81df38fe1f40 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:14.028160 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af930ab-0493-42ec-ad32-81df38fe1f40 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:14.030116 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af930ab-0493-42ec-ad32-81df38fe1f40 service placement] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:14.041576 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1379/2796] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:02:15.373226 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175de4ab-d312-4447-8c3b-d0223d2f3d73 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:15.373685 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175de4ab-d312-4447-8c3b-d0223d2f3d73 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:15.373781 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175de4ab-d312-4447-8c3b-d0223d2f3d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:15.395747 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-175de4ab-d312-4447-8c3b-d0223d2f3d73 None None] MFA Rules not processed for user `e0653575c0a24603bb9287e6222313de`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:15.396964 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-175de4ab-d312-4447-8c3b-d0223d2f3d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:15.404514 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1418/2797] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Apr 11 17:02:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:15.418881 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af930ab-0493-42ec-ad32-81df38fe1f40 service placement] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:15.430206 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af930ab-0493-42ec-ad32-81df38fe1f40 service placement] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:15.436391 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f236b99-5592-4a80-ace5-b1dff89f96ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6659c6661840a79ba9ff1c3c9e93c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:15.437070 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f236b99-5592-4a80-ace5-b1dff89f96ec service swift] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:15.437431 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f236b99-5592-4a80-ace5-b1dff89f96ec service swift] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:15.437836 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f236b99-5592-4a80-ace5-b1dff89f96ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:15.450233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f236b99-5592-4a80-ace5-b1dff89f96ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:15.452397 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f236b99-5592-4a80-ace5-b1dff89f96ec service swift] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:15.469619 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1380/2798] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Apr 11 17:02:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 17:02:23.866383 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175de4ab-d312-4447-8c3b-d0223d2f3d73 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:23.867984 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-175de4ab-d312-4447-8c3b-d0223d2f3d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:23.939374 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175de4ab-d312-4447-8c3b-d0223d2f3d73 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:23.944114 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61402118-b674-4de9-8709-e3c1a43a926d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:23.944987 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61402118-b674-4de9-8709-e3c1a43a926d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:23.945269 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61402118-b674-4de9-8709-e3c1a43a926d admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:23.945547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61402118-b674-4de9-8709-e3c1a43a926d admin admin] PATH_INFO: `/v3/users/8524207b2fa84eb3858a4017486faa77` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:23.946789 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61402118-b674-4de9-8709-e3c1a43a926d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8524207b2fa84eb3858a4017486faa77)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:23.948709 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61402118-b674-4de9-8709-e3c1a43a926d admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:23.995665 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-61402118-b674-4de9-8709-e3c1a43a926d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8524207b2fa84eb3858a4017486faa77'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:23.996824 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-61402118-b674-4de9-8709-e3c1a43a926d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8524207b2fa84eb3858a4017486faa77'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:24.005385 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-61402118-b674-4de9-8709-e3c1a43a926d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8524207b2fa84eb3858a4017486faa77'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:24.014522 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-61402118-b674-4de9-8709-e3c1a43a926d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8524207b2fa84eb3858a4017486faa77'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:24.028541 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-61402118-b674-4de9-8709-e3c1a43a926d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8524207b2fa84eb3858a4017486faa77'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:24.034626 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1419/2799] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 17:02:23 2022] DELETE /identity/v3/users/8524207b2fa84eb3858a4017486faa77 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:24.039203 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa341f1-29c3-4d74-a4e5-11f35b270ced None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:24.039706 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa341f1-29c3-4d74-a4e5-11f35b270ced None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:24.039929 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa341f1-29c3-4d74-a4e5-11f35b270ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:24.057096 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-6aa341f1-29c3-4d74-a4e5-11f35b270ced None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:24.058265 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6aa341f1-29c3-4d74-a4e5-11f35b270ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:24.118665 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1381/2800] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:02:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 17:02:24.128846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61402118-b674-4de9-8709-e3c1a43a926d admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:24.130468 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-61402118-b674-4de9-8709-e3c1a43a926d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:24.190836 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61402118-b674-4de9-8709-e3c1a43a926d admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:24.194425 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26e8fb-04a2-4e16-9d9a-b7b404122561 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:24.195148 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26e8fb-04a2-4e16-9d9a-b7b404122561 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:24.195425 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26e8fb-04a2-4e16-9d9a-b7b404122561 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:24.195695 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26e8fb-04a2-4e16-9d9a-b7b404122561 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:24.205576 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26e8fb-04a2-4e16-9d9a-b7b404122561 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:24.207028 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26e8fb-04a2-4e16-9d9a-b7b404122561 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:24.216943 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1420/2801] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:02:24.539443 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa341f1-29c3-4d74-a4e5-11f35b270ced None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:24.541395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-6aa341f1-29c3-4d74-a4e5-11f35b270ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:24.563723 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa341f1-29c3-4d74-a4e5-11f35b270ced None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:24.571234 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8980b97-b88f-4db1-8997-2c3201d56caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:24.572104 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8980b97-b88f-4db1-8997-2c3201d56caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:24.572386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8980b97-b88f-4db1-8997-2c3201d56caa admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:24.572656 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8980b97-b88f-4db1-8997-2c3201d56caa admin admin] PATH_INFO: `/v3/projects/fc9b54a51f734b6ab9176bf4f8dc6c9e` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:24.576822 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8980b97-b88f-4db1-8997-2c3201d56caa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc9b54a51f734b6ab9176bf4f8dc6c9e)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:24.579395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8980b97-b88f-4db1-8997-2c3201d56caa admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:24.641866 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f8980b97-b88f-4db1-8997-2c3201d56caa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc9b54a51f734b6ab9176bf4f8dc6c9e', 'request_id': 'req-f8980b97-b88f-4db1-8997-2c3201d56caa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:24.647265 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f8980b97-b88f-4db1-8997-2c3201d56caa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc9b54a51f734b6ab9176bf4f8dc6c9e', 'request_id': 'req-f8980b97-b88f-4db1-8997-2c3201d56caa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:24.653642 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f8980b97-b88f-4db1-8997-2c3201d56caa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc9b54a51f734b6ab9176bf4f8dc6c9e', 'request_id': 'req-f8980b97-b88f-4db1-8997-2c3201d56caa'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:24.666933 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f8980b97-b88f-4db1-8997-2c3201d56caa admin admin] The token cache is being invalidate because project fc9b54a51f734b6ab9176bf4f8dc6c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:02:24.667217 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f8980b97-b88f-4db1-8997-2c3201d56caa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:24.667866 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-f8980b97-b88f-4db1-8997-2c3201d56caa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:24.669675 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1382/2802] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 17:02:24 2022] DELETE /identity/v3/projects/fc9b54a51f734b6ab9176bf4f8dc6c9e => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:24.673453 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26e8fb-04a2-4e16-9d9a-b7b404122561 service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:24.683564 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26e8fb-04a2-4e16-9d9a-b7b404122561 service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:24.740915 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d5eac-5a49-4b41-9c32-780b6b32f5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:24.741877 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d5eac-5a49-4b41-9c32-780b6b32f5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:24.742156 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d5eac-5a49-4b41-9c32-780b6b32f5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:24.742582 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d5eac-5a49-4b41-9c32-780b6b32f5bd admin admin] PATH_INFO: `/v3/users/3f31095751b7497da99f2227ef313ef9` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:24.743792 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d5eac-5a49-4b41-9c32-780b6b32f5bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f31095751b7497da99f2227ef313ef9)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:24.745698 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d5eac-5a49-4b41-9c32-780b6b32f5bd admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:24.793802 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b94d5eac-5a49-4b41-9c32-780b6b32f5bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f31095751b7497da99f2227ef313ef9'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:24.794893 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b94d5eac-5a49-4b41-9c32-780b6b32f5bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f31095751b7497da99f2227ef313ef9'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:24.802962 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b94d5eac-5a49-4b41-9c32-780b6b32f5bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f31095751b7497da99f2227ef313ef9'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:24.810540 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b94d5eac-5a49-4b41-9c32-780b6b32f5bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f31095751b7497da99f2227ef313ef9'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:24.821729 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-b94d5eac-5a49-4b41-9c32-780b6b32f5bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f31095751b7497da99f2227ef313ef9'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:24.828353 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1421/2803] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 17:02:24 2022] DELETE /identity/v3/users/3f31095751b7497da99f2227ef313ef9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:25.092479 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8980b97-b88f-4db1-8997-2c3201d56caa admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:25.093979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-f8980b97-b88f-4db1-8997-2c3201d56caa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:25.110362 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8980b97-b88f-4db1-8997-2c3201d56caa admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:25.165204 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d4ecf-512b-4a4a-8ba7-8fc21cfdf08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:25.166053 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d4ecf-512b-4a4a-8ba7-8fc21cfdf08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:25.166339 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d4ecf-512b-4a4a-8ba7-8fc21cfdf08f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:25.166643 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d4ecf-512b-4a4a-8ba7-8fc21cfdf08f admin admin] PATH_INFO: `/v3/projects/aff6e964c6584b238b397c1a1fdf3d21` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:25.167853 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d4ecf-512b-4a4a-8ba7-8fc21cfdf08f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aff6e964c6584b238b397c1a1fdf3d21)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:25.170276 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d4ecf-512b-4a4a-8ba7-8fc21cfdf08f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:25.214407 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e35d4ecf-512b-4a4a-8ba7-8fc21cfdf08f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aff6e964c6584b238b397c1a1fdf3d21', 'request_id': 'req-e35d4ecf-512b-4a4a-8ba7-8fc21cfdf08f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:25.219462 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e35d4ecf-512b-4a4a-8ba7-8fc21cfdf08f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aff6e964c6584b238b397c1a1fdf3d21', 'request_id': 'req-e35d4ecf-512b-4a4a-8ba7-8fc21cfdf08f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:25.225388 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e35d4ecf-512b-4a4a-8ba7-8fc21cfdf08f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aff6e964c6584b238b397c1a1fdf3d21', 'request_id': 'req-e35d4ecf-512b-4a4a-8ba7-8fc21cfdf08f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:25.238800 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e35d4ecf-512b-4a4a-8ba7-8fc21cfdf08f admin admin] The token cache is being invalidate because project aff6e964c6584b238b397c1a1fdf3d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:02:25.239084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e35d4ecf-512b-4a4a-8ba7-8fc21cfdf08f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:25.239718 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-e35d4ecf-512b-4a4a-8ba7-8fc21cfdf08f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:25.241260 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1383/2804] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 17:02:25 2022] DELETE /identity/v3/projects/aff6e964c6584b238b397c1a1fdf3d21 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:25.246355 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bc1dc-2b04-4a95-8a7a-f156adcb4944 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:25.247435 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bc1dc-2b04-4a95-8a7a-f156adcb4944 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:25.247552 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bc1dc-2b04-4a95-8a7a-f156adcb4944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:25.265653 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-7e4bc1dc-2b04-4a95-8a7a-f156adcb4944 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:25.266847 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-7e4bc1dc-2b04-4a95-8a7a-f156adcb4944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:25.332367 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1422/2805] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:25.340263 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a57f1-e24d-4f46-b344-b51c08b20a20 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:25.340548 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a57f1-e24d-4f46-b344-b51c08b20a20 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:25.343021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a57f1-e24d-4f46-b344-b51c08b20a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:25.363109 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-ee6a57f1-e24d-4f46-b344-b51c08b20a20 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:25.364398 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ee6a57f1-e24d-4f46-b344-b51c08b20a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:25.376033 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1384/2806] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:02:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:25.380205 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bc1dc-2b04-4a95-8a7a-f156adcb4944 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:25.389900 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bc1dc-2b04-4a95-8a7a-f156adcb4944 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:25.394468 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811045a-1496-4521-aa1e-46483d6e96d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:25.395161 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811045a-1496-4521-aa1e-46483d6e96d2 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:25.395588 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811045a-1496-4521-aa1e-46483d6e96d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:25.395870 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1811045a-1496-4521-aa1e-46483d6e96d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:25.396592 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811045a-1496-4521-aa1e-46483d6e96d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 17:02:25.396897 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811045a-1496-4521-aa1e-46483d6e96d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:25.398493 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1811045a-1496-4521-aa1e-46483d6e96d2 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:25.410547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1423/2807] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 17:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 17:02:25.414832 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a57f1-e24d-4f46-b344-b51c08b20a20 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:25.424735 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a57f1-e24d-4f46-b344-b51c08b20a20 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:25.429406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e4034-9b8e-4f1e-90ad-96c5c85433f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:25.430053 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e4034-9b8e-4f1e-90ad-96c5c85433f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:25.430330 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e4034-9b8e-4f1e-90ad-96c5c85433f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:25.430616 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e4034-9b8e-4f1e-90ad-96c5c85433f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:25.431326 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e4034-9b8e-4f1e-90ad-96c5c85433f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:25.433200 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e4034-9b8e-4f1e-90ad-96c5c85433f8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:25.471186 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1385/2808] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 17:02:25 2022] POST /identity/v3/projects => generated 365 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:02:25.472416 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811045a-1496-4521-aa1e-46483d6e96d2 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:25.483141 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1811045a-1496-4521-aa1e-46483d6e96d2 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:25.536815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26916802-a47e-4d43-ab5b-857d919b0049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:25.537506 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26916802-a47e-4d43-ab5b-857d919b0049 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:25.537768 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26916802-a47e-4d43-ab5b-857d919b0049 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:25.538039 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26916802-a47e-4d43-ab5b-857d919b0049 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:25.538770 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26916802-a47e-4d43-ab5b-857d919b0049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:25.540689 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26916802-a47e-4d43-ab5b-857d919b0049 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:25.564399 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1424/2809] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 17:02:25 2022] POST /identity/v3/users => generated 283 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:02:25.565706 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e4034-9b8e-4f1e-90ad-96c5c85433f8 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:25.576064 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e4034-9b8e-4f1e-90ad-96c5c85433f8 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:25.581113 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d56679-0509-4734-b68a-71157956aa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:25.581766 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56679-0509-4734-b68a-71157956aa2b admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:25.582051 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56679-0509-4734-b68a-71157956aa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:25.582353 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d56679-0509-4734-b68a-71157956aa2b admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:25.583087 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d56679-0509-4734-b68a-71157956aa2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:25.584729 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d56679-0509-4734-b68a-71157956aa2b admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:25.595809 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1386/2810] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:02:25.599640 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26916802-a47e-4d43-ab5b-857d919b0049 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:25.610071 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26916802-a47e-4d43-ab5b-857d919b0049 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:25.614671 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471f7b50-f756-4d72-b087-3252392a2671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:25.615321 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f7b50-f756-4d72-b087-3252392a2671 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:25.615607 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f7b50-f756-4d72-b087-3252392a2671 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:25.615884 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471f7b50-f756-4d72-b087-3252392a2671 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:25.616630 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f7b50-f756-4d72-b087-3252392a2671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:25.618217 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471f7b50-f756-4d72-b087-3252392a2671 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:25.627893 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1425/2811] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:02:25.632181 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d56679-0509-4734-b68a-71157956aa2b admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:25.644460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d56679-0509-4734-b68a-71157956aa2b admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:25.649057 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67756d74-77e3-4abd-b30d-dc7a549787a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:25.649928 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67756d74-77e3-4abd-b30d-dc7a549787a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:25.650208 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67756d74-77e3-4abd-b30d-dc7a549787a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:25.650486 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67756d74-77e3-4abd-b30d-dc7a549787a3 admin admin] PATH_INFO: `/v3/projects/c2ed55b0f58344e7a62b5c3e12738387/users/4ed403d8d8dc4b67a0ed405fb0767d98/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:25.665775 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67756d74-77e3-4abd-b30d-dc7a549787a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2ed55b0f58344e7a62b5c3e12738387, user_id=4ed403d8d8dc4b67a0ed405fb0767d98, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:25.668997 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67756d74-77e3-4abd-b30d-dc7a549787a3 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:25.681138 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1387/2812] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 17:02:25 2022] PUT /identity/v3/projects/c2ed55b0f58344e7a62b5c3e12738387/users/4ed403d8d8dc4b67a0ed405fb0767d98/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 17:02:25.691402 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc8747-0cab-4ad3-bb2b-395000bd34b7 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:25.691694 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc8747-0cab-4ad3-bb2b-395000bd34b7 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:25.691978 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc8747-0cab-4ad3-bb2b-395000bd34b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:25.718386 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-4dbc8747-0cab-4ad3-bb2b-395000bd34b7 None None] MFA Rules not processed for user `4ed403d8d8dc4b67a0ed405fb0767d98`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:25.719549 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-4dbc8747-0cab-4ad3-bb2b-395000bd34b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:25.783217 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1426/2813] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:02:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:25.787672 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67756d74-77e3-4abd-b30d-dc7a549787a3 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:25.848813 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67756d74-77e3-4abd-b30d-dc7a549787a3 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:25.853477 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159306-b159-4015-9501-fb13d2f044f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:25.854133 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159306-b159-4015-9501-fb13d2f044f8 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:25.854417 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159306-b159-4015-9501-fb13d2f044f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:25.854725 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159306-b159-4015-9501-fb13d2f044f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:25.855414 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d159306-b159-4015-9501-fb13d2f044f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:25.857878 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d159306-b159-4015-9501-fb13d2f044f8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:25.886232 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1388/2814] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 17:02:25 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:02:25.890439 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc8747-0cab-4ad3-bb2b-395000bd34b7 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:25.902421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc8747-0cab-4ad3-bb2b-395000bd34b7 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:25.975967 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b1433-5ea7-4a21-93c9-9474d610c3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:25.976572 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b1433-5ea7-4a21-93c9-9474d610c3cd admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:25.976856 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b1433-5ea7-4a21-93c9-9474d610c3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:25.977131 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b1433-5ea7-4a21-93c9-9474d610c3cd admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:25.977830 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b1433-5ea7-4a21-93c9-9474d610c3cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:25.980411 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b1433-5ea7-4a21-93c9-9474d610c3cd admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:26.007140 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1427/2815] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 17:02:25 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:02:26.008392 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159306-b159-4015-9501-fb13d2f044f8 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:26.021253 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159306-b159-4015-9501-fb13d2f044f8 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:26.027404 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37acf2b-0623-4b6e-b68d-e76b74d1f28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:26.028606 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37acf2b-0623-4b6e-b68d-e76b74d1f28f admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:26.029682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37acf2b-0623-4b6e-b68d-e76b74d1f28f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:26.029972 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37acf2b-0623-4b6e-b68d-e76b74d1f28f admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:26.031025 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37acf2b-0623-4b6e-b68d-e76b74d1f28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:26.032556 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37acf2b-0623-4b6e-b68d-e76b74d1f28f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:26.045444 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1389/2816] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:02:26.048421 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b1433-5ea7-4a21-93c9-9474d610c3cd admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:26.059807 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b1433-5ea7-4a21-93c9-9474d610c3cd admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:26.065066 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eaf4d-91bd-4285-a3e9-98b6fdbd425b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:26.066054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eaf4d-91bd-4285-a3e9-98b6fdbd425b admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:26.066434 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eaf4d-91bd-4285-a3e9-98b6fdbd425b admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:26.069537 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68eaf4d-91bd-4285-a3e9-98b6fdbd425b admin admin] PATH_INFO: `/v3/projects/58fc5be562e1462f9a751ae17181c92c/users/ab7ec520915649969f672845dea88d51/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:26.083841 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68eaf4d-91bd-4285-a3e9-98b6fdbd425b admin admin] RBAC: Authorizing `identity:create_grant(project_id=58fc5be562e1462f9a751ae17181c92c, user_id=ab7ec520915649969f672845dea88d51, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:26.086686 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68eaf4d-91bd-4285-a3e9-98b6fdbd425b admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:26.100545 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1428/2817] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 17:02:26 2022] PUT /identity/v3/projects/58fc5be562e1462f9a751ae17181c92c/users/ab7ec520915649969f672845dea88d51/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 17:02:26.104235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37acf2b-0623-4b6e-b68d-e76b74d1f28f admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:26.115193 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37acf2b-0623-4b6e-b68d-e76b74d1f28f admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:26.171705 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b69b07-41d3-40e5-8600-6441694721bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:26.172408 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b69b07-41d3-40e5-8600-6441694721bb admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:26.172694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b69b07-41d3-40e5-8600-6441694721bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:26.172973 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b69b07-41d3-40e5-8600-6441694721bb admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:26.173696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b69b07-41d3-40e5-8600-6441694721bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:26.175327 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b69b07-41d3-40e5-8600-6441694721bb admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:26.188708 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1390/2818] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 17:02:26.189928 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eaf4d-91bd-4285-a3e9-98b6fdbd425b admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:26.200642 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68eaf4d-91bd-4285-a3e9-98b6fdbd425b admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:26.205313 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958917ad-6e16-4a65-8e83-b542615f7bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:26.206259 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958917ad-6e16-4a65-8e83-b542615f7bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:26.206639 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958917ad-6e16-4a65-8e83-b542615f7bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:26.206988 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958917ad-6e16-4a65-8e83-b542615f7bf6 admin admin] PATH_INFO: `/v3/projects/58fc5be562e1462f9a751ae17181c92c/users/ab7ec520915649969f672845dea88d51/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:26.209060 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958917ad-6e16-4a65-8e83-b542615f7bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58fc5be562e1462f9a751ae17181c92c, user_id=ab7ec520915649969f672845dea88d51, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:26.211823 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958917ad-6e16-4a65-8e83-b542615f7bf6 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:26.222534 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1429/2819] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 17:02:26 2022] PUT /identity/v3/projects/58fc5be562e1462f9a751ae17181c92c/users/ab7ec520915649969f672845dea88d51/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:26.234556 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa49f5c-1868-436b-a6d3-47a9467c729a None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:26.234798 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa49f5c-1868-436b-a6d3-47a9467c729a None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:26.235082 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa49f5c-1868-436b-a6d3-47a9467c729a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:26.261392 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-faa49f5c-1868-436b-a6d3-47a9467c729a None None] MFA Rules not processed for user `ab7ec520915649969f672845dea88d51`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:26.263259 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-faa49f5c-1868-436b-a6d3-47a9467c729a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:26.331544 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1391/2820] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:02:26 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:26.343990 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958917ad-6e16-4a65-8e83-b542615f7bf6 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:26.345825 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-958917ad-6e16-4a65-8e83-b542615f7bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:26.403703 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958917ad-6e16-4a65-8e83-b542615f7bf6 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:26.411638 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb568de3-5264-4e2b-9af4-a22407e3b3ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:26.412374 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb568de3-5264-4e2b-9af4-a22407e3b3ff service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:26.412724 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb568de3-5264-4e2b-9af4-a22407e3b3ff service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:26.413065 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb568de3-5264-4e2b-9af4-a22407e3b3ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:26.424651 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb568de3-5264-4e2b-9af4-a22407e3b3ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:26.426094 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb568de3-5264-4e2b-9af4-a22407e3b3ff service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:26.436114 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1430/2821] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:26 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:02:26.523879 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa49f5c-1868-436b-a6d3-47a9467c729a None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:26.534712 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa49f5c-1868-436b-a6d3-47a9467c729a None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:26.539098 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a00a9d-0468-46a6-8d91-77f54eed4ad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:26.539750 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a00a9d-0468-46a6-8d91-77f54eed4ad6 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:26.540034 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a00a9d-0468-46a6-8d91-77f54eed4ad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:26.540362 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a00a9d-0468-46a6-8d91-77f54eed4ad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:26.600707 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a00a9d-0468-46a6-8d91-77f54eed4ad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:26.602347 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a00a9d-0468-46a6-8d91-77f54eed4ad6 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:26.612643 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1392/2822] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:26 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:02:30.664430 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb568de3-5264-4e2b-9af4-a22407e3b3ff service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:30.666566 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-eb568de3-5264-4e2b-9af4-a22407e3b3ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:30.722956 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb568de3-5264-4e2b-9af4-a22407e3b3ff service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:30.726646 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351723a-2251-4104-bd8f-d94f591d4d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:30.727295 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351723a-2251-4104-bd8f-d94f591d4d06 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:30.727575 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351723a-2251-4104-bd8f-d94f591d4d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:30.727853 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351723a-2251-4104-bd8f-d94f591d4d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:30.729630 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d351723a-2251-4104-bd8f-d94f591d4d06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:30.792644 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351723a-2251-4104-bd8f-d94f591d4d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:30.794109 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351723a-2251-4104-bd8f-d94f591d4d06 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:30.803381 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1431/2823] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:02:31.126923 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a00a9d-0468-46a6-8d91-77f54eed4ad6 service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:31.128336 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-50a00a9d-0468-46a6-8d91-77f54eed4ad6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:31.227570 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a00a9d-0468-46a6-8d91-77f54eed4ad6 service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:31.233050 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a21747-32ee-4d7a-897e-ec90aa718cf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:31.233694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a21747-32ee-4d7a-897e-ec90aa718cf7 service nova] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:31.233974 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a21747-32ee-4d7a-897e-ec90aa718cf7 service nova] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:31.234245 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a21747-32ee-4d7a-897e-ec90aa718cf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:31.236394 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-58a21747-32ee-4d7a-897e-ec90aa718cf7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:31.253454 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a21747-32ee-4d7a-897e-ec90aa718cf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:31.255082 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a21747-32ee-4d7a-897e-ec90aa718cf7 service nova] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:31.276616 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1393/2824] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:02:31.340032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351723a-2251-4104-bd8f-d94f591d4d06 service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:31.349153 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351723a-2251-4104-bd8f-d94f591d4d06 service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:31.353809 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c357e6d-b3c8-4462-b76d-99e9de204164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:31.354706 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c357e6d-b3c8-4462-b76d-99e9de204164 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:31.355006 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c357e6d-b3c8-4462-b76d-99e9de204164 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:31.355280 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c357e6d-b3c8-4462-b76d-99e9de204164 admin admin] PATH_INFO: `/v3/users/4ed403d8d8dc4b67a0ed405fb0767d98` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:31.356505 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c357e6d-b3c8-4462-b76d-99e9de204164 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ed403d8d8dc4b67a0ed405fb0767d98)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:31.358457 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c357e6d-b3c8-4462-b76d-99e9de204164 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:31.408938 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6c357e6d-b3c8-4462-b76d-99e9de204164 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ed403d8d8dc4b67a0ed405fb0767d98'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:31.409836 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6c357e6d-b3c8-4462-b76d-99e9de204164 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ed403d8d8dc4b67a0ed405fb0767d98'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:31.419687 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6c357e6d-b3c8-4462-b76d-99e9de204164 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ed403d8d8dc4b67a0ed405fb0767d98'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:31.427240 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6c357e6d-b3c8-4462-b76d-99e9de204164 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ed403d8d8dc4b67a0ed405fb0767d98'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:31.440760 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6c357e6d-b3c8-4462-b76d-99e9de204164 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ed403d8d8dc4b67a0ed405fb0767d98'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:31.448164 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1432/2825] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 17:02:31 2022] DELETE /identity/v3/users/4ed403d8d8dc4b67a0ed405fb0767d98 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:31.453414 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9321d3d-a51b-4525-84d8-ce7bd9221b1b None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:31.453953 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9321d3d-a51b-4525-84d8-ce7bd9221b1b None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:31.454232 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9321d3d-a51b-4525-84d8-ce7bd9221b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:31.472526 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-d9321d3d-a51b-4525-84d8-ce7bd9221b1b None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:31.473662 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d9321d3d-a51b-4525-84d8-ce7bd9221b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:31.534642 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1394/2826] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:31.544578 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c357e6d-b3c8-4462-b76d-99e9de204164 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:31.546514 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-6c357e6d-b3c8-4462-b76d-99e9de204164 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:31.602009 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c357e6d-b3c8-4462-b76d-99e9de204164 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:31.606205 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2293e0-c777-4b5a-930e-9b0eac85a671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:31.606908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2293e0-c777-4b5a-930e-9b0eac85a671 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:31.607192 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2293e0-c777-4b5a-930e-9b0eac85a671 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:31.607470 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2293e0-c777-4b5a-930e-9b0eac85a671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:31.616601 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2293e0-c777-4b5a-930e-9b0eac85a671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:31.618032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2293e0-c777-4b5a-930e-9b0eac85a671 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:31.628185 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1433/2827] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:02:31.974623 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9321d3d-a51b-4525-84d8-ce7bd9221b1b None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:31.976194 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d9321d3d-a51b-4525-84d8-ce7bd9221b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:31.988684 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9321d3d-a51b-4525-84d8-ce7bd9221b1b None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:31.993590 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21348a-f33c-4644-bb47-c039826cc305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:31.994451 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21348a-f33c-4644-bb47-c039826cc305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:31.994762 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21348a-f33c-4644-bb47-c039826cc305 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:31.995034 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b21348a-f33c-4644-bb47-c039826cc305 admin admin] PATH_INFO: `/v3/projects/c2ed55b0f58344e7a62b5c3e12738387` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:31.996280 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21348a-f33c-4644-bb47-c039826cc305 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2ed55b0f58344e7a62b5c3e12738387)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:31.998201 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b21348a-f33c-4644-bb47-c039826cc305 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:32.048069 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4b21348a-f33c-4644-bb47-c039826cc305 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2ed55b0f58344e7a62b5c3e12738387', 'request_id': 'req-4b21348a-f33c-4644-bb47-c039826cc305'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:32.053479 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4b21348a-f33c-4644-bb47-c039826cc305 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2ed55b0f58344e7a62b5c3e12738387', 'request_id': 'req-4b21348a-f33c-4644-bb47-c039826cc305'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:32.060706 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4b21348a-f33c-4644-bb47-c039826cc305 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2ed55b0f58344e7a62b5c3e12738387', 'request_id': 'req-4b21348a-f33c-4644-bb47-c039826cc305'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:32.072881 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4b21348a-f33c-4644-bb47-c039826cc305 admin admin] The token cache is being invalidate because project c2ed55b0f58344e7a62b5c3e12738387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:02:32.073261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4b21348a-f33c-4644-bb47-c039826cc305 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:32.074107 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4b21348a-f33c-4644-bb47-c039826cc305 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:32.075834 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1395/2828] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 17:02:31 2022] DELETE /identity/v3/projects/c2ed55b0f58344e7a62b5c3e12738387 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:32.079735 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2293e0-c777-4b5a-930e-9b0eac85a671 service neutron] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:32.089298 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2293e0-c777-4b5a-930e-9b0eac85a671 service neutron] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:32.159743 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75e448-0e92-4952-b3c1-8d09904290ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:32.160578 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75e448-0e92-4952-b3c1-8d09904290ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:32.161009 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75e448-0e92-4952-b3c1-8d09904290ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:32.161290 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75e448-0e92-4952-b3c1-8d09904290ca admin admin] PATH_INFO: `/v3/users/ab7ec520915649969f672845dea88d51` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:32.162500 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75e448-0e92-4952-b3c1-8d09904290ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab7ec520915649969f672845dea88d51)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:32.164491 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75e448-0e92-4952-b3c1-8d09904290ca admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:32.215769 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-bb75e448-0e92-4952-b3c1-8d09904290ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab7ec520915649969f672845dea88d51'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:32.216473 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-bb75e448-0e92-4952-b3c1-8d09904290ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab7ec520915649969f672845dea88d51'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:32.225565 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-bb75e448-0e92-4952-b3c1-8d09904290ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab7ec520915649969f672845dea88d51'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:32.233535 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-bb75e448-0e92-4952-b3c1-8d09904290ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab7ec520915649969f672845dea88d51'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:32.246132 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-bb75e448-0e92-4952-b3c1-8d09904290ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab7ec520915649969f672845dea88d51'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:32.255576 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1434/2829] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 17:02:32 2022] DELETE /identity/v3/users/ab7ec520915649969f672845dea88d51 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 17:02:32.527244 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21348a-f33c-4644-bb47-c039826cc305 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:32.529379 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-4b21348a-f33c-4644-bb47-c039826cc305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:32.557043 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b21348a-f33c-4644-bb47-c039826cc305 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:32.616084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ca1ae-774d-4417-b96a-ffe1172a2cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:32.616084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ca1ae-774d-4417-b96a-ffe1172a2cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:32.616084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ca1ae-774d-4417-b96a-ffe1172a2cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:32.616084 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ca1ae-774d-4417-b96a-ffe1172a2cbf admin admin] PATH_INFO: `/v3/projects/58fc5be562e1462f9a751ae17181c92c` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:32.617080 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ca1ae-774d-4417-b96a-ffe1172a2cbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=58fc5be562e1462f9a751ae17181c92c)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:32.619133 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ca1ae-774d-4417-b96a-ffe1172a2cbf admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:32.673177 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-fe4ca1ae-774d-4417-b96a-ffe1172a2cbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58fc5be562e1462f9a751ae17181c92c', 'request_id': 'req-fe4ca1ae-774d-4417-b96a-ffe1172a2cbf'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:32.680281 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-fe4ca1ae-774d-4417-b96a-ffe1172a2cbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58fc5be562e1462f9a751ae17181c92c', 'request_id': 'req-fe4ca1ae-774d-4417-b96a-ffe1172a2cbf'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:32.688492 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-fe4ca1ae-774d-4417-b96a-ffe1172a2cbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58fc5be562e1462f9a751ae17181c92c', 'request_id': 'req-fe4ca1ae-774d-4417-b96a-ffe1172a2cbf'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:32.708705 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-fe4ca1ae-774d-4417-b96a-ffe1172a2cbf admin admin] The token cache is being invalidate because project 58fc5be562e1462f9a751ae17181c92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:02:32.709257 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-fe4ca1ae-774d-4417-b96a-ffe1172a2cbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:32.710192 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-fe4ca1ae-774d-4417-b96a-ffe1172a2cbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:32.712721 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1396/2830] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 17:02:32 2022] DELETE /identity/v3/projects/58fc5be562e1462f9a751ae17181c92c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:32.718042 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f1b93-f2a8-4bc0-98d5-5d30ef24211a None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:32.718322 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f1b93-f2a8-4bc0-98d5-5d30ef24211a None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:32.718618 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f1b93-f2a8-4bc0-98d5-5d30ef24211a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:32.737944 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-8d0f1b93-f2a8-4bc0-98d5-5d30ef24211a None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:32.739207 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-8d0f1b93-f2a8-4bc0-98d5-5d30ef24211a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:32.803555 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1435/2831] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:32.811752 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944bfc3-db03-4751-95bb-7efb68072704 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:32.812041 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944bfc3-db03-4751-95bb-7efb68072704 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:32.812327 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1944bfc3-db03-4751-95bb-7efb68072704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:32.831781 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-1944bfc3-db03-4751-95bb-7efb68072704 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:32.832981 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-1944bfc3-db03-4751-95bb-7efb68072704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:32.841847 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1397/2832] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:32.846055 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f1b93-f2a8-4bc0-98d5-5d30ef24211a None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:32.856738 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f1b93-f2a8-4bc0-98d5-5d30ef24211a None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:32.863106 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f397a46-b7b3-4c15-bc6a-873019c937dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:32.864258 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f397a46-b7b3-4c15-bc6a-873019c937dc admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:32.864547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f397a46-b7b3-4c15-bc6a-873019c937dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:32.864825 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f397a46-b7b3-4c15-bc6a-873019c937dc admin admin] PATH_INFO: `/v3/domains` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:32.866044 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f397a46-b7b3-4c15-bc6a-873019c937dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86346) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 17:02:32.866360 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f397a46-b7b3-4c15-bc6a-873019c937dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:32.868725 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f397a46-b7b3-4c15-bc6a-873019c937dc admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:32.884664 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1436/2833] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 17:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 17:02:32.887554 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944bfc3-db03-4751-95bb-7efb68072704 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:32.897250 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1944bfc3-db03-4751-95bb-7efb68072704 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:32.903406 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c97c6-b507-48ff-9360-62d8da42f476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:32.904159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c97c6-b507-48ff-9360-62d8da42f476 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:32.904504 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c97c6-b507-48ff-9360-62d8da42f476 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:32.904842 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607c97c6-b507-48ff-9360-62d8da42f476 admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:32.905595 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c97c6-b507-48ff-9360-62d8da42f476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:32.907613 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607c97c6-b507-48ff-9360-62d8da42f476 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:32.938157 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1398/2834] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 17:02:32 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:02:32.945924 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f397a46-b7b3-4c15-bc6a-873019c937dc admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:32.958546 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f397a46-b7b3-4c15-bc6a-873019c937dc admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:33.017995 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c19eca-f9f6-47df-915f-587706bf0db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:33.018708 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c19eca-f9f6-47df-915f-587706bf0db9 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:33.018999 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c19eca-f9f6-47df-915f-587706bf0db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:33.019282 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c19eca-f9f6-47df-915f-587706bf0db9 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:33.019971 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c19eca-f9f6-47df-915f-587706bf0db9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:33.022100 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c19eca-f9f6-47df-915f-587706bf0db9 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:33.053426 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1437/2835] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 17:02:32 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:02:33.055690 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c97c6-b507-48ff-9360-62d8da42f476 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:33.070659 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607c97c6-b507-48ff-9360-62d8da42f476 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:33.078393 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32b51f-7532-41af-bc51-1faf0281a9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:33.079099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32b51f-7532-41af-bc51-1faf0281a9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:33.080496 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32b51f-7532-41af-bc51-1faf0281a9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:33.080797 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32b51f-7532-41af-bc51-1faf0281a9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:33.081755 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32b51f-7532-41af-bc51-1faf0281a9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:33.083647 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32b51f-7532-41af-bc51-1faf0281a9e4 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:33.101925 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1399/2836] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 17:02:33.106781 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c19eca-f9f6-47df-915f-587706bf0db9 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:33.129011 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c19eca-f9f6-47df-915f-587706bf0db9 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:33.135614 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae46175-3d9c-45e6-a250-85147b2050ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:33.136500 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae46175-3d9c-45e6-a250-85147b2050ea admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:33.137507 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae46175-3d9c-45e6-a250-85147b2050ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:33.137937 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae46175-3d9c-45e6-a250-85147b2050ea admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:33.138901 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae46175-3d9c-45e6-a250-85147b2050ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:33.140755 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae46175-3d9c-45e6-a250-85147b2050ea admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:33.153269 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1438/2837] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:02:33.157024 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32b51f-7532-41af-bc51-1faf0281a9e4 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:33.168352 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32b51f-7532-41af-bc51-1faf0281a9e4 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:33.190649 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a6bd3-9a05-4bc0-b3d1-8a5022fcd653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:33.190649 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a6bd3-9a05-4bc0-b3d1-8a5022fcd653 admin admin] REQUEST_METHOD: `PUT` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:33.190649 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a6bd3-9a05-4bc0-b3d1-8a5022fcd653 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:33.190649 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a6bd3-9a05-4bc0-b3d1-8a5022fcd653 admin admin] PATH_INFO: `/v3/projects/69137dbd240145cab6129f0ed1023128/users/b63338f13d9c43aca450e05ff6ea691f/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:33.232401 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a6bd3-9a05-4bc0-b3d1-8a5022fcd653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69137dbd240145cab6129f0ed1023128, user_id=b63338f13d9c43aca450e05ff6ea691f, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:33.235297 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042a6bd3-9a05-4bc0-b3d1-8a5022fcd653 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:33.254552 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1400/2838] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 17:02:33 2022] PUT /identity/v3/projects/69137dbd240145cab6129f0ed1023128/users/b63338f13d9c43aca450e05ff6ea691f/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:33.264626 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b6116-31ee-4188-b537-31dd87e3b885 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:33.264910 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b6116-31ee-4188-b537-31dd87e3b885 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:33.265259 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b6116-31ee-4188-b537-31dd87e3b885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:33.299154 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-769b6116-31ee-4188-b537-31dd87e3b885 None None] MFA Rules not processed for user `b63338f13d9c43aca450e05ff6ea691f`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:33.300472 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-769b6116-31ee-4188-b537-31dd87e3b885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:33.373855 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1439/2839] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:02:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 17:02:33.378367 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a6bd3-9a05-4bc0-b3d1-8a5022fcd653 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:33.441674 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a6bd3-9a05-4bc0-b3d1-8a5022fcd653 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:33.447326 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cc217-96ae-48e6-940f-c3a872c37acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:33.448073 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cc217-96ae-48e6-940f-c3a872c37acc admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:33.448521 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cc217-96ae-48e6-940f-c3a872c37acc admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:33.448801 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213cc217-96ae-48e6-940f-c3a872c37acc admin admin] PATH_INFO: `/v3/projects` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:33.449562 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cc217-96ae-48e6-940f-c3a872c37acc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:33.451524 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213cc217-96ae-48e6-940f-c3a872c37acc admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:33.483108 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1401/2840] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 17:02:33 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 17:02:33.487169 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b6116-31ee-4188-b537-31dd87e3b885 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:33.498364 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b6116-31ee-4188-b537-31dd87e3b885 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:33.590023 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3cb3e-b01b-4828-9f40-ff6a84100946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:33.591354 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3cb3e-b01b-4828-9f40-ff6a84100946 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:33.591637 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3cb3e-b01b-4828-9f40-ff6a84100946 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:33.591916 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3cb3e-b01b-4828-9f40-ff6a84100946 admin admin] PATH_INFO: `/v3/users` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:33.593093 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3cb3e-b01b-4828-9f40-ff6a84100946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:33.595120 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3cb3e-b01b-4828-9f40-ff6a84100946 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:33.638530 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1440/2841] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 17:02:33 2022] POST /identity/v3/users => generated 298 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 17:02:33.642378 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cc217-96ae-48e6-940f-c3a872c37acc admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:33.653292 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213cc217-96ae-48e6-940f-c3a872c37acc admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:33.658922 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35630b-b287-4ee4-a668-5f599d1eddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:33.659596 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35630b-b287-4ee4-a668-5f599d1eddee admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:33.659878 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35630b-b287-4ee4-a668-5f599d1eddee admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:33.660320 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca35630b-b287-4ee4-a668-5f599d1eddee admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:33.661053 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35630b-b287-4ee4-a668-5f599d1eddee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:33.662682 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca35630b-b287-4ee4-a668-5f599d1eddee admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:33.677846 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1402/2842] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 17:02:33.679075 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3cb3e-b01b-4828-9f40-ff6a84100946 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:33.690353 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3cb3e-b01b-4828-9f40-ff6a84100946 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:33.695343 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e3f01-4a06-454c-b3f4-ac636a981f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:33.696237 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e3f01-4a06-454c-b3f4-ac636a981f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:33.696514 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e3f01-4a06-454c-b3f4-ac636a981f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:33.696786 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87e3f01-4a06-454c-b3f4-ac636a981f0e admin admin] PATH_INFO: `/v3/projects/8b1168a344814fe087e3832d8a6ff506/users/b1d8d4f00de74219a7c77ec6c8cb8572/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:33.713577 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e3f01-4a06-454c-b3f4-ac636a981f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1168a344814fe087e3832d8a6ff506, user_id=b1d8d4f00de74219a7c77ec6c8cb8572, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:33.716496 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87e3f01-4a06-454c-b3f4-ac636a981f0e admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:33.733859 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1441/2843] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 17:02:33 2022] PUT /identity/v3/projects/8b1168a344814fe087e3832d8a6ff506/users/b1d8d4f00de74219a7c77ec6c8cb8572/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:33.738463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35630b-b287-4ee4-a668-5f599d1eddee admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:33.764490 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca35630b-b287-4ee4-a668-5f599d1eddee admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:33.835232 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866b0c9f-145f-4c61-b76b-227c5fa6fd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:33.835694 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b0c9f-145f-4c61-b76b-227c5fa6fd5f admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:33.836013 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b0c9f-145f-4c61-b76b-227c5fa6fd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:33.836372 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866b0c9f-145f-4c61-b76b-227c5fa6fd5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:33.837148 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b0c9f-145f-4c61-b76b-227c5fa6fd5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:33.838828 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866b0c9f-145f-4c61-b76b-227c5fa6fd5f admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:33.853501 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1403/2844] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:02:33.854851 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e3f01-4a06-454c-b3f4-ac636a981f0e admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:33.874224 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87e3f01-4a06-454c-b3f4-ac636a981f0e admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:33.881504 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901771c-71ef-4558-bcb6-b50f8095f7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:33.882657 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901771c-71ef-4558-bcb6-b50f8095f7bf admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:33.883088 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901771c-71ef-4558-bcb6-b50f8095f7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:33.883512 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8901771c-71ef-4558-bcb6-b50f8095f7bf admin admin] PATH_INFO: `/v3/projects/8b1168a344814fe087e3832d8a6ff506/users/b1d8d4f00de74219a7c77ec6c8cb8572/roles/13de1ce875d44fcc988cc31b3a0639be` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:33.886377 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901771c-71ef-4558-bcb6-b50f8095f7bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b1168a344814fe087e3832d8a6ff506, user_id=b1d8d4f00de74219a7c77ec6c8cb8572, role_id=13de1ce875d44fcc988cc31b3a0639be)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:33.889764 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8901771c-71ef-4558-bcb6-b50f8095f7bf admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:33.915521 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1442/2845] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 17:02:33 2022] PUT /identity/v3/projects/8b1168a344814fe087e3832d8a6ff506/users/b1d8d4f00de74219a7c77ec6c8cb8572/roles/13de1ce875d44fcc988cc31b3a0639be => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:33.979335 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bad80f-f967-44b8-9788-39f3b09f63da None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:33.979617 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bad80f-f967-44b8-9788-39f3b09f63da None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:33.979887 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bad80f-f967-44b8-9788-39f3b09f63da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:34.023060 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-a7bad80f-f967-44b8-9788-39f3b09f63da None None] MFA Rules not processed for user `b1d8d4f00de74219a7c77ec6c8cb8572`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:34.024269 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a7bad80f-f967-44b8-9788-39f3b09f63da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:34.123632 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1404/2846] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:02:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:34.135344 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901771c-71ef-4558-bcb6-b50f8095f7bf admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:34.138165 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-8901771c-71ef-4558-bcb6-b50f8095f7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:34.206424 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8901771c-71ef-4558-bcb6-b50f8095f7bf admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:34.216392 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ffdb6-a493-4f27-b861-4681f0cd3c9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:34.217568 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ffdb6-a493-4f27-b861-4681f0cd3c9a service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:34.219054 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ffdb6-a493-4f27-b861-4681f0cd3c9a service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:34.219336 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ffdb6-a493-4f27-b861-4681f0cd3c9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:34.307478 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ffdb6-a493-4f27-b861-4681f0cd3c9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:34.309485 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ffdb6-a493-4f27-b861-4681f0cd3c9a service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:34.326632 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1443/2847] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:02:37.949698 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bad80f-f967-44b8-9788-39f3b09f63da None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:37.951233 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-a7bad80f-f967-44b8-9788-39f3b09f63da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:38.016286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bad80f-f967-44b8-9788-39f3b09f63da None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:38.021279 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96eb0e-da1a-46fd-acd1-f5eed3ffe661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:38.022457 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96eb0e-da1a-46fd-acd1-f5eed3ffe661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:38.022906 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96eb0e-da1a-46fd-acd1-f5eed3ffe661 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:38.023231 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96eb0e-da1a-46fd-acd1-f5eed3ffe661 admin admin] PATH_INFO: `/v3/users/de624ce35a9b4c2b8b0ac5301c54f799` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:38.024713 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96eb0e-da1a-46fd-acd1-f5eed3ffe661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de624ce35a9b4c2b8b0ac5301c54f799)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:38.026934 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96eb0e-da1a-46fd-acd1-f5eed3ffe661 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:38.074835 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9a96eb0e-da1a-46fd-acd1-f5eed3ffe661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de624ce35a9b4c2b8b0ac5301c54f799'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.081266 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9a96eb0e-da1a-46fd-acd1-f5eed3ffe661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de624ce35a9b4c2b8b0ac5301c54f799'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.081909 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9a96eb0e-da1a-46fd-acd1-f5eed3ffe661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de624ce35a9b4c2b8b0ac5301c54f799'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.088654 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9a96eb0e-da1a-46fd-acd1-f5eed3ffe661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de624ce35a9b4c2b8b0ac5301c54f799'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.100458 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-9a96eb0e-da1a-46fd-acd1-f5eed3ffe661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de624ce35a9b4c2b8b0ac5301c54f799'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.106955 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1405/2848] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 17:02:37 2022] DELETE /identity/v3/users/de624ce35a9b4c2b8b0ac5301c54f799 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:38.276030 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ffdb6-a493-4f27-b861-4681f0cd3c9a service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:38.287462 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ffdb6-a493-4f27-b861-4681f0cd3c9a service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:38.341677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b08543-b468-4cf9-adc6-5f7c9638086a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:38.342525 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08543-b468-4cf9-adc6-5f7c9638086a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:38.342848 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08543-b468-4cf9-adc6-5f7c9638086a admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:38.343126 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b08543-b468-4cf9-adc6-5f7c9638086a admin admin] PATH_INFO: `/v3/projects/5e8e5da108f24ed3b3955c8a12bdf580` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:38.344312 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b08543-b468-4cf9-adc6-5f7c9638086a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e8e5da108f24ed3b3955c8a12bdf580)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:38.346216 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b08543-b468-4cf9-adc6-5f7c9638086a admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:38.389594 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c0b08543-b468-4cf9-adc6-5f7c9638086a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e8e5da108f24ed3b3955c8a12bdf580', 'request_id': 'req-c0b08543-b468-4cf9-adc6-5f7c9638086a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.394782 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c0b08543-b468-4cf9-adc6-5f7c9638086a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e8e5da108f24ed3b3955c8a12bdf580', 'request_id': 'req-c0b08543-b468-4cf9-adc6-5f7c9638086a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.400624 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c0b08543-b468-4cf9-adc6-5f7c9638086a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e8e5da108f24ed3b3955c8a12bdf580', 'request_id': 'req-c0b08543-b468-4cf9-adc6-5f7c9638086a'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.412692 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c0b08543-b468-4cf9-adc6-5f7c9638086a admin admin] The token cache is being invalidate because project 5e8e5da108f24ed3b3955c8a12bdf580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:02:38.412916 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c0b08543-b468-4cf9-adc6-5f7c9638086a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.413534 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-c0b08543-b468-4cf9-adc6-5f7c9638086a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.415090 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1444/2849] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 17:02:38 2022] DELETE /identity/v3/projects/5e8e5da108f24ed3b3955c8a12bdf580 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:38.419288 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96eb0e-da1a-46fd-acd1-f5eed3ffe661 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:38.420678 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-9a96eb0e-da1a-46fd-acd1-f5eed3ffe661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:38.434171 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96eb0e-da1a-46fd-acd1-f5eed3ffe661 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:38.488206 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededa6c5-3bf2-4a6c-b329-3823956aac6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:38.489071 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededa6c5-3bf2-4a6c-b329-3823956aac6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:38.489357 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededa6c5-3bf2-4a6c-b329-3823956aac6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:38.489635 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededa6c5-3bf2-4a6c-b329-3823956aac6d admin admin] PATH_INFO: `/v3/users/5a4db63f5fc4457bab3c53ddc94a17b2` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:38.490853 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededa6c5-3bf2-4a6c-b329-3823956aac6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a4db63f5fc4457bab3c53ddc94a17b2)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:38.492757 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ededa6c5-3bf2-4a6c-b329-3823956aac6d admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:38.539021 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ededa6c5-3bf2-4a6c-b329-3823956aac6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a4db63f5fc4457bab3c53ddc94a17b2'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.545979 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ededa6c5-3bf2-4a6c-b329-3823956aac6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a4db63f5fc4457bab3c53ddc94a17b2'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.546618 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ededa6c5-3bf2-4a6c-b329-3823956aac6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a4db63f5fc4457bab3c53ddc94a17b2'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.553193 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ededa6c5-3bf2-4a6c-b329-3823956aac6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a4db63f5fc4457bab3c53ddc94a17b2'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.564210 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-ededa6c5-3bf2-4a6c-b329-3823956aac6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a4db63f5fc4457bab3c53ddc94a17b2'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.569909 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1406/2850] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 17:02:38 2022] DELETE /identity/v3/users/5a4db63f5fc4457bab3c53ddc94a17b2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:38.701196 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b08543-b468-4cf9-adc6-5f7c9638086a admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:38.702644 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-c0b08543-b468-4cf9-adc6-5f7c9638086a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:38.740976 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededa6c5-3bf2-4a6c-b329-3823956aac6d admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:38.742453 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ededa6c5-3bf2-4a6c-b329-3823956aac6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:38.763547 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b08543-b468-4cf9-adc6-5f7c9638086a admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:38.807301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededa6c5-3bf2-4a6c-b329-3823956aac6d admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:38.811123 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596466-979e-4cd7-90c2-3f7f89ed7d2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:38.811758 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596466-979e-4cd7-90c2-3f7f89ed7d2a service cinder] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:38.812039 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596466-979e-4cd7-90c2-3f7f89ed7d2a service cinder] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:38.812318 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596466-979e-4cd7-90c2-3f7f89ed7d2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:38.812478 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93263b14-423f-4d4d-b014-e8a286cb15d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:38.813321 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93263b14-423f-4d4d-b014-e8a286cb15d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:38.813598 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93263b14-423f-4d4d-b014-e8a286cb15d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:38.813988 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93263b14-423f-4d4d-b014-e8a286cb15d5 admin admin] PATH_INFO: `/v3/projects/22b135fb155e41d7895fbbca0d9864b5` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:38.814095 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-59596466-979e-4cd7-90c2-3f7f89ed7d2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:38.815202 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93263b14-423f-4d4d-b014-e8a286cb15d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22b135fb155e41d7895fbbca0d9864b5)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:38.817082 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93263b14-423f-4d4d-b014-e8a286cb15d5 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:38.861760 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-93263b14-423f-4d4d-b014-e8a286cb15d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22b135fb155e41d7895fbbca0d9864b5', 'request_id': 'req-93263b14-423f-4d4d-b014-e8a286cb15d5'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.867176 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-93263b14-423f-4d4d-b014-e8a286cb15d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22b135fb155e41d7895fbbca0d9864b5', 'request_id': 'req-93263b14-423f-4d4d-b014-e8a286cb15d5'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.873681 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-93263b14-423f-4d4d-b014-e8a286cb15d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22b135fb155e41d7895fbbca0d9864b5', 'request_id': 'req-93263b14-423f-4d4d-b014-e8a286cb15d5'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.876167 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59596466-979e-4cd7-90c2-3f7f89ed7d2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:38.877614 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59596466-979e-4cd7-90c2-3f7f89ed7d2a service cinder] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:38.885944 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-93263b14-423f-4d4d-b014-e8a286cb15d5 admin admin] The token cache is being invalidate because project 22b135fb155e41d7895fbbca0d9864b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86345) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:02:38.886227 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-93263b14-423f-4d4d-b014-e8a286cb15d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.887425 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-93263b14-423f-4d4d-b014-e8a286cb15d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:38.888018 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1445/2851] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:02:38.899075 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1407/2852] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 17:02:38 2022] DELETE /identity/v3/projects/22b135fb155e41d7895fbbca0d9864b5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:43.477324 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596466-979e-4cd7-90c2-3f7f89ed7d2a service cinder] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:43.478731 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-59596466-979e-4cd7-90c2-3f7f89ed7d2a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:43.533792 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596466-979e-4cd7-90c2-3f7f89ed7d2a service cinder] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:43.579274 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba44d56-60fc-4c11-9c22-aec8e3fbbb36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:43.579905 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba44d56-60fc-4c11-9c22-aec8e3fbbb36 service neutron] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:43.580186 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba44d56-60fc-4c11-9c22-aec8e3fbbb36 service neutron] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:43.580455 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba44d56-60fc-4c11-9c22-aec8e3fbbb36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:43.582178 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-0ba44d56-60fc-4c11-9c22-aec8e3fbbb36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:43.641388 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba44d56-60fc-4c11-9c22-aec8e3fbbb36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:43.642839 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba44d56-60fc-4c11-9c22-aec8e3fbbb36 service neutron] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:43.651864 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1446/2853] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:02:43.723560 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93263b14-423f-4d4d-b014-e8a286cb15d5 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:43.724969 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-93263b14-423f-4d4d-b014-e8a286cb15d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:43.788159 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93263b14-423f-4d4d-b014-e8a286cb15d5 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:43.792696 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26406262-0f3c-4638-a8b6-c1cf7196cf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:43.793586 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26406262-0f3c-4638-a8b6-c1cf7196cf9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:43.793869 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26406262-0f3c-4638-a8b6-c1cf7196cf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:43.794138 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26406262-0f3c-4638-a8b6-c1cf7196cf9e admin admin] PATH_INFO: `/v3/users/b63338f13d9c43aca450e05ff6ea691f` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:43.795333 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26406262-0f3c-4638-a8b6-c1cf7196cf9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b63338f13d9c43aca450e05ff6ea691f)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:43.797723 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26406262-0f3c-4638-a8b6-c1cf7196cf9e admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:43.845340 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-26406262-0f3c-4638-a8b6-c1cf7196cf9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b63338f13d9c43aca450e05ff6ea691f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:43.852517 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-26406262-0f3c-4638-a8b6-c1cf7196cf9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b63338f13d9c43aca450e05ff6ea691f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:43.853130 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-26406262-0f3c-4638-a8b6-c1cf7196cf9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b63338f13d9c43aca450e05ff6ea691f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:43.860774 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-26406262-0f3c-4638-a8b6-c1cf7196cf9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b63338f13d9c43aca450e05ff6ea691f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:43.873051 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-26406262-0f3c-4638-a8b6-c1cf7196cf9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b63338f13d9c43aca450e05ff6ea691f'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:43.879073 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1408/2854] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 17:02:43 2022] DELETE /identity/v3/users/b63338f13d9c43aca450e05ff6ea691f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:43.883480 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecceb071-435f-4e9e-b69b-46088055d510 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:43.883798 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecceb071-435f-4e9e-b69b-46088055d510 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:43.884076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecceb071-435f-4e9e-b69b-46088055d510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:43.901211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-ecceb071-435f-4e9e-b69b-46088055d510 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:43.902926 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-ecceb071-435f-4e9e-b69b-46088055d510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:43.967001 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1447/2855] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:43.976768 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26406262-0f3c-4638-a8b6-c1cf7196cf9e admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:43.978170 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-26406262-0f3c-4638-a8b6-c1cf7196cf9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:44.039364 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26406262-0f3c-4638-a8b6-c1cf7196cf9e admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:44.043701 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499f0d5-5594-484e-a7ca-97785f004140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:44.044352 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499f0d5-5594-484e-a7ca-97785f004140 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:44.044636 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499f0d5-5594-484e-a7ca-97785f004140 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:44.044917 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499f0d5-5594-484e-a7ca-97785f004140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:44.054049 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499f0d5-5594-484e-a7ca-97785f004140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:44.055515 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499f0d5-5594-484e-a7ca-97785f004140 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:44.064962 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1409/2856] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:02:44.333032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecceb071-435f-4e9e-b69b-46088055d510 None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:44.334849 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-ecceb071-435f-4e9e-b69b-46088055d510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:44.359822 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecceb071-435f-4e9e-b69b-46088055d510 None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:44.365153 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bb799-d69d-451e-be5c-40c94ea66da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:44.366122 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bb799-d69d-451e-be5c-40c94ea66da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:44.366474 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bb799-d69d-451e-be5c-40c94ea66da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:44.366842 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bb799-d69d-451e-be5c-40c94ea66da0 admin admin] PATH_INFO: `/v3/projects/69137dbd240145cab6129f0ed1023128` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:44.368373 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bb799-d69d-451e-be5c-40c94ea66da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69137dbd240145cab6129f0ed1023128)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:44.370636 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bb799-d69d-451e-be5c-40c94ea66da0 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:44.422908 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-201bb799-d69d-451e-be5c-40c94ea66da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69137dbd240145cab6129f0ed1023128', 'request_id': 'req-201bb799-d69d-451e-be5c-40c94ea66da0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:44.428241 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-201bb799-d69d-451e-be5c-40c94ea66da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69137dbd240145cab6129f0ed1023128', 'request_id': 'req-201bb799-d69d-451e-be5c-40c94ea66da0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:44.434917 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-201bb799-d69d-451e-be5c-40c94ea66da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69137dbd240145cab6129f0ed1023128', 'request_id': 'req-201bb799-d69d-451e-be5c-40c94ea66da0'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:44.450305 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-201bb799-d69d-451e-be5c-40c94ea66da0 admin admin] The token cache is being invalidate because project 69137dbd240145cab6129f0ed1023128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:02:44.450797 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-201bb799-d69d-451e-be5c-40c94ea66da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:44.451466 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-201bb799-d69d-451e-be5c-40c94ea66da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:44.453044 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1448/2857] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 17:02:44 2022] DELETE /identity/v3/projects/69137dbd240145cab6129f0ed1023128 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:44.457099 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499f0d5-5594-484e-a7ca-97785f004140 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:44.467695 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499f0d5-5594-484e-a7ca-97785f004140 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:44.524445 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71fbb9-4601-4f21-8216-833fac3da47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:44.525473 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71fbb9-4601-4f21-8216-833fac3da47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:44.525869 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71fbb9-4601-4f21-8216-833fac3da47c admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:44.526149 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71fbb9-4601-4f21-8216-833fac3da47c admin admin] PATH_INFO: `/v3/users/b1d8d4f00de74219a7c77ec6c8cb8572` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:44.527947 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71fbb9-4601-4f21-8216-833fac3da47c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d8d4f00de74219a7c77ec6c8cb8572)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:44.529863 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71fbb9-4601-4f21-8216-833fac3da47c admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:44.577634 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4e71fbb9-4601-4f21-8216-833fac3da47c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d8d4f00de74219a7c77ec6c8cb8572'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:44.584689 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4e71fbb9-4601-4f21-8216-833fac3da47c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d8d4f00de74219a7c77ec6c8cb8572'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:44.585521 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4e71fbb9-4601-4f21-8216-833fac3da47c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d8d4f00de74219a7c77ec6c8cb8572'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:44.592919 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4e71fbb9-4601-4f21-8216-833fac3da47c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d8d4f00de74219a7c77ec6c8cb8572'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:44.607778 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-4e71fbb9-4601-4f21-8216-833fac3da47c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d8d4f00de74219a7c77ec6c8cb8572'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:44.614020 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1410/2858] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 17:02:44 2022] DELETE /identity/v3/users/b1d8d4f00de74219a7c77ec6c8cb8572 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:44.888196 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bb799-d69d-451e-be5c-40c94ea66da0 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:44.889974 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-201bb799-d69d-451e-be5c-40c94ea66da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:44.911064 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bb799-d69d-451e-be5c-40c94ea66da0 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:44.982888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b66a02-ca9a-47c7-b5ab-8519c0676fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:44.983925 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b66a02-ca9a-47c7-b5ab-8519c0676fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:44.984308 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b66a02-ca9a-47c7-b5ab-8519c0676fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:44.984712 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b66a02-ca9a-47c7-b5ab-8519c0676fe1 admin admin] PATH_INFO: `/v3/projects/8b1168a344814fe087e3832d8a6ff506` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:44.986002 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b66a02-ca9a-47c7-b5ab-8519c0676fe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b1168a344814fe087e3832d8a6ff506)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:44.988045 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b66a02-ca9a-47c7-b5ab-8519c0676fe1 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:45.037240 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-62b66a02-ca9a-47c7-b5ab-8519c0676fe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b1168a344814fe087e3832d8a6ff506', 'request_id': 'req-62b66a02-ca9a-47c7-b5ab-8519c0676fe1'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:45.043457 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-62b66a02-ca9a-47c7-b5ab-8519c0676fe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b1168a344814fe087e3832d8a6ff506', 'request_id': 'req-62b66a02-ca9a-47c7-b5ab-8519c0676fe1'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:45.049946 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-62b66a02-ca9a-47c7-b5ab-8519c0676fe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b1168a344814fe087e3832d8a6ff506', 'request_id': 'req-62b66a02-ca9a-47c7-b5ab-8519c0676fe1'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:45.062164 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-62b66a02-ca9a-47c7-b5ab-8519c0676fe1 admin admin] The token cache is being invalidate because project 8b1168a344814fe087e3832d8a6ff506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:02:45.062453 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-62b66a02-ca9a-47c7-b5ab-8519c0676fe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:45.063112 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-62b66a02-ca9a-47c7-b5ab-8519c0676fe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:02:45.064690 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1449/2859] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 17:02:44 2022] DELETE /identity/v3/projects/8b1168a344814fe087e3832d8a6ff506 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:02:45.070655 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a7934-e038-4eff-82ce-7830beb40275 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:45.071124 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a7934-e038-4eff-82ce-7830beb40275 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:45.071270 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a7934-e038-4eff-82ce-7830beb40275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:45.090723 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-af1a7934-e038-4eff-82ce-7830beb40275 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:45.091920 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-af1a7934-e038-4eff-82ce-7830beb40275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:45.151315 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1411/2860] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 17:02:45.159846 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0900a-e971-4526-afbf-9198a58df65f None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:45.160208 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0900a-e971-4526-afbf-9198a58df65f None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:45.160558 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0900a-e971-4526-afbf-9198a58df65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:45.179512 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-d5f0900a-e971-4526-afbf-9198a58df65f None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:45.180698 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-d5f0900a-e971-4526-afbf-9198a58df65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:45.189051 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1450/2861] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:45.193203 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a7934-e038-4eff-82ce-7830beb40275 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:45.202687 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a7934-e038-4eff-82ce-7830beb40275 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:45.207266 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b540789-aa70-4c47-a459-8c06a11aa277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:45.207912 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b540789-aa70-4c47-a459-8c06a11aa277 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:45.208190 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b540789-aa70-4c47-a459-8c06a11aa277 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:45.208460 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b540789-aa70-4c47-a459-8c06a11aa277 admin admin] PATH_INFO: `/v3/domains` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:45.209175 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b540789-aa70-4c47-a459-8c06a11aa277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86345) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 17:02:45.209479 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b540789-aa70-4c47-a459-8c06a11aa277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:45.211112 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b540789-aa70-4c47-a459-8c06a11aa277 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:45.222358 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1412/2862] 10.222.0.73 () {58 vars in 1152 bytes} [Mon Apr 11 17:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 17:02:45.226761 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0900a-e971-4526-afbf-9198a58df65f None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:45.236595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f0900a-e971-4526-afbf-9198a58df65f None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:45.241490 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a962c89-a374-44c8-9843-9fb99cb12948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:45.242157 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a962c89-a374-44c8-9843-9fb99cb12948 admin admin] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:45.242495 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a962c89-a374-44c8-9843-9fb99cb12948 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:45.242815 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a962c89-a374-44c8-9843-9fb99cb12948 admin admin] PATH_INFO: `/v3/projects` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:45.243544 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a962c89-a374-44c8-9843-9fb99cb12948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:45.245541 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a962c89-a374-44c8-9843-9fb99cb12948 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:45.270917 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1451/2863] 10.222.0.73 () {60 vars in 1152 bytes} [Mon Apr 11 17:02:45 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 17:02:45.275048 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b540789-aa70-4c47-a459-8c06a11aa277 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:45.284813 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b540789-aa70-4c47-a459-8c06a11aa277 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:45.341937 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3398f-0a9f-4907-ac72-255900a6e044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:45.342578 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3398f-0a9f-4907-ac72-255900a6e044 admin admin] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:45.342887 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3398f-0a9f-4907-ac72-255900a6e044 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:45.343287 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3398f-0a9f-4907-ac72-255900a6e044 admin admin] PATH_INFO: `/v3/users` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:45.343981 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3398f-0a9f-4907-ac72-255900a6e044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:45.345931 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3398f-0a9f-4907-ac72-255900a6e044 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:45.368966 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1413/2864] 10.222.0.73 () {60 vars in 1143 bytes} [Mon Apr 11 17:02:45 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 17:02:45.370416 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a962c89-a374-44c8-9843-9fb99cb12948 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:45.383193 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a962c89-a374-44c8-9843-9fb99cb12948 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:45.389332 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849b0d7-74d0-47be-ac0f-c2be24f05664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:45.389999 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849b0d7-74d0-47be-ac0f-c2be24f05664 admin admin] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:45.390282 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849b0d7-74d0-47be-ac0f-c2be24f05664 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:45.390558 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849b0d7-74d0-47be-ac0f-c2be24f05664 admin admin] PATH_INFO: `/v3/roles` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:45.391778 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849b0d7-74d0-47be-ac0f-c2be24f05664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:45.393557 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849b0d7-74d0-47be-ac0f-c2be24f05664 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:45.404941 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1452/2865] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:02:45.408699 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3398f-0a9f-4907-ac72-255900a6e044 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:45.419127 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3398f-0a9f-4907-ac72-255900a6e044 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:45.423737 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704245c3-a22b-4e44-a9cd-2907e42a0553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:45.424394 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704245c3-a22b-4e44-a9cd-2907e42a0553 admin admin] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:45.424677 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704245c3-a22b-4e44-a9cd-2907e42a0553 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:45.424949 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704245c3-a22b-4e44-a9cd-2907e42a0553 admin admin] PATH_INFO: `/v3/roles` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:45.425668 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704245c3-a22b-4e44-a9cd-2907e42a0553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:45.427314 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704245c3-a22b-4e44-a9cd-2907e42a0553 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:45.438617 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1414/2866] 10.222.0.73 () {58 vars in 1121 bytes} [Mon Apr 11 17:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 17:02:45.441511 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849b0d7-74d0-47be-ac0f-c2be24f05664 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:45.451589 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849b0d7-74d0-47be-ac0f-c2be24f05664 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:45.456305 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faef8c-fdb8-49fa-bd8f-80ffdd6ef6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:45.457188 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faef8c-fdb8-49fa-bd8f-80ffdd6ef6a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:45.457473 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faef8c-fdb8-49fa-bd8f-80ffdd6ef6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:45.457775 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73faef8c-fdb8-49fa-bd8f-80ffdd6ef6a0 admin admin] PATH_INFO: `/v3/projects/d97ae48ae79a4eb6878c76aca9266b9c/users/4bbdf8f44bd64c898fa10c3a3287e774/roles/7695974856564d4289ab64dbf6dcc119` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:45.489617 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73faef8c-fdb8-49fa-bd8f-80ffdd6ef6a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d97ae48ae79a4eb6878c76aca9266b9c, user_id=4bbdf8f44bd64c898fa10c3a3287e774, role_id=7695974856564d4289ab64dbf6dcc119)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:45.492634 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73faef8c-fdb8-49fa-bd8f-80ffdd6ef6a0 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:45.506684 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1453/2867] 10.222.0.73 () {60 vars in 1482 bytes} [Mon Apr 11 17:02:45 2022] PUT /identity/v3/projects/d97ae48ae79a4eb6878c76aca9266b9c/users/4bbdf8f44bd64c898fa10c3a3287e774/roles/7695974856564d4289ab64dbf6dcc119 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 17:02:45.515218 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a42650-3a6b-44f3-a63c-b5c4cff00512 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:45.515537 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a42650-3a6b-44f3-a63c-b5c4cff00512 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:45.515828 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a42650-3a6b-44f3-a63c-b5c4cff00512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:45.525137 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faef8c-fdb8-49fa-bd8f-80ffdd6ef6a0 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:45.529199 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-73faef8c-fdb8-49fa-bd8f-80ffdd6ef6a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:45.544394 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-37a42650-3a6b-44f3-a63c-b5c4cff00512 None None] MFA Rules not processed for user `f89fba69f1e24fd6b5126bf48028fdd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:45.546386 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-37a42650-3a6b-44f3-a63c-b5c4cff00512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:45.613808 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1415/2868] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:45.626108 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73faef8c-fdb8-49fa-bd8f-80ffdd6ef6a0 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:45.629026 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a42650-3a6b-44f3-a63c-b5c4cff00512 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:45.630634 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-37a42650-3a6b-44f3-a63c-b5c4cff00512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:45.644046 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5e015-ac1d-41ae-b06c-d140157edf0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba3665d046864985916fdd6c4a4edcd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:45.644850 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5e015-ac1d-41ae-b06c-d140157edf0a service nova] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:45.645167 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5e015-ac1d-41ae-b06c-d140157edf0a service nova] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:45.645467 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5e015-ac1d-41ae-b06c-d140157edf0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:45.647286 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-ade5e015-ac1d-41ae-b06c-d140157edf0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:45.660620 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5e015-ac1d-41ae-b06c-d140157edf0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:45.662280 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5e015-ac1d-41ae-b06c-d140157edf0a service nova] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:45.675113 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1454/2869] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 17:02:45.698918 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a42650-3a6b-44f3-a63c-b5c4cff00512 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:45.703543 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86f453-9f5e-4943-81e6-e204a11a6a49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:45.704709 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86f453-9f5e-4943-81e6-e204a11a6a49 service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:45.704991 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86f453-9f5e-4943-81e6-e204a11a6a49 service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:45.705271 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86f453-9f5e-4943-81e6-e204a11a6a49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:45.716382 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86f453-9f5e-4943-81e6-e204a11a6a49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:45.718438 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86f453-9f5e-4943-81e6-e204a11a6a49 service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:45.731207 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1416/2870] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 17:02:46.739078 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a1be4-efb1-478c-881b-4c8c58da76e0 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:46.739600 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a1be4-efb1-478c-881b-4c8c58da76e0 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:46.739688 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a1be4-efb1-478c-881b-4c8c58da76e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:46.769526 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-bd3a1be4-efb1-478c-881b-4c8c58da76e0 None None] MFA Rules not processed for user `4bbdf8f44bd64c898fa10c3a3287e774`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:46.770825 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-bd3a1be4-efb1-478c-881b-4c8c58da76e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:46.859887 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1455/2871] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:02:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:46.872638 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86f453-9f5e-4943-81e6-e204a11a6a49 service neutron] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:46.875429 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-ee86f453-9f5e-4943-81e6-e204a11a6a49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:46.946925 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86f453-9f5e-4943-81e6-e204a11a6a49 service neutron] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:46.950742 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec88c6-6ed4-40ac-a1a0-03178a987ff1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4531e7936634508bb4cbfaaaca5bbde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:46.951416 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec88c6-6ed4-40ac-a1a0-03178a987ff1 service cinder] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:46.951703 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec88c6-6ed4-40ac-a1a0-03178a987ff1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:46.951985 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec88c6-6ed4-40ac-a1a0-03178a987ff1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:46.960968 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec88c6-6ed4-40ac-a1a0-03178a987ff1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:46.962409 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec88c6-6ed4-40ac-a1a0-03178a987ff1 service cinder] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:46.972045 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1417/2872] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 17:02:48.349690 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165b4bd-5ed5-4783-9072-e5f30630f9d9 None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:48.350174 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165b4bd-5ed5-4783-9072-e5f30630f9d9 None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:48.350298 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165b4bd-5ed5-4783-9072-e5f30630f9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:48.368343 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-f165b4bd-5ed5-4783-9072-e5f30630f9d9 None None] MFA Rules not processed for user `4bbdf8f44bd64c898fa10c3a3287e774`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:02:48.369527 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f165b4bd-5ed5-4783-9072-e5f30630f9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:48.377015 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1456/2873] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:02:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:02:48.603973 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec88c6-6ed4-40ac-a1a0-03178a987ff1 service cinder] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:02:48.605402 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-dcec88c6-6ed4-40ac-a1a0-03178a987ff1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:48.617106 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec88c6-6ed4-40ac-a1a0-03178a987ff1 service cinder] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:02:48.620693 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f618b2c-c49d-444f-a3e8-0423ed0f12bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7990c92f59454156bbd99445387ca889', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:02:48.621818 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f618b2c-c49d-444f-a3e8-0423ed0f12bb service neutron] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:02:48.622098 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f618b2c-c49d-444f-a3e8-0423ed0f12bb service neutron] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:02:48.622375 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f618b2c-c49d-444f-a3e8-0423ed0f12bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:02:48.624101 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-7f618b2c-c49d-444f-a3e8-0423ed0f12bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:02:48.633134 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f618b2c-c49d-444f-a3e8-0423ed0f12bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:02:48.634538 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f618b2c-c49d-444f-a3e8-0423ed0f12bb service neutron] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:02:48.643203 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1418/2874] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:02:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 17:03:03.299544 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6a45d-3c27-4fa1-8d2a-c22b13c047db None None] REQUEST_METHOD: `POST` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:03:03.300163 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6a45d-3c27-4fa1-8d2a-c22b13c047db None None] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:03:03.300163 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde6a45d-3c27-4fa1-8d2a-c22b13c047db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:03:03.326379 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.auth.core [None req-dde6a45d-3c27-4fa1-8d2a-c22b13c047db None None] MFA Rules not processed for user `4bbdf8f44bd64c898fa10c3a3287e774`. Rule list: `[]` (Enabled: `True`). {{(pid=86346) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:03:03.327579 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-dde6a45d-3c27-4fa1-8d2a-c22b13c047db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:03:03.349872 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1457/2875] 10.222.0.73 () {58 vars in 957 bytes} [Mon Apr 11 17:03:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 17:03:21.997166 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe6848-8d99-4ce1-bf0f-68468f30b8e5 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:03:21.997668 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe6848-8d99-4ce1-bf0f-68468f30b8e5 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:03:21.997778 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebe6848-8d99-4ce1-bf0f-68468f30b8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:03:22.015952 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-eebe6848-8d99-4ce1-bf0f-68468f30b8e5 None None] MFA Rules not processed for user `e0653575c0a24603bb9287e6222313de`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:03:22.017081 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-eebe6848-8d99-4ce1-bf0f-68468f30b8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:03:22.089126 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1419/2876] 10.222.0.73 () {58 vars in 1009 bytes} [Mon Apr 11 17:03:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:03:22.129338 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6a45d-3c27-4fa1-8d2a-c22b13c047db None None] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:03:22.130821 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-dde6a45d-3c27-4fa1-8d2a-c22b13c047db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:03:22.204032 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde6a45d-3c27-4fa1-8d2a-c22b13c047db None None] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:03:22.208888 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641bf2b-43b4-431e-98fa-bcaa8264c67f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6659c6661840a79ba9ff1c3c9e93c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:03:22.209518 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641bf2b-43b4-431e-98fa-bcaa8264c67f service swift] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:03:22.209796 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641bf2b-43b4-431e-98fa-bcaa8264c67f service swift] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:03:22.210066 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641bf2b-43b4-431e-98fa-bcaa8264c67f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:03:22.218137 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641bf2b-43b4-431e-98fa-bcaa8264c67f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:03:22.219724 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641bf2b-43b4-431e-98fa-bcaa8264c67f service swift] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:03:22.227405 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1458/2877] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Apr 11 17:03:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 17:03:36.597959 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a53af-9078-4de8-9ccf-90878b53f596 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:03:36.598483 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a53af-9078-4de8-9ccf-90878b53f596 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:03:36.598483 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a53af-9078-4de8-9ccf-90878b53f596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:03:36.616242 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-398a53af-9078-4de8-9ccf-90878b53f596 None None] MFA Rules not processed for user `e0653575c0a24603bb9287e6222313de`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:03:36.617399 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-398a53af-9078-4de8-9ccf-90878b53f596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:03:36.624886 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1420/2878] 10.222.0.73 () {58 vars in 967 bytes} [Mon Apr 11 17:03:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:03:36.637517 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641bf2b-43b4-431e-98fa-bcaa8264c67f service swift] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:03:36.647679 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641bf2b-43b4-431e-98fa-bcaa8264c67f service swift] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:03:36.652595 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c45f4-56f9-4d01-88b2-1367f05e6b18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6659c6661840a79ba9ff1c3c9e93c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:03:36.653214 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c45f4-56f9-4d01-88b2-1367f05e6b18 service swift] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:03:36.653491 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c45f4-56f9-4d01-88b2-1367f05e6b18 service swift] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:03:36.653778 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962c45f4-56f9-4d01-88b2-1367f05e6b18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:03:36.661409 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c45f4-56f9-4d01-88b2-1367f05e6b18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:03:36.662998 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962c45f4-56f9-4d01-88b2-1367f05e6b18 service swift] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:03:36.670649 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1459/2879] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Apr 11 17:03:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 11 17:03:38.521239 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a53af-9078-4de8-9ccf-90878b53f596 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:03:38.551235 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a53af-9078-4de8-9ccf-90878b53f596 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:03:38.555796 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e8e1a0-7b08-4104-9069-4da2e2454632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:03:38.556658 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8e1a0-7b08-4104-9069-4da2e2454632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:03:38.556939 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8e1a0-7b08-4104-9069-4da2e2454632 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:03:38.557212 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e8e1a0-7b08-4104-9069-4da2e2454632 admin admin] PATH_INFO: `/v3/users/4bbdf8f44bd64c898fa10c3a3287e774` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:03:38.559008 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8e1a0-7b08-4104-9069-4da2e2454632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bbdf8f44bd64c898fa10c3a3287e774)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:03:38.560903 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e8e1a0-7b08-4104-9069-4da2e2454632 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:03:38.605128 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-43e8e1a0-7b08-4104-9069-4da2e2454632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bbdf8f44bd64c898fa10c3a3287e774'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:03:38.612155 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-43e8e1a0-7b08-4104-9069-4da2e2454632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bbdf8f44bd64c898fa10c3a3287e774'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:03:38.612769 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-43e8e1a0-7b08-4104-9069-4da2e2454632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bbdf8f44bd64c898fa10c3a3287e774'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:03:38.619301 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-43e8e1a0-7b08-4104-9069-4da2e2454632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bbdf8f44bd64c898fa10c3a3287e774'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:03:38.630947 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-43e8e1a0-7b08-4104-9069-4da2e2454632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bbdf8f44bd64c898fa10c3a3287e774'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:03:38.636863 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1421/2880] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 17:03:38 2022] DELETE /identity/v3/users/4bbdf8f44bd64c898fa10c3a3287e774 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:03:38.805722 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c45f4-56f9-4d01-88b2-1367f05e6b18 service swift] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:03:38.816211 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962c45f4-56f9-4d01-88b2-1367f05e6b18 service swift] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:03:38.870747 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5e520-aa16-4be8-9d23-8625feff77c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:03:38.871635 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5e520-aa16-4be8-9d23-8625feff77c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:03:38.871916 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5e520-aa16-4be8-9d23-8625feff77c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:03:38.872192 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5e520-aa16-4be8-9d23-8625feff77c5 admin admin] PATH_INFO: `/v3/projects/d97ae48ae79a4eb6878c76aca9266b9c` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:03:38.873361 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5e520-aa16-4be8-9d23-8625feff77c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d97ae48ae79a4eb6878c76aca9266b9c)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:03:38.875355 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c5e520-aa16-4be8-9d23-8625feff77c5 admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:03:38.920455 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a4c5e520-aa16-4be8-9d23-8625feff77c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd97ae48ae79a4eb6878c76aca9266b9c', 'request_id': 'req-a4c5e520-aa16-4be8-9d23-8625feff77c5'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:03:38.925707 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a4c5e520-aa16-4be8-9d23-8625feff77c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd97ae48ae79a4eb6878c76aca9266b9c', 'request_id': 'req-a4c5e520-aa16-4be8-9d23-8625feff77c5'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:03:38.931579 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a4c5e520-aa16-4be8-9d23-8625feff77c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd97ae48ae79a4eb6878c76aca9266b9c', 'request_id': 'req-a4c5e520-aa16-4be8-9d23-8625feff77c5'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:03:38.955302 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a4c5e520-aa16-4be8-9d23-8625feff77c5 admin admin] The token cache is being invalidate because project d97ae48ae79a4eb6878c76aca9266b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:03:38.955590 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a4c5e520-aa16-4be8-9d23-8625feff77c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:03:38.956242 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-a4c5e520-aa16-4be8-9d23-8625feff77c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:03:38.957890 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1460/2881] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 17:03:38 2022] DELETE /identity/v3/projects/d97ae48ae79a4eb6878c76aca9266b9c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:04:03.253793 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbc44c-da6e-4be4-a599-d798dc3a6c69 None None] REQUEST_METHOD: `POST` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:04:03.254298 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbc44c-da6e-4be4-a599-d798dc3a6c69 None None] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:04:03.254407 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbc44c-da6e-4be4-a599-d798dc3a6c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:04:03.272368 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.auth.core [None req-06dbc44c-da6e-4be4-a599-d798dc3a6c69 None None] MFA Rules not processed for user `e0653575c0a24603bb9287e6222313de`. Rule list: `[]` (Enabled: `True`). {{(pid=86345) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 17:04:03.273535 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-06dbc44c-da6e-4be4-a599-d798dc3a6c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:04:03.325708 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1422/2882] 10.222.0.73 () {58 vars in 967 bytes} [Mon Apr 11 17:04:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 17:04:03.337900 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5e520-aa16-4be8-9d23-8625feff77c5 admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:04:03.339902 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-a4c5e520-aa16-4be8-9d23-8625feff77c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:04:03.404361 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c5e520-aa16-4be8-9d23-8625feff77c5 admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:04:03.409175 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41619c-8737-4fee-a763-3c71d031fb2f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f6659c6661840a79ba9ff1c3c9e93c6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:04:03.409801 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41619c-8737-4fee-a763-3c71d031fb2f service swift] REQUEST_METHOD: `GET` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:04:03.410079 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41619c-8737-4fee-a763-3c71d031fb2f service swift] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:04:03.410345 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de41619c-8737-4fee-a763-3c71d031fb2f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:04:03.417967 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41619c-8737-4fee-a763-3c71d031fb2f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:04:03.419553 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de41619c-8737-4fee-a763-3c71d031fb2f service swift] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:04:03.427102 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1461/2883] 10.222.0.73 () {60 vars in 1384 bytes} [Mon Apr 11 17:04:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 17:04:09.952109 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbc44c-da6e-4be4-a599-d798dc3a6c69 None None] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:04:09.954076 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-06dbc44c-da6e-4be4-a599-d798dc3a6c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:04:10.021385 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbc44c-da6e-4be4-a599-d798dc3a6c69 None None] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:04:10.027378 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd037dd3-a939-4008-92fc-3d1b73ed6669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:04:10.028394 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd037dd3-a939-4008-92fc-3d1b73ed6669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:04:10.028820 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd037dd3-a939-4008-92fc-3d1b73ed6669 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:04:10.028985 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd037dd3-a939-4008-92fc-3d1b73ed6669 admin admin] PATH_INFO: `/v3/users/fcc4ebdac7fb437da89a7fd19cbe6ca8` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:04:10.030261 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd037dd3-a939-4008-92fc-3d1b73ed6669 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcc4ebdac7fb437da89a7fd19cbe6ca8)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:04:10.032287 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd037dd3-a939-4008-92fc-3d1b73ed6669 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:04:10.080658 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-bd037dd3-a939-4008-92fc-3d1b73ed6669 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcc4ebdac7fb437da89a7fd19cbe6ca8'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.089836 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-bd037dd3-a939-4008-92fc-3d1b73ed6669 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcc4ebdac7fb437da89a7fd19cbe6ca8'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.091278 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-bd037dd3-a939-4008-92fc-3d1b73ed6669 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcc4ebdac7fb437da89a7fd19cbe6ca8'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.099995 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-bd037dd3-a939-4008-92fc-3d1b73ed6669 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcc4ebdac7fb437da89a7fd19cbe6ca8'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.114571 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-bd037dd3-a939-4008-92fc-3d1b73ed6669 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcc4ebdac7fb437da89a7fd19cbe6ca8'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.125517 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1423/2884] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 17:04:09 2022] DELETE /identity/v3/users/fcc4ebdac7fb437da89a7fd19cbe6ca8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:04:10.309867 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41619c-8737-4fee-a763-3c71d031fb2f service swift] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:04:10.322859 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de41619c-8737-4fee-a763-3c71d031fb2f service swift] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:04:10.378677 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102d1e6-e7fa-4797-929c-a6104c8cccce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:04:10.379454 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102d1e6-e7fa-4797-929c-a6104c8cccce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:04:10.379733 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102d1e6-e7fa-4797-929c-a6104c8cccce admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:04:10.380003 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102d1e6-e7fa-4797-929c-a6104c8cccce admin admin] PATH_INFO: `/v3/projects/c7994d24146849ada7ff0333c09e7f82` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:04:10.381150 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102d1e6-e7fa-4797-929c-a6104c8cccce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7994d24146849ada7ff0333c09e7f82)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:04:10.383078 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f102d1e6-e7fa-4797-929c-a6104c8cccce admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:04:10.426534 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-f102d1e6-e7fa-4797-929c-a6104c8cccce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7994d24146849ada7ff0333c09e7f82', 'request_id': 'req-f102d1e6-e7fa-4797-929c-a6104c8cccce'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.431711 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-f102d1e6-e7fa-4797-929c-a6104c8cccce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7994d24146849ada7ff0333c09e7f82', 'request_id': 'req-f102d1e6-e7fa-4797-929c-a6104c8cccce'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.438021 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-f102d1e6-e7fa-4797-929c-a6104c8cccce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7994d24146849ada7ff0333c09e7f82', 'request_id': 'req-f102d1e6-e7fa-4797-929c-a6104c8cccce'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.449526 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-f102d1e6-e7fa-4797-929c-a6104c8cccce admin admin] The token cache is being invalidate because project c7994d24146849ada7ff0333c09e7f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:04:10.449809 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-f102d1e6-e7fa-4797-929c-a6104c8cccce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.450418 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-f102d1e6-e7fa-4797-929c-a6104c8cccce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.452131 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1462/2885] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 17:04:10 2022] DELETE /identity/v3/projects/c7994d24146849ada7ff0333c09e7f82 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:04:10.456049 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd037dd3-a939-4008-92fc-3d1b73ed6669 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:04:10.457418 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-bd037dd3-a939-4008-92fc-3d1b73ed6669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:04:10.470194 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd037dd3-a939-4008-92fc-3d1b73ed6669 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:04:10.525307 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e518e-3eb2-447c-a3eb-d97fdfa458a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:04:10.526092 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e518e-3eb2-447c-a3eb-d97fdfa458a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:04:10.526395 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e518e-3eb2-447c-a3eb-d97fdfa458a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:04:10.526691 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e518e-3eb2-447c-a3eb-d97fdfa458a8 admin admin] PATH_INFO: `/v3/users/de152c199730454d9435353957088987` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:04:10.527876 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e518e-3eb2-447c-a3eb-d97fdfa458a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de152c199730454d9435353957088987)` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:04:10.529780 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e518e-3eb2-447c-a3eb-d97fdfa458a8 admin admin] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:04:10.572463 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d90e518e-3eb2-447c-a3eb-d97fdfa458a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de152c199730454d9435353957088987'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.579893 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d90e518e-3eb2-447c-a3eb-d97fdfa458a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de152c199730454d9435353957088987'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.580550 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d90e518e-3eb2-447c-a3eb-d97fdfa458a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de152c199730454d9435353957088987'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.587370 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d90e518e-3eb2-447c-a3eb-d97fdfa458a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de152c199730454d9435353957088987'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.598286 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.notifications [None req-d90e518e-3eb2-447c-a3eb-d97fdfa458a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de152c199730454d9435353957088987'} {{(pid=86345) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.603905 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1424/2886] 10.222.0.73 () {58 vars in 1223 bytes} [Mon Apr 11 17:04:10 2022] DELETE /identity/v3/users/de152c199730454d9435353957088987 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:04:10.773588 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102d1e6-e7fa-4797-929c-a6104c8cccce admin admin] Authenticating user token {{(pid=86346) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:04:10.775040 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.fernet_utils [None req-f102d1e6-e7fa-4797-929c-a6104c8cccce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86346) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:04:10.787867 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102d1e6-e7fa-4797-929c-a6104c8cccce admin admin] Validating token access rules against request {{(pid=86346) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:04:10.842559 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6197cd61-b347-44e7-9e72-6aacb5c76a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f89fba69f1e24fd6b5126bf48028fdd1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f8c9bf4c662c47e3808d264d2ea01d67', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86346) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:04:10.843433 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197cd61-b347-44e7-9e72-6aacb5c76a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:04:10.843714 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197cd61-b347-44e7-9e72-6aacb5c76a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:04:10.843989 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6197cd61-b347-44e7-9e72-6aacb5c76a5d admin admin] PATH_INFO: `/v3/projects/8e93d4be3f5e4f57ab92462022ff48dd` {{(pid=86346) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:04:10.845146 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197cd61-b347-44e7-9e72-6aacb5c76a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e93d4be3f5e4f57ab92462022ff48dd)` {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:04:10.847076 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6197cd61-b347-44e7-9e72-6aacb5c76a5d admin admin] RBAC: Authorization granted {{(pid=86346) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:04:10.890406 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6197cd61-b347-44e7-9e72-6aacb5c76a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e93d4be3f5e4f57ab92462022ff48dd', 'request_id': 'req-6197cd61-b347-44e7-9e72-6aacb5c76a5d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.895643 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6197cd61-b347-44e7-9e72-6aacb5c76a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e93d4be3f5e4f57ab92462022ff48dd', 'request_id': 'req-6197cd61-b347-44e7-9e72-6aacb5c76a5d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.902127 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6197cd61-b347-44e7-9e72-6aacb5c76a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e93d4be3f5e4f57ab92462022ff48dd', 'request_id': 'req-6197cd61-b347-44e7-9e72-6aacb5c76a5d'} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.914301 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6197cd61-b347-44e7-9e72-6aacb5c76a5d admin admin] The token cache is being invalidate because project 8e93d4be3f5e4f57ab92462022ff48dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86346) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 17:04:10.914606 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6197cd61-b347-44e7-9e72-6aacb5c76a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.915366 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: DEBUG keystone.notifications [None req-6197cd61-b347-44e7-9e72-6aacb5c76a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86346) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 17:04:10.917004 dv-cinder-837166-2-iscsi devstack@keystone.service[86346]: [pid: 86346|app: 0|req: 1463/2887] 10.222.0.73 () {58 vars in 1232 bytes} [Mon Apr 11 17:04:10 2022] DELETE /identity/v3/projects/8e93d4be3f5e4f57ab92462022ff48dd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 17:04:53.403113 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e518e-3eb2-447c-a3eb-d97fdfa458a8 admin admin] Authenticating user token {{(pid=86345) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 17:04:53.404507 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-d90e518e-3eb2-447c-a3eb-d97fdfa458a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:04:53.491891 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e518e-3eb2-447c-a3eb-d97fdfa458a8 admin admin] Validating token access rules against request {{(pid=86345) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 17:04:53.547622 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78a54f-ebc5-4b1e-a5d4-df9c50c37ff6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85f5ef8708f54401af7e8defa8d13141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c1eb8559ca744abda7039b767af5818f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86345) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 17:04:53.548782 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78a54f-ebc5-4b1e-a5d4-df9c50c37ff6 service placement] REQUEST_METHOD: `GET` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 17:04:53.549096 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78a54f-ebc5-4b1e-a5d4-df9c50c37ff6 service placement] SCRIPT_NAME: `/identity` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 17:04:53.549442 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78a54f-ebc5-4b1e-a5d4-df9c50c37ff6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86345) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 17:04:53.551491 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.fernet_utils [None req-fd78a54f-ebc5-4b1e-a5d4-df9c50c37ff6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86345) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 17:04:53.562403 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78a54f-ebc5-4b1e-a5d4-df9c50c37ff6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 17:04:53.564642 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78a54f-ebc5-4b1e-a5d4-df9c50c37ff6 service placement] RBAC: Authorization granted {{(pid=86345) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 17:04:53.574197 dv-cinder-837166-2-iscsi devstack@keystone.service[86345]: [pid: 86345|app: 0|req: 1425/2888] 10.222.0.73 () {60 vars in 1365 bytes} [Mon Apr 11 17:04:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)